[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:46.242008 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:40945
I20260709 13:05:46.243696 11576 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:46.244872 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:46.265123 11582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:46.265120 11583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:46.267628 11576 server_base.cc:1061] running on GCE node
W20260709 13:05:46.265061 11585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:47.621877 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:47.622131 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:47.622293 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602347622275 us; error 0 us; skew 500 ppm
I20260709 13:05:47.623091 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:47.629029 11576 webserver.cc:533] Webserver started at http://127.11.78.62:44009/ using document root <none> and password file <none>
I20260709 13:05:47.629925 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:47.630127 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:47.630548 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:47.637017 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "aff1c5475a9c422896ef3137a63d9f5e"
format_stamp: "Formatted at 2026-07-09 13:05:47 on dist-test-slave-smzk"
I20260709 13:05:47.646386 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:47.652772 11591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:47.654548 11576 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:05:47.655053 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "aff1c5475a9c422896ef3137a63d9f5e"
format_stamp: "Formatted at 2026-07-09 13:05:47 on dist-test-slave-smzk"
I20260709 13:05:47.655441 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:47.733922 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:47.735919 11576 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:47.736584 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:47.829829 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:40945
I20260709 13:05:47.829913 11642 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:40945 every 8 connection(s)
I20260709 13:05:47.839365 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.863391 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: Bootstrap starting.
I20260709 13:05:47.870265 11643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.872272 11643 log.cc:826] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:47.877959 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: No bootstrap required, opened a new log
I20260709 13:05:47.899402 11643 raft_consensus.cc:359] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER }
I20260709 13:05:47.900035 11643 raft_consensus.cc:385] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.900380 11643 raft_consensus.cc:740] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff1c5475a9c422896ef3137a63d9f5e, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.901435 11643 consensus_queue.cc:260] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER }
I20260709 13:05:47.901971 11643 raft_consensus.cc:399] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:47.902807 11643 raft_consensus.cc:493] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:47.903260 11643 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.908483 11643 raft_consensus.cc:515] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER }
I20260709 13:05:47.909379 11643 leader_election.cc:304] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aff1c5475a9c422896ef3137a63d9f5e; no voters: 
I20260709 13:05:47.911319 11643 leader_election.cc:290] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:47.911916 11646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.915407 11646 raft_consensus.cc:697] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 1 LEADER]: Becoming Leader. State: Replica: aff1c5475a9c422896ef3137a63d9f5e, State: Running, Role: LEADER
I20260709 13:05:47.916595 11646 consensus_queue.cc:237] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER }
I20260709 13:05:47.917726 11643 sys_catalog.cc:565] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:47.935341 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aff1c5475a9c422896ef3137a63d9f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER } }
I20260709 13:05:47.935681 11648 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader aff1c5475a9c422896ef3137a63d9f5e. Latest consensus state: current_term: 1 leader_uuid: "aff1c5475a9c422896ef3137a63d9f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff1c5475a9c422896ef3137a63d9f5e" member_type: VOTER } }
I20260709 13:05:47.936312 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:47.936383 11648 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:47.940825 11656 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:47.953796 11656 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:47.959306 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:47.975198 11656 catalog_manager.cc:1383] Generated new cluster ID: 259abfc5ffa7422a8ba5ff2cb37ce1ab
I20260709 13:05:47.975575 11656 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:47.998755 11656 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:48.001201 11656 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:48.019112 11656 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: Generated new TSK 0
I20260709 13:05:48.020591 11656 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:48.026875 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:48.038336 11665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:48.039729 11666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:48.044710 11668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:48.049284 11576 server_base.cc:1061] running on GCE node
I20260709 13:05:48.050194 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:48.050396 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:48.050601 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602348050586 us; error 0 us; skew 500 ppm
I20260709 13:05:48.051255 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:48.056296 11576 webserver.cc:533] Webserver started at http://127.11.78.1:37887/ using document root <none> and password file <none>
I20260709 13:05:48.056912 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:48.057122 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:48.057461 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:48.058633 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "1e3ee0b8e63e438fb861810834b07195"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.064890 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:48.070252 11673 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.071382 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:05:48.071861 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "1e3ee0b8e63e438fb861810834b07195"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.072304 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:48.101169 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:48.102850 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:48.105777 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:48.111379 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:48.111660 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.112030 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:48.112260 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:48.241317 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:46411
I20260709 13:05:48.241433 11735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:46411 every 8 connection(s)
I20260709 13:05:48.251142 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:48.262974 11740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:48.264392 11741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:48.274381 11743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:48.276440 11576 server_base.cc:1061] running on GCE node
I20260709 13:05:48.277621 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:48.277904 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:48.278410 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602348278388 us; error 0 us; skew 500 ppm
I20260709 13:05:48.279305 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:48.283648 11576 webserver.cc:533] Webserver started at http://127.11.78.2:39683/ using document root <none> and password file <none>
I20260709 13:05:48.284440 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:48.284713 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:48.285243 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:48.286285 11736 heartbeater.cc:344] Connected to a master server at 127.11.78.62:40945
I20260709 13:05:48.286815 11736 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:48.286836 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "2234dde46ccf4fcfa1f418419fddcebf"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.288369 11736 heartbeater.cc:507] Master 127.11.78.62:40945 requested a full tablet report, sending...
I20260709 13:05:48.292018 11608 ts_manager.cc:194] Registered new tserver with Master: 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411)
I20260709 13:05:48.294656 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:48.295384 11608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42816
I20260709 13:05:48.300614 11748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.301783 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:48.302291 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "2234dde46ccf4fcfa1f418419fddcebf"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.302688 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:48.345989 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:48.347821 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:48.350934 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:48.355142 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:48.355456 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.355751 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:48.355983 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.459213 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:43221
I20260709 13:05:48.459424 11810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:43221 every 8 connection(s)
I20260709 13:05:48.466125 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:48.476619 11814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:48.478605 11815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:48.483738 11811 heartbeater.cc:344] Connected to a master server at 127.11.78.62:40945
I20260709 13:05:48.484305 11811 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:48.484887 11817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:48.485509 11811 heartbeater.cc:507] Master 127.11.78.62:40945 requested a full tablet report, sending...
I20260709 13:05:48.488421 11608 ts_manager.cc:194] Registered new tserver with Master: 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:48.488524 11576 server_base.cc:1061] running on GCE node
I20260709 13:05:48.489779 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:48.490288 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:48.490636 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602348490607 us; error 0 us; skew 500 ppm
I20260709 13:05:48.490989 11608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42824
I20260709 13:05:48.491255 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:48.495352 11576 webserver.cc:533] Webserver started at http://127.11.78.3:38129/ using document root <none> and password file <none>
I20260709 13:05:48.495995 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:48.496315 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:48.496618 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:48.497946 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "56ad779bd4974f29b8436ea08c74ac43"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.503321 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:05:48.508286 11822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.509735 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:48.510298 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "56ad779bd4974f29b8436ea08c74ac43"
format_stamp: "Formatted at 2026-07-09 13:05:48 on dist-test-slave-smzk"
I20260709 13:05:48.510751 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:48.538533 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:48.540174 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:48.542101 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:48.544843 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:48.545113 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.545394 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:48.545588 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:48.657667 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:36077
I20260709 13:05:48.657925 11884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:36077 every 8 connection(s)
I20260709 13:05:48.677378 11885 heartbeater.cc:344] Connected to a master server at 127.11.78.62:40945
I20260709 13:05:48.677832 11885 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:48.678836 11885 heartbeater.cc:507] Master 127.11.78.62:40945 requested a full tablet report, sending...
I20260709 13:05:48.681370 11608 ts_manager.cc:194] Registered new tserver with Master: 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:48.681968 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01895422s
I20260709 13:05:48.683384 11608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42828
I20260709 13:05:48.759871 11608 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42830:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:48.765691 11608 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:48.878306 11850 tablet_service.cc:1511] Processing CreateTablet for tablet 488e99663ad54e4e965b2b0e0c5b8039 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.877960 11849 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff24cc162d4a25914a6a56d0aca205 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.883410 11848 tablet_service.cc:1511] Processing CreateTablet for tablet 433301372d8549739935288ae1115423 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:48.885092 11850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488e99663ad54e4e965b2b0e0c5b8039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.886353 11848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433301372d8549739935288ae1115423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.888273 11849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff24cc162d4a25914a6a56d0aca205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.891964 11847 tablet_service.cc:1511] Processing CreateTablet for tablet 73ca4f7069454f3ba8b52bd0705cd100 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:48.893896 11847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ca4f7069454f3ba8b52bd0705cd100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.905980 11846 tablet_service.cc:1511] Processing CreateTablet for tablet e7a03f44922f4f4180d0dd15652eb915 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:48.909142 11846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a03f44922f4f4180d0dd15652eb915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.931377 11845 tablet_service.cc:1511] Processing CreateTablet for tablet 1819933e41e3465d9eec82f8dbcabc4e (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:48.941598 11776 tablet_service.cc:1511] Processing CreateTablet for tablet 488e99663ad54e4e965b2b0e0c5b8039 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.944932 11775 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff24cc162d4a25914a6a56d0aca205 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.952705 11845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1819933e41e3465d9eec82f8dbcabc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.951287 11774 tablet_service.cc:1511] Processing CreateTablet for tablet 433301372d8549739935288ae1115423 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:48.962441 11773 tablet_service.cc:1511] Processing CreateTablet for tablet 73ca4f7069454f3ba8b52bd0705cd100 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:48.964162 11844 tablet_service.cc:1511] Processing CreateTablet for tablet d3f5edcb2de64586998b557e132ad42f (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:48.961123 11776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488e99663ad54e4e965b2b0e0c5b8039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.968876 11844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f5edcb2de64586998b557e132ad42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.981145 11770 tablet_service.cc:1511] Processing CreateTablet for tablet d3f5edcb2de64586998b557e132ad42f (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:48.985580 11701 tablet_service.cc:1511] Processing CreateTablet for tablet 488e99663ad54e4e965b2b0e0c5b8039 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.989048 11701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488e99663ad54e4e965b2b0e0c5b8039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.989131 11700 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff24cc162d4a25914a6a56d0aca205 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.989825 11771 tablet_service.cc:1511] Processing CreateTablet for tablet 1819933e41e3465d9eec82f8dbcabc4e (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:48.990278 11773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ca4f7069454f3ba8b52bd0705cd100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.997601 11700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff24cc162d4a25914a6a56d0aca205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.992817 11772 tablet_service.cc:1511] Processing CreateTablet for tablet e7a03f44922f4f4180d0dd15652eb915 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 13:05:48.995277 11655 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:49.002992 11699 tablet_service.cc:1511] Processing CreateTablet for tablet 433301372d8549739935288ae1115423 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:49.016619 11774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433301372d8549739935288ae1115423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.027390 11699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433301372d8549739935288ae1115423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.020913 11698 tablet_service.cc:1511] Processing CreateTablet for tablet 73ca4f7069454f3ba8b52bd0705cd100 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:49.044637 11903 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.044876 11695 tablet_service.cc:1511] Processing CreateTablet for tablet d3f5edcb2de64586998b557e132ad42f (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:49.038475 11770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f5edcb2de64586998b557e132ad42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.034448 11697 tablet_service.cc:1511] Processing CreateTablet for tablet e7a03f44922f4f4180d0dd15652eb915 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:49.053808 11769 tablet_service.cc:1511] Processing CreateTablet for tablet ec135fc0cba6467f9eca3d28a7783c94 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:49.061479 11696 tablet_service.cc:1511] Processing CreateTablet for tablet 1819933e41e3465d9eec82f8dbcabc4e (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:49.062002 11694 tablet_service.cc:1511] Processing CreateTablet for tablet ec135fc0cba6467f9eca3d28a7783c94 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:49.072005 11698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ca4f7069454f3ba8b52bd0705cd100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.073218 11695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f5edcb2de64586998b557e132ad42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.074404 11694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec135fc0cba6467f9eca3d28a7783c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.086246 11697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a03f44922f4f4180d0dd15652eb915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.086349 11772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a03f44922f4f4180d0dd15652eb915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.094008 11696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1819933e41e3465d9eec82f8dbcabc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.104825 11775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff24cc162d4a25914a6a56d0aca205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.097170 11847 tablet_service.cc:1511] Processing CreateTablet for tablet ec135fc0cba6467f9eca3d28a7783c94 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:49.112428 11769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec135fc0cba6467f9eca3d28a7783c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.112416 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb429336d624eefa0cbf908555b35f3 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:49.123751 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb429336d624eefa0cbf908555b35f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.123795 11847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec135fc0cba6467f9eca3d28a7783c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.143513 11771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1819933e41e3465d9eec82f8dbcabc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.147354 11768 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb429336d624eefa0cbf908555b35f3 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:49.154304 11768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb429336d624eefa0cbf908555b35f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.156760 11849 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb429336d624eefa0cbf908555b35f3 (DEFAULT_TABLE table=test-workload [id=7c5a9136c14649bcb857d42fb99f5338]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:49.158669 11849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb429336d624eefa0cbf908555b35f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.200417 11903 tablet_bootstrap.cc:654] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.299615 11736 heartbeater.cc:499] Master 127.11.78.62:40945 was elected leader, sending a full tablet report...
I20260709 13:05:49.309403 11904 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:49.312451 11905 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.318004 11903 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.330093 11903 ts_tablet_manager.cc:1403] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.305s	user 0.017s	sys 0.005s
I20260709 13:05:49.336474 11903 raft_consensus.cc:359] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.337466 11903 raft_consensus.cc:385] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.342374 11904 tablet_bootstrap.cc:654] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.337836 11903 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.343453 11903 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.345531 11905 tablet_bootstrap.cc:654] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.359642 11905 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.360451 11905 ts_tablet_manager.cc:1403] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.008s
I20260709 13:05:49.361884 11903 ts_tablet_manager.cc:1434] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.010s
I20260709 13:05:49.361868 11885 heartbeater.cc:499] Master 127.11.78.62:40945 was elected leader, sending a full tablet report...
I20260709 13:05:49.363188 11903 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.365056 11904 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:49.365628 11904 ts_tablet_manager.cc:1403] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.021s
I20260709 13:05:49.368939 11905 raft_consensus.cc:359] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.369863 11905 raft_consensus.cc:385] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.370229 11905 raft_consensus.cc:740] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.370618 11903 tablet_bootstrap.cc:654] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.371145 11905 consensus_queue.cc:260] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.381943 11905 ts_tablet_manager.cc:1434] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:05:49.383561 11905 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.390110 11904 raft_consensus.cc:359] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.391031 11904 raft_consensus.cc:385] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.391384 11904 raft_consensus.cc:740] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.391814 11903 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.393389 11903 ts_tablet_manager.cc:1403] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.020s
I20260709 13:05:49.393421 11905 tablet_bootstrap.cc:654] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.396706 11903 raft_consensus.cc:359] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.397563 11903 raft_consensus.cc:385] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.397826 11903 raft_consensus.cc:740] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.398581 11903 consensus_queue.cc:260] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.399948 11905 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.400552 11905 ts_tablet_manager.cc:1403] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:05:49.400362 11904 consensus_queue.cc:260] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.404135 11903 ts_tablet_manager.cc:1434] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:49.403841 11905 raft_consensus.cc:359] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.404660 11905 raft_consensus.cc:385] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.404976 11905 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.405851 11905 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.406589 11903 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.408129 11905 ts_tablet_manager.cc:1434] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:05:49.411477 11905 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.411660 11904 ts_tablet_manager.cc:1434] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.007s
W20260709 13:05:49.415088 11886 tablet.cc:2406] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:49.416551 11903 tablet_bootstrap.cc:654] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.419945 11905 tablet_bootstrap.cc:654] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.422067 11811 heartbeater.cc:499] Master 127.11.78.62:40945 was elected leader, sending a full tablet report...
I20260709 13:05:49.424381 11903 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.425012 11903 ts_tablet_manager.cc:1403] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:05:49.425722 11904 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:49.435883 11905 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.436561 11905 ts_tablet_manager.cc:1403] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:05:49.436944 11904 tablet_bootstrap.cc:654] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.437892 11903 raft_consensus.cc:359] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.438843 11903 raft_consensus.cc:385] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.443786 11903 raft_consensus.cc:740] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.440004 11905 raft_consensus.cc:359] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.444475 11905 raft_consensus.cc:385] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.444885 11905 raft_consensus.cc:740] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.444900 11903 consensus_queue.cc:260] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.445967 11905 consensus_queue.cc:260] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.444085 11904 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:49.449002 11905 ts_tablet_manager.cc:1434] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:05:49.450237 11905 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.452394 11903 ts_tablet_manager.cc:1434] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:49.458719 11905 tablet_bootstrap.cc:654] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.461346 11904 ts_tablet_manager.cc:1403] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 13:05:49.464885 11903 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.465629 11904 raft_consensus.cc:359] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.466385 11904 raft_consensus.cc:385] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.466888 11904 raft_consensus.cc:740] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.468339 11904 consensus_queue.cc:260] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.473687 11905 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.474596 11905 ts_tablet_manager.cc:1403] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:05:49.475801 11903 tablet_bootstrap.cc:654] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.478765 11905 raft_consensus.cc:359] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.479809 11905 raft_consensus.cc:385] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.480217 11905 raft_consensus.cc:740] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.480295 11904 ts_tablet_manager.cc:1434] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:05:49.481213 11905 consensus_queue.cc:260] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.484498 11905 ts_tablet_manager.cc:1434] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:05:49.485764 11905 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.491367 11904 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:49.494639 11905 tablet_bootstrap.cc:654] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.496284 11903 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.496831 11903 ts_tablet_manager.cc:1403] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 13:05:49.500452 11903 raft_consensus.cc:359] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.501328 11903 raft_consensus.cc:385] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.501649 11903 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.503355 11903 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.506767 11903 ts_tablet_manager.cc:1434] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:05:49.508124 11903 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.515869 11903 tablet_bootstrap.cc:654] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.518088 11904 tablet_bootstrap.cc:654] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.520897 11905 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.521533 11905 ts_tablet_manager.cc:1403] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.008s
I20260709 13:05:49.525051 11905 raft_consensus.cc:359] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.526427 11905 raft_consensus.cc:385] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.527550 11905 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.529318 11905 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.533936 11904 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:49.534044 11905 ts_tablet_manager.cc:1434] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:05:49.534682 11904 ts_tablet_manager.cc:1403] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.011s
I20260709 13:05:49.534965 11907 raft_consensus.cc:493] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.535625 11907 raft_consensus.cc:515] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.536489 11905 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.538239 11904 raft_consensus.cc:359] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.539057 11904 raft_consensus.cc:385] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.539422 11904 raft_consensus.cc:740] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.540989 11904 consensus_queue.cc:260] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.545800 11905 tablet_bootstrap.cc:654] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.547197 11907 leader_election.cc:290] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.553135 11903 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.554035 11903 ts_tablet_manager.cc:1403] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.005s
I20260709 13:05:49.562294 11913 raft_consensus.cc:493] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.562938 11913 raft_consensus.cc:515] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.566023 11913 leader_election.cc:290] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.568408 11905 tablet_bootstrap.cc:492] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.569020 11905 ts_tablet_manager.cc:1403] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.006s
I20260709 13:05:49.572801 11905 raft_consensus.cc:359] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.573729 11905 raft_consensus.cc:385] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.575819 11905 raft_consensus.cc:740] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.578176 11903 raft_consensus.cc:359] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.578224 11905 consensus_queue.cc:260] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.586561 11904 ts_tablet_manager.cc:1434] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.004s
I20260709 13:05:49.579816 11903 raft_consensus.cc:385] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.589594 11904 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:49.589787 11903 raft_consensus.cc:740] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.590150 11905 ts_tablet_manager.cc:1434] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:05:49.591029 11903 consensus_queue.cc:260] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.594545 11905 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.598562 11907 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.599282 11907 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.602218 11907 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.612962 11903 ts_tablet_manager.cc:1434] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 13:05:49.614394 11910 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.615092 11910 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.621990 11910 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.624188 11903 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.632946 11907 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.633709 11907 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.636917 11907 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.638419 11910 raft_consensus.cc:493] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.638703 11903 tablet_bootstrap.cc:654] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.639077 11910 raft_consensus.cc:515] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.641695 11910 leader_election.cc:290] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.644194 11905 tablet_bootstrap.cc:654] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.660029 11904 tablet_bootstrap.cc:654] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.664232 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.678436 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.690284 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
W20260709 13:05:49.689222 11823 leader_election.cc:343] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.704663 11786 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:49.698005 11907 raft_consensus.cc:493] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.712368 11907 raft_consensus.cc:515] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.696527 11711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.714809 11711 raft_consensus.cc:2468] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 0.
I20260709 13:05:49.720824 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
W20260709 13:05:49.715706 11823 leader_election.cc:343] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.729135 11823 leader_election.cc:304] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:49.732100 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.716809 11907 leader_election.cc:290] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411)
I20260709 13:05:49.734356 11907 raft_consensus.cc:2804] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.738319 11913 raft_consensus.cc:493] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.740424 11913 raft_consensus.cc:515] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.740613 11711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.741806 11711 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:49.742821 11913 leader_election.cc:290] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.743644 11907 raft_consensus.cc:493] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.744195 11907 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:49.744728 11823 leader_election.cc:343] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.728427 11752 leader_election.cc:304] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:49.739773 11903 tablet_bootstrap.cc:492] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:49.747453 11913 raft_consensus.cc:2804] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:49.747552 11751 leader_election.cc:343] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.747946 11913 raft_consensus.cc:493] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.748611 11913 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.746237 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.752501 11903 ts_tablet_manager.cc:1403] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.129s	user 0.019s	sys 0.021s
I20260709 13:05:49.757543 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.758813 11710 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:49.759383 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:49.760664 11711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.761440 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.762984 11710 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
W20260709 13:05:49.761509 11751 leader_election.cc:343] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.766163 11905 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:49.766961 11905 ts_tablet_manager.cc:1403] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.019s
W20260709 13:05:49.767176 11752 leader_election.cc:343] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:49.769349 11826 leader_election.cc:343] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.770987 11826 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56ad779bd4974f29b8436ea08c74ac43; no voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:49.772950 11752 leader_election.cc:304] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf; no voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:49.774322 11931 raft_consensus.cc:2749] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.778836 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:49.778968 11826 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:49.779685 11860 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 0.
I20260709 13:05:49.780112 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.780360 11931 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.781127 11931 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.779721 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.782078 11931 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.781059 11784 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 0.
I20260709 13:05:49.783372 11826 leader_election.cc:304] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:49.775017 11903 raft_consensus.cc:359] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.785391 11903 raft_consensus.cc:385] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.781874 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:49.787972 11674 leader_election.cc:304] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:49.790043 11910 raft_consensus.cc:2804] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.790446 11910 raft_consensus.cc:493] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.790934 11910 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.786330 11903 raft_consensus.cc:740] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.796909 11904 tablet_bootstrap.cc:492] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:49.791493 11676 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
W20260709 13:05:49.798820 11674 leader_election.cc:343] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.794445 11903 consensus_queue.cc:260] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.790469 11905 raft_consensus.cc:359] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.798872 11904 ts_tablet_manager.cc:1403] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.210s	user 0.032s	sys 0.060s
I20260709 13:05:49.810412 11905 raft_consensus.cc:385] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.813443 11905 raft_consensus.cc:740] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.818207 11940 raft_consensus.cc:2804] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.818814 11940 raft_consensus.cc:493] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.818601 11910 raft_consensus.cc:515] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.819308 11940 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:49.812203 11752 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:46411, user_credentials={real_user=slave}} blocked reactor thread for 49941.6us
I20260709 13:05:49.824074 11910 leader_election.cc:290] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.824805 11910 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.824898 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:49.825225 11910 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.825503 11786 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.825582 11910 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.828707 11939 raft_consensus.cc:2749] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.826596 11905 consensus_queue.cc:260] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.837809 11903 ts_tablet_manager.cc:1434] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.078s	user 0.012s	sys 0.010s
I20260709 13:05:49.831383 11913 raft_consensus.cc:515] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.845530 11903 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:49.849643 11905 ts_tablet_manager.cc:1434] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.002s
I20260709 13:05:49.828284 11907 raft_consensus.cc:515] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.848968 11786 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 1.
I20260709 13:05:49.856561 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:49.860096 11710 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.860669 11904 raft_consensus.cc:359] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.861434 11904 raft_consensus.cc:385] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.861732 11904 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.862742 11904 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.856745 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:49.865540 11859 raft_consensus.cc:2393] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e3ee0b8e63e438fb861810834b07195 in current term 1: Already voted for candidate 56ad779bd4974f29b8436ea08c74ac43 in this term.
I20260709 13:05:49.865762 11860 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.862007 11905 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:49.855598 11913 leader_election.cc:290] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.844514 11931 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.869769 11674 leader_election.cc:304] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:49.871760 11941 raft_consensus.cc:493] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.874470 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:49.872409 11941 raft_consensus.cc:515] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.879470 11904 ts_tablet_manager.cc:1434] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:05:49.873628 11907 leader_election.cc:290] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.881433 11786 raft_consensus.cc:2393] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56ad779bd4974f29b8436ea08c74ac43 in current term 1: Already voted for candidate 1e3ee0b8e63e438fb861810834b07195 in this term.
I20260709 13:05:49.881759 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
W20260709 13:05:49.871241 11676 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36077, user_credentials={real_user=slave}} blocked reactor thread for 88219.5us
I20260709 13:05:49.863816 11940 raft_consensus.cc:515] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:49.886548 11904 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:49.883834 11931 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.885351 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:49.890445 11944 raft_consensus.cc:2804] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.892987 11944 raft_consensus.cc:697] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:49.892984 11711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:49.900681 11940 leader_election.cc:290] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411)
I20260709 13:05:49.898208 11859 raft_consensus.cc:2393] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e3ee0b8e63e438fb861810834b07195 in current term 1: Already voted for candidate 56ad779bd4974f29b8436ea08c74ac43 in this term.
I20260709 13:05:49.900876 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:49.910305 11710 raft_consensus.cc:2468] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 1.
I20260709 13:05:49.896863 11944 consensus_queue.cc:237] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.911798 11752 leader_election.cc:304] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:49.916311 11913 raft_consensus.cc:2804] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.916931 11913 raft_consensus.cc:697] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:49.917794 11913 consensus_queue.cc:237] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.920269 11860 raft_consensus.cc:2468] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 1.
I20260709 13:05:49.922860 11826 leader_election.cc:304] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56ad779bd4974f29b8436ea08c74ac43; no voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:49.924229 11903 tablet_bootstrap.cc:654] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.924189 11940 raft_consensus.cc:2749] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.931964 11942 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.931545 11823 leader_election.cc:343] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.935822 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:49.936509 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:49.937438 11784 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.936582 11710 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.932614 11942 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.972491 11941 leader_election.cc:290] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:49.975261 11942 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:49.971768 11910 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:49.975682 11711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:49.978986 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.981488 11711 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:49.986703 11709 raft_consensus.cc:2393] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56ad779bd4974f29b8436ea08c74ac43 in current term 1: Already voted for candidate 1e3ee0b8e63e438fb861810834b07195 in this term.
I20260709 13:05:49.987232 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:49.988958 11826 leader_election.cc:304] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
W20260709 13:05:49.990391 11674 leader_election.cc:343] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.989796 11946 raft_consensus.cc:493] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.992733 11941 raft_consensus.cc:2804] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.997138 11941 raft_consensus.cc:493] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.997594 11941 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.991945 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:49.992657 11946 raft_consensus.cc:515] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.007965 11710 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:50.007053 11910 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
W20260709 13:05:50.007210 11676 leader_election.cc:343] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.007803 11784 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
W20260709 13:05:50.001967 11823 leader_election.cc:343] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.009007 11676 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195; no voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:50.007875 11905 tablet_bootstrap.cc:654] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:50.011191 11655 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:50.011399 11823 leader_election.cc:304] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:50.013233 11940 raft_consensus.cc:2804] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.013484 11904 tablet_bootstrap.cc:654] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.013749 11940 raft_consensus.cc:697] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:50.014729 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:50.015035 11940 consensus_queue.cc:237] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:50.012024 11910 raft_consensus.cc:2749] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.015863 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
W20260709 13:05:50.017532 11674 leader_election.cc:343] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.018530 11860 raft_consensus.cc:2393] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e3ee0b8e63e438fb861810834b07195 in current term 1: Already voted for candidate 56ad779bd4974f29b8436ea08c74ac43 in this term.
I20260709 13:05:50.021034 11676 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195; no voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:50.022861 11910 raft_consensus.cc:2749] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.025772 11903 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:50.026487 11903 ts_tablet_manager.cc:1403] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.181s	user 0.007s	sys 0.011s
I20260709 13:05:50.026989 11941 raft_consensus.cc:515] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.037811 11941 leader_election.cc:290] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:50.038154 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:50.039309 11905 tablet_bootstrap.cc:492] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:50.039806 11905 ts_tablet_manager.cc:1403] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.001s
W20260709 13:05:50.040444 11823 leader_election.cc:343] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.037250 11903 raft_consensus.cc:359] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.042002 11903 raft_consensus.cc:385] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.042394 11903 raft_consensus.cc:740] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.042209 11605 catalog_manager.cc:5697] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.042958 11905 raft_consensus.cc:359] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.043761 11905 raft_consensus.cc:385] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.043360 11903 consensus_queue.cc:260] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.047302 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:50.048700 11710 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.055960 11607 catalog_manager.cc:5697] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.057561 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:50.058420 11860 raft_consensus.cc:2393] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e3ee0b8e63e438fb861810834b07195 in current term 1: Already voted for candidate 56ad779bd4974f29b8436ea08c74ac43 in this term.
I20260709 13:05:50.050743 11903 ts_tablet_manager.cc:1434] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:05:50.060007 11903 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:50.055956 11608 catalog_manager.cc:5697] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 1 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.067991 11903 tablet_bootstrap.cc:654] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.051249 11905 raft_consensus.cc:740] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.052742 11826 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56ad779bd4974f29b8436ea08c74ac43; no voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:50.054589 11904 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:50.054889 11946 leader_election.cc:290] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.055970 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:50.072414 11941 raft_consensus.cc:2749] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.072441 11904 ts_tablet_manager.cc:1403] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.186s	user 0.007s	sys 0.018s
W20260709 13:05:50.073779 11674 leader_election.cc:343] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.074381 11674 leader_election.cc:304] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195; no voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:50.074378 11905 consensus_queue.cc:260] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.076440 11710 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:50.077064 11910 raft_consensus.cc:2749] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.076972 11904 raft_consensus.cc:359] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.077948 11904 raft_consensus.cc:385] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.078400 11904 raft_consensus.cc:740] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.079344 11904 consensus_queue.cc:260] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.080547 11826 leader_election.cc:304] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:50.082032 11941 raft_consensus.cc:2804] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.082427 11904 ts_tablet_manager.cc:1434] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:50.082557 11941 raft_consensus.cc:697] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:50.084189 11904 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:50.084586 11941 consensus_queue.cc:237] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.088932 11905 ts_tablet_manager.cc:1434] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:05:50.090023 11905 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: Bootstrap starting.
I20260709 13:05:50.095152 11904 tablet_bootstrap.cc:654] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.104485 11903 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:50.105058 11903 ts_tablet_manager.cc:1403] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.045s	user 0.002s	sys 0.012s
I20260709 13:05:50.108280 11903 raft_consensus.cc:359] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.109202 11903 raft_consensus.cc:385] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.109500 11905 tablet_bootstrap.cc:654] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.109588 11903 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.110486 11903 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.113309 11903 ts_tablet_manager.cc:1434] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:50.114591 11903 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: Bootstrap starting.
I20260709 13:05:50.121306 11904 tablet_bootstrap.cc:492] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:50.122100 11904 ts_tablet_manager.cc:1403] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:05:50.125432 11903 tablet_bootstrap.cc:654] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.125236 11904 raft_consensus.cc:359] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.127230 11904 raft_consensus.cc:385] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.127701 11904 raft_consensus.cc:740] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.128799 11904 consensus_queue.cc:260] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.131289 11904 ts_tablet_manager.cc:1434] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:05:50.132356 11904 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:50.133177 11905 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: No bootstrap required, opened a new log
I20260709 13:05:50.134025 11905 ts_tablet_manager.cc:1403] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.004s
I20260709 13:05:50.138499 11910 raft_consensus.cc:493] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.139086 11910 raft_consensus.cc:515] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.142181 11910 leader_election.cc:290] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.143694 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:50.145790 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:50.146620 11784 raft_consensus.cc:2468] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 0.
W20260709 13:05:50.147854 11676 leader_election.cc:343] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.149040 11674 leader_election.cc:304] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:50.150591 11910 raft_consensus.cc:2804] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.151113 11910 raft_consensus.cc:493] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.151537 11910 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.154281 11905 raft_consensus.cc:359] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.155310 11905 raft_consensus.cc:385] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.155601 11905 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.156590 11905 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.164463 11904 tablet_bootstrap.cc:654] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.168995 11905 ts_tablet_manager.cc:1434] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 13:05:50.170238 11903 tablet_bootstrap.cc:492] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: No bootstrap required, opened a new log
I20260709 13:05:50.171178 11903 ts_tablet_manager.cc:1403] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.018s
I20260709 13:05:50.171785 11946 raft_consensus.cc:493] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.179757 11910 raft_consensus.cc:515] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.182525 11910 leader_election.cc:290] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.188495 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:50.189291 11784 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.201107 11903 raft_consensus.cc:359] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.202157 11903 raft_consensus.cc:385] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.194805 11946 raft_consensus.cc:515] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.202674 11903 raft_consensus.cc:740] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.204810 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:50.210175 11903 consensus_queue.cc:260] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.211285 11860 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.207036 11784 raft_consensus.cc:2468] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 1.
I20260709 13:05:50.218712 11904 tablet_bootstrap.cc:492] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:50.219265 11904 ts_tablet_manager.cc:1403] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.030s
I20260709 13:05:50.219559 11674 leader_election.cc:304] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:50.220800 11910 raft_consensus.cc:2804] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.201782 11607 catalog_manager.cc:5697] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.221349 11910 raft_consensus.cc:697] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:50.221930 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:50.222631 11785 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 0.
I20260709 13:05:50.222406 11910 consensus_queue.cc:237] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.223852 11860 raft_consensus.cc:2468] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 1.
I20260709 13:05:50.224092 11674 leader_election.cc:304] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:50.225066 11944 raft_consensus.cc:2804] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.225420 11944 raft_consensus.cc:493] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.225766 11944 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.230312 11903 ts_tablet_manager.cc:1434] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.015s
I20260709 13:05:50.231453 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:50.232210 11860 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 0.
I20260709 13:05:50.232761 11946 leader_election.cc:290] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.234628 11944 raft_consensus.cc:515] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.238373 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:50.238981 11784 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.244562 11904 raft_consensus.cc:359] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.245405 11904 raft_consensus.cc:385] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.245707 11904 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.246488 11904 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.247386 11913 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.247821 11913 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.249266 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:50.249838 11860 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.251001 11944 leader_election.cc:290] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.252375 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:50.253176 11710 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 0.
I20260709 13:05:50.251446 11913 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.254343 11904 ts_tablet_manager.cc:1434] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 13:05:50.254449 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:50.255264 11859 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 0.
I20260709 13:05:50.257654 11751 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:50.258406 11904 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:50.259583 11913 raft_consensus.cc:2804] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.262272 11913 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.262671 11913 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.260708 11860 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 1.
I20260709 13:05:50.261494 11784 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 1.
I20260709 13:05:50.272740 11676 leader_election.cc:304] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:50.273651 11910 raft_consensus.cc:2804] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.273581 11913 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.274649 11910 raft_consensus.cc:697] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:50.277001 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:50.277690 11710 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.278770 11904 tablet_bootstrap.cc:654] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.279390 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:50.280092 11860 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.287302 11710 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 1.
I20260709 13:05:50.290230 11752 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:50.291216 11939 raft_consensus.cc:2804] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.290652 11608 catalog_manager.cc:5697] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.294088 11904 tablet_bootstrap.cc:492] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:50.294873 11904 ts_tablet_manager.cc:1403] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.013s
I20260709 13:05:50.299618 11904 raft_consensus.cc:359] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.300837 11904 raft_consensus.cc:385] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.301268 11904 raft_consensus.cc:740] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.303103 11904 consensus_queue.cc:260] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.287428 11860 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 1.
I20260709 13:05:50.288193 11913 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.275760 11910 consensus_queue.cc:237] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.307745 11939 raft_consensus.cc:697] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:50.309428 11939 consensus_queue.cc:237] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.317140 11904 ts_tablet_manager.cc:1434] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:05:50.318351 11904 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: Bootstrap starting.
I20260709 13:05:50.322324 11608 catalog_manager.cc:5697] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.325279 11904 tablet_bootstrap.cc:654] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.330447 11904 tablet_bootstrap.cc:492] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: No bootstrap required, opened a new log
I20260709 13:05:50.331067 11904 ts_tablet_manager.cc:1403] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:05:50.333997 11904 raft_consensus.cc:359] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.334941 11904 raft_consensus.cc:385] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.335237 11904 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.335882 11904 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.337780 11904 ts_tablet_manager.cc:1434] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:50.331214 11605 catalog_manager.cc:5697] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 1 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.338228 11939 consensus_queue.cc:1048] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.351619 11910 consensus_queue.cc:1048] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.374854 11965 consensus_queue.cc:1048] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.393167 11944 consensus_queue.cc:1048] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.405090 11941 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.405980 11941 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.412101 11710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:50.414178 11710 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:50.416306 11826 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:50.417721 11940 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.418304 11940 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.418788 11940 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.426256 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:50.426517 11965 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.427007 11784 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 0.
I20260709 13:05:50.427173 11965 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.428644 11941 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:50.429836 11965 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:50.430518 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:50.431535 11709 raft_consensus.cc:2393] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2234dde46ccf4fcfa1f418419fddcebf in current term 1: Already voted for candidate 1e3ee0b8e63e438fb861810834b07195 in this term.
I20260709 13:05:50.433670 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ad779bd4974f29b8436ea08c74ac43" is_pre_election: true
I20260709 13:05:50.434425 11859 raft_consensus.cc:2393] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2234dde46ccf4fcfa1f418419fddcebf in current term 1: Already voted for candidate 56ad779bd4974f29b8436ea08c74ac43 in this term.
I20260709 13:05:50.435909 11751 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf; no voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:50.437374 11965 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.441774 11941 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.441799 11940 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.445905 11965 raft_consensus.cc:2749] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.449412 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:50.450140 11709 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.450415 11940 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:50.450661 11784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:50.451529 11784 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.466580 11931 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.467984 11709 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:50.469347 11826 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:50.470989 11941 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.471594 11941 raft_consensus.cc:697] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:50.472512 11941 consensus_queue.cc:237] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:50.482617 11784 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:50.488160 11605 catalog_manager.cc:5697] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.519917 11785 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.530131 11941 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.548434 11931 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.721997 11965 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.733963 11913 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.746199 11910 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.772383 11946 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.795023 11946 consensus_queue.cc:1048] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.806257 11944 consensus_queue.cc:1048] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.860239 11931 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.872773 11941 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:51.014453 11655 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.628280 11941 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.628904 11941 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.630714 11941 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:51.631821 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195" is_pre_election: true
I20260709 13:05:51.631891 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf" is_pre_election: true
I20260709 13:05:51.632655 11709 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:51.632741 11785 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 1.
I20260709 13:05:51.633980 11826 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:51.635129 11941 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:51.635545 11941 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.635840 11941 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.640578 11941 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.642289 11941 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:51.643239 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:51.643493 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:51.643728 11709 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.644187 11785 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.648643 11709 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 2.
I20260709 13:05:51.649909 11826 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:51.650031 11785 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 2.
I20260709 13:05:51.650993 11941 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.651648 11941 raft_consensus.cc:697] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:51.652483 11941 consensus_queue.cc:237] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.661110 11607 catalog_manager.cc:5697] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 0 to 2, leader changed from <none> to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.710994 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:51.711899 11860 raft_consensus.cc:606] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:51.718405 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:51.719162 11860 raft_consensus.cc:606] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:51.738605 11785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:50362
I20260709 13:05:51.739213 11785 raft_consensus.cc:606] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:51.752363 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:51.752950 11860 raft_consensus.cc:606] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:51.759052 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:51.759644 11860 raft_consensus.cc:606] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:51.776597 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:33240
I20260709 13:05:51.777154 11709 raft_consensus.cc:606] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:51.783059 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:33240
I20260709 13:05:51.783594 11709 raft_consensus.cc:606] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Received request to transfer leadership to TS 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:51.840631 11910 raft_consensus.cc:993] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:51.841145 11910 raft_consensus.cc:1081] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:51.848944 11785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50356
I20260709 13:05:51.849790 11785 raft_consensus.cc:493] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.850214 11785 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.855530 11785 raft_consensus.cc:515] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.857501 11785 leader_election.cc:290] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:51.858529 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:51.858868 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:51.859145 11709 raft_consensus.cc:3055] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.859545 11709 raft_consensus.cc:740] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:51.859495 11860 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.860514 11709 consensus_queue.cc:260] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.861647 11709 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.865272 11860 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:51.866371 11709 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:51.866609 11751 leader_election.cc:304] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:51.867491 11966 raft_consensus.cc:2804] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.868433 11966 raft_consensus.cc:697] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:51.869099 11966 consensus_queue.cc:237] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.875953 11607 catalog_manager.cc:5697] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 1 to 2, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 2 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.925066 11931 raft_consensus.cc:993] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:51.925697 11941 raft_consensus.cc:1081] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:51.927347 11709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:05:51.927935 11709 raft_consensus.cc:493] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.928288 11709 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.933136 11709 raft_consensus.cc:515] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:51.934820 11709 leader_election.cc:290] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Requested vote from peers 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:51.936097 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:51.936224 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:51.936668 11860 raft_consensus.cc:3055] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.936921 11785 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.937047 11860 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:51.937922 11860 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:51.939116 11860 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.943200 11785 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:51.944605 11674 leader_election.cc:304] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:51.945057 11860 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:51.945746 11910 raft_consensus.cc:2804] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.946336 11910 raft_consensus.cc:697] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:51.947269 11910 consensus_queue.cc:237] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:51.954974 11607 catalog_manager.cc:5697] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 1 to 2, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.978237 11931 raft_consensus.cc:993] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:51.978749 11931 raft_consensus.cc:1081] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:51.980950 11785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:05:51.981647 11785 raft_consensus.cc:493] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.982069 11785 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.987784 11785 raft_consensus.cc:515] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.989843 11785 leader_election.cc:290] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:51.990917 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:51.991148 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:51.991637 11709 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.991752 11860 raft_consensus.cc:3055] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.992198 11860 raft_consensus.cc:740] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:51.992964 11860 consensus_queue.cc:260] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:51.994032 11860 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.997300 11709 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:51.998620 11752 leader_election.cc:304] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:51.999459 11966 raft_consensus.cc:2804] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.999938 11966 raft_consensus.cc:697] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:52.000504 11860 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:52.000886 11966 consensus_queue.cc:237] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.009608 11607 catalog_manager.cc:5697] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 1 to 2, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 2 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.138924 11941 raft_consensus.cc:993] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:52.139390 11931 raft_consensus.cc:1081] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:52.141281 11785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:05:52.141860 11785 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.142181 11785 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.143463 11784 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:52.145038 11931 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.150163 11785 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.152660 11785 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:52.153929 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:52.154644 11860 raft_consensus.cc:3055] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.154392 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:52.155376 11709 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.155076 11860 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:52.157662 11860 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.159075 11860 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.162644 11710 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:52.164929 11709 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:52.164415 11941 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.166518 11752 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:52.167726 11966 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.168220 11966 raft_consensus.cc:697] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:52.169085 11966 consensus_queue.cc:237] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.173287 11860 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:52.177446 11910 raft_consensus.cc:993] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:52.178071 11910 raft_consensus.cc:1081] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Signalling peer 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:52.181334 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:42012
I20260709 13:05:52.182317 11860 raft_consensus.cc:493] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.184362 11860 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.184823 11607 catalog_manager.cc:5697] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 1 to 2, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 2 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.186589 11931 raft_consensus.cc:993] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:52.187008 11931 raft_consensus.cc:1081] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:52.188769 11710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33218
I20260709 13:05:52.189332 11710 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.189798 11710 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.192020 11860 raft_consensus.cc:515] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.194816 11860 leader_election.cc:290] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:52.195802 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:52.196565 11709 raft_consensus.cc:3055] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.196943 11709 raft_consensus.cc:740] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:52.197161 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb429336d624eefa0cbf908555b35f3" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:52.197233 11710 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.198122 11786 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.198096 11709 consensus_queue.cc:260] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.199874 11709 raft_consensus.cc:3060] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.205236 11710 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 3 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:52.206792 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:52.207111 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:52.207451 11860 raft_consensus.cc:3055] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.207605 11785 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.207796 11860 raft_consensus.cc:740] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:52.207849 11709 raft_consensus.cc:2468] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 2.
I20260709 13:05:52.207844 11786 raft_consensus.cc:2468] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 2.
I20260709 13:05:52.208774 11860 consensus_queue.cc:260] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.209890 11823 leader_election.cc:304] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:52.210176 11860 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.211094 11931 raft_consensus.cc:2804] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.211570 11931 raft_consensus.cc:697] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:52.212560 11931 consensus_queue.cc:237] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.215862 11785 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 3.
I20260709 13:05:52.217355 11674 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:52.218343 11999 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:52.218863 11999 raft_consensus.cc:697] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:52.219796 11999 consensus_queue.cc:237] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.221787 11860 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 3.
I20260709 13:05:52.222540 11608 catalog_manager.cc:5697] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 1 to 2, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.229120 11607 catalog_manager.cc:5697] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 2 to 3, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.236407 12000 raft_consensus.cc:993] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:52.236912 11966 raft_consensus.cc:1081] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:52.239049 11709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33226
I20260709 13:05:52.239636 11709 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.239959 11709 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.245546 11709 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.247723 11709 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:52.248827 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:52.248997 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:52.249490 11785 raft_consensus.cc:3055] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.249635 11860 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.249842 11785 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:52.250694 11785 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.251686 11785 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.254796 11860 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:52.255975 11676 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:52.257023 11999 raft_consensus.cc:2804] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.257596 11999 raft_consensus.cc:697] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:52.257834 11785 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:52.258558 11999 consensus_queue.cc:237] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:52.266099 11607 catalog_manager.cc:5697] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 1 to 2, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.283610 11709 raft_consensus.cc:1275] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.285349 11966 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.296429 11860 raft_consensus.cc:1275] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.298063 11966 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.365219 11785 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.366843 11999 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.378346 11860 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.379979 12016 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.426227 11709 raft_consensus.cc:1275] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.427961 11966 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.438875 11860 raft_consensus.cc:1275] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.440603 12013 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.608312 11786 raft_consensus.cc:1275] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.610148 11931 consensus_queue.cc:1048] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.623181 11709 raft_consensus.cc:1275] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.624583 11786 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:52.624990 12021 consensus_queue.cc:1048] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.625952 12016 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.637434 11860 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:52.639398 12016 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.677894 11786 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.679517 12016 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.690505 11860 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.692534 11999 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.724982 11860 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.726555 12000 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.732322 11709 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.734263 12000 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:54.827384 11576 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:54.829082 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.857191 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:54.858388 11786 raft_consensus.cc:606] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Received request to transfer leadership to TS 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:54.878377 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:33254
I20260709 13:05:54.879129 11709 raft_consensus.cc:606] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Received request to transfer leadership to TS 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:54.880723 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:54.881263 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:55.097010 12000 raft_consensus.cc:993] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:55.097563 12030 raft_consensus.cc:1081] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Signalling peer 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:55.099357 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:41998
I20260709 13:05:55.099941 11860 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.100309 11860 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.104666 11860 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.106458 11860 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:55.107764 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:55.107858 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:55.108429 11709 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.108610 11786 raft_consensus.cc:3055] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.109025 11786 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:55.109866 11786 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.111065 11786 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.113528 11709 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:55.114688 11826 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:55.115353 12021 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.116621 12021 raft_consensus.cc:697] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:55.117440 12021 consensus_queue.cc:237] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.117884 11786 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:55.125684 11608 catalog_manager.cc:5697] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 2 to 3, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.280579 11999 raft_consensus.cc:993] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:55.281213 12031 raft_consensus.cc:1081] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Signalling peer 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:55.283314 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:42012
I20260709 13:05:55.283875 11860 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.284185 11860 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.289088 11860 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.290889 11860 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:55.292106 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:55.292258 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:55.292658 11709 raft_consensus.cc:3055] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.292996 11709 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:55.293053 11786 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.293681 11709 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.294621 11709 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.299434 11786 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:55.299607 11709 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:55.300887 11826 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:55.301683 12021 raft_consensus.cc:2804] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.302188 12021 raft_consensus.cc:697] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:55.302920 12021 consensus_queue.cc:237] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.311108 11608 catalog_manager.cc:5697] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 2 to 3, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.607502 11709 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.609231 12021 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.620131 11786 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.621709 12044 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:55.750326 11709 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.751906 12044 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.761924 11786 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.763613 12021 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.882375 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.895102 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:33240
I20260709 13:05:55.895799 11709 raft_consensus.cc:606] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:55.902472 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:33240
I20260709 13:05:55.903141 11709 raft_consensus.cc:606] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:55.909653 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:55.910320 11860 raft_consensus.cc:606] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:55.916823 11709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:33240
I20260709 13:05:55.917410 11709 raft_consensus.cc:606] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:55.926738 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
mode: GRACEFUL
new_leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:05:55.927541 11860 raft_consensus.cc:606] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Received request to transfer leadership to TS 2234dde46ccf4fcfa1f418419fddcebf
I20260709 13:05:55.941701 12031 raft_consensus.cc:993] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:55.942169 12031 raft_consensus.cc:1081] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:55.943822 11786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50356
I20260709 13:05:55.944432 11786 raft_consensus.cc:493] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.944725 11786 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.950084 11786 raft_consensus.cc:515] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.951889 11786 leader_election.cc:290] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:55.953095 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:55.953095 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ca4f7069454f3ba8b52bd0705cd100" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:55.953876 11860 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.953866 11709 raft_consensus.cc:3055] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:55.954397 11709 raft_consensus.cc:740] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:55.955178 11709 consensus_queue.cc:260] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.956372 11709 raft_consensus.cc:3060] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.961179 11860 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:55.962723 11751 leader_election.cc:304] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:55.962872 11709 raft_consensus.cc:2468] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 2.
I20260709 13:05:55.963546 12050 raft_consensus.cc:2804] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:55.964025 12050 raft_consensus.cc:697] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:55.964758 12050 consensus_queue.cc:237] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:55.972396 11608 catalog_manager.cc:5697] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 1 to 2, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 2 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.057246 12051 raft_consensus.cc:993] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.057732 12031 raft_consensus.cc:1081] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.059383 11786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50356
I20260709 13:05:56.059957 11786 raft_consensus.cc:493] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.060298 11786 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.066007 11786 raft_consensus.cc:515] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.067992 11786 leader_election.cc:290] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:56.069157 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:56.069239 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bff24cc162d4a25914a6a56d0aca205" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:56.069921 11709 raft_consensus.cc:3055] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.070003 11860 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.070262 11709 raft_consensus.cc:740] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:56.071089 11709 consensus_queue.cc:260] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.071959 11709 raft_consensus.cc:3060] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.076548 11709 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.077531 11752 leader_election.cc:304] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:56.078023 11860 raft_consensus.cc:2468] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.078274 12050 raft_consensus.cc:2804] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.078845 12050 raft_consensus.cc:697] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:56.079629 12050 consensus_queue.cc:237] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.087781 11608 catalog_manager.cc:5697] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 3 to 4, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 4 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.120513 12051 raft_consensus.cc:993] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.121040 12031 raft_consensus.cc:1081] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.122903 11786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50356
I20260709 13:05:56.123482 11786 raft_consensus.cc:493] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.123795 11786 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.129426 11786 raft_consensus.cc:515] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:56.131305 11786 leader_election.cc:290] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 3 election: Requested vote from peers 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077), 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411)
I20260709 13:05:56.133225 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:56.133924 11860 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.133971 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:56.134572 11709 raft_consensus.cc:3055] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.134783 11709 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:56.135483 11709 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:56.136361 11709 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.139505 11860 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 3.
I20260709 13:05:56.141098 11751 leader_election.cc:304] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234dde46ccf4fcfa1f418419fddcebf, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:56.141717 11709 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 3.
I20260709 13:05:56.142073 12050 raft_consensus.cc:2804] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.143714 12050 raft_consensus.cc:697] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:56.144549 12050 consensus_queue.cc:237] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:56.152536 11608 catalog_manager.cc:5697] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 2 to 3, leader changed from 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 3 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.215512 12035 raft_consensus.cc:993] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.216157 12021 raft_consensus.cc:1081] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.218053 11786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:05:56.218675 11786 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.219048 11786 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.224282 11786 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.226071 11786 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:56.227154 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:56.227313 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:56.227828 11709 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.227895 11860 raft_consensus.cc:3055] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.228313 11860 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:56.228982 11860 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.229921 11860 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.233201 11709 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.234401 11860 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.234476 11752 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:56.235419 12050 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.235914 12050 raft_consensus.cc:697] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:56.237046 12050 consensus_queue.cc:237] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.244234 11608 catalog_manager.cc:5697] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 3 to 4, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 4 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.322883 12044 raft_consensus.cc:993] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: : Instructing follower 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.324296 12035 raft_consensus.cc:1081] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Signalling peer 2234dde46ccf4fcfa1f418419fddcebf to start an election
I20260709 13:05:56.327740 11786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "433301372d8549739935288ae1115423"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:05:56.328745 11786 raft_consensus.cc:493] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.329190 11786 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.335314 11786 raft_consensus.cc:515] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.337358 11786 leader_election.cc:290] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:56.339221 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:56.339746 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433301372d8549739935288ae1115423" candidate_uuid: "2234dde46ccf4fcfa1f418419fddcebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:56.340266 11709 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.340368 11860 raft_consensus.cc:3055] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.341068 11860 raft_consensus.cc:740] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:56.342190 11860 consensus_queue.cc:260] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.343828 11860 raft_consensus.cc:3060] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.350483 11709 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.352272 11752 leader_election.cc:304] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 2234dde46ccf4fcfa1f418419fddcebf; no voters: 
I20260709 13:05:56.352921 11860 raft_consensus.cc:2468] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2234dde46ccf4fcfa1f418419fddcebf in term 4.
I20260709 13:05:56.353458 12050 raft_consensus.cc:2804] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.354107 12050 raft_consensus.cc:697] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Becoming Leader. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:56.355284 12050 consensus_queue.cc:237] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:56.362823 11608 catalog_manager.cc:5697] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf reported cstate change: term changed from 3 to 4, leader changed from 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3) to 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2). New cstate: current_term: 4 leader_uuid: "2234dde46ccf4fcfa1f418419fddcebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.394650 11860 raft_consensus.cc:1275] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.396272 12050 consensus_queue.cc:1048] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.411556 11709 raft_consensus.cc:1275] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.414336 12050 consensus_queue.cc:1048] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.538834 11709 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.540683 12050 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.553844 11860 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.556180 12057 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.601909 11709 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:56.603608 12057 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.615062 11860 raft_consensus.cc:1275] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:56.617148 12069 consensus_queue.cc:1048] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.772578 11860 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.774484 12069 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.786602 11709 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.788197 12030 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:56.806416 11860 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.807791 12030 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.817677 11709 raft_consensus.cc:1275] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Refusing update from remote peer 2234dde46ccf4fcfa1f418419fddcebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.819362 12069 consensus_queue.cc:1048] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.940900 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.950043 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:58.950639 11786 raft_consensus.cc:606] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:58.953502 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:58.954005 11786 raft_consensus.cc:606] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:58.956766 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:58.957229 11786 raft_consensus.cc:606] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Received request to transfer leadership to TS 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:58.959949 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:58.960435 11786 raft_consensus.cc:606] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Received request to transfer leadership to TS 1e3ee0b8e63e438fb861810834b07195
I20260709 13:05:58.963016 11786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94"
dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
mode: GRACEFUL
new_leader_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:50374
I20260709 13:05:58.963464 11786 raft_consensus.cc:606] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Received request to transfer leadership to TS 56ad779bd4974f29b8436ea08c74ac43
I20260709 13:05:58.964507 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:58.965198 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.122881 12075 raft_consensus.cc:993] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:59.123503 12075 raft_consensus.cc:1081] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Signalling peer 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:59.125258 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:41998
I20260709 13:05:59.125790 11860 raft_consensus.cc:493] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.126101 11860 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.130296 11860 raft_consensus.cc:515] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.131771 11860 leader_election.cc:290] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:59.133037 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:59.133317 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec135fc0cba6467f9eca3d28a7783c94" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:59.133595 11709 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.134006 11786 raft_consensus.cc:3055] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.134269 11786 raft_consensus.cc:740] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:59.135083 11786 consensus_queue.cc:260] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.136196 11786 raft_consensus.cc:3060] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.138056 11709 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:59.139706 11826 leader_election.cc:304] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:59.140923 12035 raft_consensus.cc:2804] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.142210 12035 raft_consensus.cc:697] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:59.142341 11786 raft_consensus.cc:2468] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:59.143361 12035 consensus_queue.cc:237] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.154992 11608 catalog_manager.cc:5697] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 2 to 3, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.191834 12075 raft_consensus.cc:993] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.192544 12069 raft_consensus.cc:1081] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.194578 11709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33226
I20260709 13:05:59.195135 11709 raft_consensus.cc:493] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.195505 11709 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.200892 11709 raft_consensus.cc:515] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.202636 11709 leader_election.cc:290] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 5 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:59.203640 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:59.203964 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1819933e41e3465d9eec82f8dbcabc4e" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:59.204463 11786 raft_consensus.cc:3055] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:59.204655 11860 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.204826 11786 raft_consensus.cc:740] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:59.205621 11786 consensus_queue.cc:260] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.206593 11786 raft_consensus.cc:3060] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.209738 11860 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 5.
I20260709 13:05:59.211230 11676 leader_election.cc:304] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:59.211784 11786 raft_consensus.cc:2468] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 5.
I20260709 13:05:59.213706 12083 raft_consensus.cc:2804] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:59.214915 12083 raft_consensus.cc:697] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 5 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:59.215822 12083 consensus_queue.cc:237] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.223193 11608 catalog_manager.cc:5697] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 4 to 5, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 5 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.288904 12075 raft_consensus.cc:993] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:59.289445 12075 raft_consensus.cc:1081] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Signalling peer 56ad779bd4974f29b8436ea08c74ac43 to start an election
I20260709 13:05:59.291002 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f"
dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
 from {username='slave'} at 127.0.0.1:41998
I20260709 13:05:59.291466 11860 raft_consensus.cc:493] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.291736 11860 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.295584 11860 raft_consensus.cc:515] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.297117 11860 leader_election.cc:290] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Requested vote from peers 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:59.298379 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:59.298525 11709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f5edcb2de64586998b557e132ad42f" candidate_uuid: "56ad779bd4974f29b8436ea08c74ac43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
I20260709 13:05:59.298895 11786 raft_consensus.cc:3055] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.299283 11786 raft_consensus.cc:740] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:59.299288 11709 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.300016 11786 consensus_queue.cc:260] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.301203 11786 raft_consensus.cc:3060] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.306564 11709 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:59.307025 11786 raft_consensus.cc:2468] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56ad779bd4974f29b8436ea08c74ac43 in term 3.
I20260709 13:05:59.307823 11826 leader_election.cc:304] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:59.308806 12076 raft_consensus.cc:2804] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.309315 12076 raft_consensus.cc:697] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Becoming Leader. State: Replica: 56ad779bd4974f29b8436ea08c74ac43, State: Running, Role: LEADER
I20260709 13:05:59.310340 12076 consensus_queue.cc:237] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.318924 11608 catalog_manager.cc:5697] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 reported cstate change: term changed from 2 to 3, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "56ad779bd4974f29b8436ea08c74ac43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.503082 12082 raft_consensus.cc:993] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.503618 12075 raft_consensus.cc:1081] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.505437 11709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33226
I20260709 13:05:59.506047 11709 raft_consensus.cc:493] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.506377 11709 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.507787 12075 raft_consensus.cc:993] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: : Instructing follower 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.508427 12082 raft_consensus.cc:1081] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Signalling peer 1e3ee0b8e63e438fb861810834b07195 to start an election
I20260709 13:05:59.510249 11710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915"
dest_uuid: "1e3ee0b8e63e438fb861810834b07195"
 from {username='slave'} at 127.0.0.1:33226
I20260709 13:05:59.510766 11710 raft_consensus.cc:493] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.511085 11710 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.512136 11709 raft_consensus.cc:515] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:59.513955 11709 leader_election.cc:290] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 4 election: Requested vote from peers 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077), 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221)
I20260709 13:05:59.515198 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:59.515393 11786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488e99663ad54e4e965b2b0e0c5b8039" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:59.515767 11860 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.516183 11786 raft_consensus.cc:3055] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.516537 11786 raft_consensus.cc:740] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:59.517279 11786 consensus_queue.cc:260] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:59.518424 11786 raft_consensus.cc:3060] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.518679 11710 raft_consensus.cc:515] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.521672 11710 leader_election.cc:290] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Requested vote from peers 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221), 56ad779bd4974f29b8436ea08c74ac43 (127.11.78.3:36077)
I20260709 13:05:59.522503 11860 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 4.
I20260709 13:05:59.522820 11785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2234dde46ccf4fcfa1f418419fddcebf"
I20260709 13:05:59.522814 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a03f44922f4f4180d0dd15652eb915" candidate_uuid: "1e3ee0b8e63e438fb861810834b07195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56ad779bd4974f29b8436ea08c74ac43"
I20260709 13:05:59.523799 11785 raft_consensus.cc:3055] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.524217 11785 raft_consensus.cc:740] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2234dde46ccf4fcfa1f418419fddcebf, State: Running, Role: LEADER
I20260709 13:05:59.523890 11859 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.524602 11676 leader_election.cc:304] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:59.525604 12083 raft_consensus.cc:2804] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.525113 11785 consensus_queue.cc:260] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.526137 12083 raft_consensus.cc:697] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 4 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:59.526641 11785 raft_consensus.cc:3060] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.526899 12083 consensus_queue.cc:237] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } }
I20260709 13:05:59.532166 11859 raft_consensus.cc:2468] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:59.533773 11676 leader_election.cc:304] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3ee0b8e63e438fb861810834b07195, 56ad779bd4974f29b8436ea08c74ac43; no voters: 
I20260709 13:05:59.533998 11785 raft_consensus.cc:2468] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 2.
I20260709 13:05:59.534904 12084 raft_consensus.cc:2804] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.537009 12084 raft_consensus.cc:697] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Becoming Leader. State: Replica: 1e3ee0b8e63e438fb861810834b07195, State: Running, Role: LEADER
I20260709 13:05:59.537022 11786 raft_consensus.cc:2468] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3ee0b8e63e438fb861810834b07195 in term 4.
I20260709 13:05:59.537262 11608 catalog_manager.cc:5697] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 3 to 4, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 4 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.537972 12084 consensus_queue.cc:237] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } }
I20260709 13:05:59.549907 11608 catalog_manager.cc:5697] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 reported cstate change: term changed from 1 to 2, leader changed from 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2) to 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "1e3ee0b8e63e438fb861810834b07195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.593536 11786 raft_consensus.cc:1275] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.594826 12076 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.606109 11710 raft_consensus.cc:1275] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.607733 12076 consensus_queue.cc:1048] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.639595 11786 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 5 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:59.641217 12084 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.651701 11859 raft_consensus.cc:1275] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 5 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:59.653828 12083 consensus_queue.cc:1048] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:59.769238 11710 raft_consensus.cc:1275] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.770577 12076 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3ee0b8e63e438fb861810834b07195" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.780815 11786 raft_consensus.cc:1275] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Refusing update from remote peer 56ad779bd4974f29b8436ea08c74ac43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.783623 12098 consensus_queue.cc:1048] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:59.938841 11786 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.939034 11859 raft_consensus.cc:1275] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.940640 12083 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:59.940830 12088 consensus_queue.cc:1048] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.951967 11860 raft_consensus.cc:1275] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.953590 12083 consensus_queue.cc:1048] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ad779bd4974f29b8436ea08c74ac43" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.959421 11785 raft_consensus.cc:1275] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Refusing update from remote peer 1e3ee0b8e63e438fb861810834b07195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.966679 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.967471 12088 consensus_queue.cc:1048] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2234dde46ccf4fcfa1f418419fddcebf" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:59.979133 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:06:00.029716 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.030622 11576 tablet_replica.cc:333] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.031847 11576 raft_consensus.cc:2243] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.032617 11576 raft_consensus.cc:2272] T 433301372d8549739935288ae1115423 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.035251 11576 tablet_replica.cc:333] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.035807 11576 raft_consensus.cc:2243] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.036321 11576 raft_consensus.cc:2272] T 8eb429336d624eefa0cbf908555b35f3 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.038297 11576 tablet_replica.cc:333] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.039016 11576 raft_consensus.cc:2243] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.039539 11576 raft_consensus.cc:2272] T d3f5edcb2de64586998b557e132ad42f P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.042671 11576 tablet_replica.cc:333] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.043223 11576 raft_consensus.cc:2243] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.043622 11576 raft_consensus.cc:2272] T 73ca4f7069454f3ba8b52bd0705cd100 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.045581 11576 tablet_replica.cc:333] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.046092 11576 raft_consensus.cc:2243] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.046481 11576 raft_consensus.cc:2272] T 3bff24cc162d4a25914a6a56d0aca205 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.048305 11576 tablet_replica.cc:333] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.048806 11576 raft_consensus.cc:2243] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.049589 11576 raft_consensus.cc:2272] T e7a03f44922f4f4180d0dd15652eb915 P 1e3ee0b8e63e438fb861810834b07195 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.051743 11576 tablet_replica.cc:333] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.052300 11576 raft_consensus.cc:2243] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.052680 11576 raft_consensus.cc:2272] T ec135fc0cba6467f9eca3d28a7783c94 P 1e3ee0b8e63e438fb861810834b07195 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.055078 11576 tablet_replica.cc:333] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.055527 11576 raft_consensus.cc:2243] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.056550 11576 raft_consensus.cc:2272] T 488e99663ad54e4e965b2b0e0c5b8039 P 1e3ee0b8e63e438fb861810834b07195 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.058995 11576 tablet_replica.cc:333] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195: stopping tablet replica
I20260709 13:06:00.059459 11576 raft_consensus.cc:2243] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.060285 11576 raft_consensus.cc:2272] T 1819933e41e3465d9eec82f8dbcabc4e P 1e3ee0b8e63e438fb861810834b07195 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:00.170805 11752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:46411: connect: Connection refused (error 111)
I20260709 13:06:00.173473 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
W20260709 13:06:00.175891 11752 consensus_peers.cc:597] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf -> Peer 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411): Couldn't send request to peer 1e3ee0b8e63e438fb861810834b07195. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:46411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.199545 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:06:00.217203 11826 consensus_peers.cc:597] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 -> Peer 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411): Couldn't send request to peer 1e3ee0b8e63e438fb861810834b07195. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:46411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.236946 11826 consensus_peers.cc:597] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 -> Peer 1e3ee0b8e63e438fb861810834b07195 (127.11.78.1:46411): Couldn't send request to peer 1e3ee0b8e63e438fb861810834b07195. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:46411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.238751 11823 consensus_peers.cc:597] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 -> Peer 2234dde46ccf4fcfa1f418419fddcebf (127.11.78.2:43221): Couldn't send request to peer 2234dde46ccf4fcfa1f418419fddcebf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.247428 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.248332 11576 tablet_replica.cc:333] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.249046 11576 raft_consensus.cc:2243] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.249565 11576 raft_consensus.cc:2272] T d3f5edcb2de64586998b557e132ad42f P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.252566 11576 tablet_replica.cc:333] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.253188 11576 raft_consensus.cc:2243] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.254031 11576 raft_consensus.cc:2272] T 433301372d8549739935288ae1115423 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.255877 11576 tablet_replica.cc:333] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.256510 11576 raft_consensus.cc:2243] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.256956 11576 raft_consensus.cc:2272] T 1819933e41e3465d9eec82f8dbcabc4e P 2234dde46ccf4fcfa1f418419fddcebf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.259593 11576 tablet_replica.cc:333] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.260267 11576 raft_consensus.cc:2243] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.260802 11576 raft_consensus.cc:2272] T ec135fc0cba6467f9eca3d28a7783c94 P 2234dde46ccf4fcfa1f418419fddcebf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.263206 11576 tablet_replica.cc:333] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.263772 11576 raft_consensus.cc:2243] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.264254 11576 raft_consensus.cc:2272] T 488e99663ad54e4e965b2b0e0c5b8039 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.266268 11576 tablet_replica.cc:333] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.266772 11576 raft_consensus.cc:2243] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.267156 11576 raft_consensus.cc:2272] T 8eb429336d624eefa0cbf908555b35f3 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.268899 11576 tablet_replica.cc:333] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.269387 11576 raft_consensus.cc:2243] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.270097 11576 raft_consensus.cc:2272] T 3bff24cc162d4a25914a6a56d0aca205 P 2234dde46ccf4fcfa1f418419fddcebf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.271700 11576 tablet_replica.cc:333] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.272244 11576 raft_consensus.cc:2243] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.272598 11576 raft_consensus.cc:2272] T e7a03f44922f4f4180d0dd15652eb915 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.274677 11576 tablet_replica.cc:333] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf: stopping tablet replica
I20260709 13:06:00.275122 11576 raft_consensus.cc:2243] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.275856 11576 raft_consensus.cc:2272] T 73ca4f7069454f3ba8b52bd0705cd100 P 2234dde46ccf4fcfa1f418419fddcebf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.306159 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
I20260709 13:06:00.324376 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
I20260709 13:06:00.358264 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.359198 11576 tablet_replica.cc:333] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.359903 11576 raft_consensus.cc:2243] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.361344 11576 raft_consensus.cc:2272] T 8eb429336d624eefa0cbf908555b35f3 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.363768 11576 tablet_replica.cc:333] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.364476 11576 raft_consensus.cc:2243] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.365321 11576 raft_consensus.cc:2272] T d3f5edcb2de64586998b557e132ad42f P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.368127 11576 tablet_replica.cc:333] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.368913 11576 raft_consensus.cc:2243] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.369442 11576 raft_consensus.cc:2272] T 433301372d8549739935288ae1115423 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.371264 11576 tablet_replica.cc:333] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.371824 11576 raft_consensus.cc:2243] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.372314 11576 raft_consensus.cc:2272] T e7a03f44922f4f4180d0dd15652eb915 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.374584 11576 tablet_replica.cc:333] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.375440 11576 raft_consensus.cc:2243] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.375998 11576 raft_consensus.cc:2272] T 3bff24cc162d4a25914a6a56d0aca205 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.377874 11576 tablet_replica.cc:333] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.378418 11576 raft_consensus.cc:2243] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.378871 11576 raft_consensus.cc:2272] T 73ca4f7069454f3ba8b52bd0705cd100 P 56ad779bd4974f29b8436ea08c74ac43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.380916 11576 tablet_replica.cc:333] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.381497 11576 raft_consensus.cc:2243] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.381970 11576 raft_consensus.cc:2272] T 1819933e41e3465d9eec82f8dbcabc4e P 56ad779bd4974f29b8436ea08c74ac43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.384371 11576 tablet_replica.cc:333] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.384891 11576 raft_consensus.cc:2243] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.385721 11576 raft_consensus.cc:2272] T ec135fc0cba6467f9eca3d28a7783c94 P 56ad779bd4974f29b8436ea08c74ac43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.388130 11576 tablet_replica.cc:333] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43: stopping tablet replica
I20260709 13:06:00.388638 11576 raft_consensus.cc:2243] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.389096 11576 raft_consensus.cc:2272] T 488e99663ad54e4e965b2b0e0c5b8039 P 56ad779bd4974f29b8436ea08c74ac43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.420591 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:06:00.440553 11576 master.cc:562] Master@127.11.78.62:40945 shutting down...
I20260709 13:06:00.656370 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.657323 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.657757 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P aff1c5475a9c422896ef3137a63d9f5e: stopping tablet replica
I20260709 13:06:00.681064 11576 master.cc:584] Master@127.11.78.62:40945 shutdown complete.
1e3ee0b8e63e438fb861810834b07195  4
2234dde46ccf4fcfa1f418419fddcebf  4
56ad779bd4974f29b8436ea08c74ac43  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14493 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:06:00.730901 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:46569
I20260709 13:06:00.732409 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.738502 12110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.738644 12111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.739854 12113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.741348 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:00.742363 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.742609 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.742789 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602360742767 us; error 0 us; skew 500 ppm
I20260709 13:06:00.743362 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.746601 11576 webserver.cc:533] Webserver started at http://127.11.78.62:42491/ using document root <none> and password file <none>
I20260709 13:06:00.747262 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.747504 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.747872 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.749351 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "0eed440e7ce64726874147a9633a9db5"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-smzk"
I20260709 13:06:00.754730 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:00.759305 12118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.760336 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:06:00.760620 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "0eed440e7ce64726874147a9633a9db5"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-smzk"
I20260709 13:06:00.760881 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.779897 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.781234 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.835073 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:46569
I20260709 13:06:00.835176 12169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:46569 every 8 connection(s)
I20260709 13:06:00.841171 12170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.855664 12170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5: Bootstrap starting.
I20260709 13:06:00.861734 12170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.867697 12170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5: No bootstrap required, opened a new log
I20260709 13:06:00.870707 12170 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER }
I20260709 13:06:00.871275 12170 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.871469 12170 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eed440e7ce64726874147a9633a9db5, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.872177 12170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER }
I20260709 13:06:00.872946 12170 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:00.873364 12170 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:00.873837 12170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.879326 12170 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER }
I20260709 13:06:00.879990 12170 leader_election.cc:304] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0eed440e7ce64726874147a9633a9db5; no voters: 
I20260709 13:06:00.881546 12170 leader_election.cc:290] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:00.881976 12173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.883451 12173 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 1 LEADER]: Becoming Leader. State: Replica: 0eed440e7ce64726874147a9633a9db5, State: Running, Role: LEADER
I20260709 13:06:00.884416 12173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER }
I20260709 13:06:00.885128 12170 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:00.890421 12175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0eed440e7ce64726874147a9633a9db5. Latest consensus state: current_term: 1 leader_uuid: "0eed440e7ce64726874147a9633a9db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER } }
I20260709 13:06:00.891187 12175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:00.890928 12174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0eed440e7ce64726874147a9633a9db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eed440e7ce64726874147a9633a9db5" member_type: VOTER } }
I20260709 13:06:00.891702 12174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:00.895351 12180 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:00.906248 12180 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:00.908289 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:00.920754 12180 catalog_manager.cc:1383] Generated new cluster ID: 743e9ff3a07a4740a6dbe7e41731c2e6
I20260709 13:06:00.921279 12180 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:00.941946 12180 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:00.943521 12180 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:00.960218 12180 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5: Generated new TSK 0
I20260709 13:06:00.961051 12180 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:00.980175 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.987869 12191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.989604 12192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.991991 12194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.993763 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:00.994762 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.994978 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.995193 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602360995177 us; error 0 us; skew 500 ppm
I20260709 13:06:00.995805 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.998692 11576 webserver.cc:533] Webserver started at http://127.11.78.1:44335/ using document root <none> and password file <none>
I20260709 13:06:00.999483 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.999729 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.000020 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.001253 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "436e5c88bcfe4f46b795aa12ef336a34"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-smzk"
I20260709 13:06:01.007927 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:06:01.013231 12199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.014485 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:01.015406 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "436e5c88bcfe4f46b795aa12ef336a34"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-smzk"
I20260709 13:06:01.016255 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.044490 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.045881 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.047736 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.051986 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.052340 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:06:01.052639 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.052841 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.110807 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:38909
I20260709 13:06:01.110993 12261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:38909 every 8 connection(s)
I20260709 13:06:01.116724 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.125689 12266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.126467 12267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.134739 11576 server_base.cc:1061] running on GCE node
W20260709 13:06:01.136196 12269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.136230 12262 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46569
I20260709 13:06:01.137293 12262 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.138399 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:01.138516 12262 heartbeater.cc:507] Master 127.11.78.62:46569 requested a full tablet report, sending...
W20260709 13:06:01.138760 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.138998 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602361138978 us; error 0 us; skew 500 ppm
I20260709 13:06:01.139739 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.142436 12135 ts_manager.cc:194] Registered new tserver with Master: 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:01.144338 11576 webserver.cc:533] Webserver started at http://127.11.78.2:33163/ using document root <none> and password file <none>
I20260709 13:06:01.144922 12135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51110
I20260709 13:06:01.146582 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.147511 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.147997 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.149986 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "5f320ea492f746d088d0ee95b9881373"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-smzk"
I20260709 13:06:01.155200 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:06:01.161016 12274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.163152 11576 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:06:01.163503 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "5f320ea492f746d088d0ee95b9881373"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-smzk"
I20260709 13:06:01.163776 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.182997 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.184835 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.187819 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.190568 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.190822 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.191159 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.191596 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.256145 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:45935
I20260709 13:06:01.256630 12336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:45935 every 8 connection(s)
I20260709 13:06:01.264321 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.280900 12340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.281702 12341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.283821 12343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.287158 12337 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46569
I20260709 13:06:01.287672 12337 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.289129 12337 heartbeater.cc:507] Master 127.11.78.62:46569 requested a full tablet report, sending...
I20260709 13:06:01.292753 12135 ts_manager.cc:194] Registered new tserver with Master: 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:01.294528 12135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51120
I20260709 13:06:01.297727 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:01.299077 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.299373 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.299583 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602361299569 us; error 0 us; skew 500 ppm
I20260709 13:06:01.300382 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.303544 11576 webserver.cc:533] Webserver started at http://127.11.78.3:39095/ using document root <none> and password file <none>
I20260709 13:06:01.304278 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.304512 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.304770 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.306217 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-smzk"
I20260709 13:06:01.313534 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:06:01.317468 12348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.319358 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:06:01.319728 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-smzk"
I20260709 13:06:01.320005 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.335376 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.337209 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.339406 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.342554 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.342799 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.343139 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.343364 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.414942 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:36455
I20260709 13:06:01.415084 12410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:36455 every 8 connection(s)
I20260709 13:06:01.436790 12411 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46569
I20260709 13:06:01.437529 12411 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.440449 12411 heartbeater.cc:507] Master 127.11.78.62:46569 requested a full tablet report, sending...
I20260709 13:06:01.446133 12135 ts_manager.cc:194] Registered new tserver with Master: eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:01.446578 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.026715562s
I20260709 13:06:01.449433 12135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51136
I20260709 13:06:01.512634 12135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51150:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:01.522661 12135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:01.648083 12375 tablet_service.cc:1511] Processing CreateTablet for tablet f50eee84d3c847da94637683aed78352 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:01.651999 12375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50eee84d3c847da94637683aed78352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.652172 12302 tablet_service.cc:1511] Processing CreateTablet for tablet 1bde340c4b24422ba28405c87c38b47c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:01.654039 12302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bde340c4b24422ba28405c87c38b47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.653766 12301 tablet_service.cc:1511] Processing CreateTablet for tablet f50eee84d3c847da94637683aed78352 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:01.655139 12301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50eee84d3c847da94637683aed78352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.655177 12300 tablet_service.cc:1511] Processing CreateTablet for tablet f449824f869c43ea84a75ef539102a0c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:01.657712 12300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f449824f869c43ea84a75ef539102a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.660306 12376 tablet_service.cc:1511] Processing CreateTablet for tablet 1bde340c4b24422ba28405c87c38b47c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:01.662114 12376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bde340c4b24422ba28405c87c38b47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.669641 12374 tablet_service.cc:1511] Processing CreateTablet for tablet f449824f869c43ea84a75ef539102a0c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:01.671209 12374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f449824f869c43ea84a75ef539102a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.673230 12299 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8cded4125441b8829cdecbada6c99 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:01.677839 12299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8cded4125441b8829cdecbada6c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.679314 12373 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8cded4125441b8829cdecbada6c99 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:01.681094 12373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8cded4125441b8829cdecbada6c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.681182 12298 tablet_service.cc:1511] Processing CreateTablet for tablet d405fb4053de42b8b7d1bb114e6d7951 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:01.682988 12298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d405fb4053de42b8b7d1bb114e6d7951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.709518 12429 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:01.710958 12227 tablet_service.cc:1511] Processing CreateTablet for tablet 1bde340c4b24422ba28405c87c38b47c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:01.713502 12226 tablet_service.cc:1511] Processing CreateTablet for tablet f50eee84d3c847da94637683aed78352 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:01.719846 12429 tablet_bootstrap.cc:654] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.721388 12223 tablet_service.cc:1511] Processing CreateTablet for tablet d405fb4053de42b8b7d1bb114e6d7951 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:01.715658 12225 tablet_service.cc:1511] Processing CreateTablet for tablet f449824f869c43ea84a75ef539102a0c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:01.720028 12224 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8cded4125441b8829cdecbada6c99 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:01.730379 12227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bde340c4b24422ba28405c87c38b47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.733166 12429 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:01.733944 12429 ts_tablet_manager.cc:1403] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:06:01.738303 12429 raft_consensus.cc:359] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:01.739295 12429 raft_consensus.cc:385] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.739653 12429 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.740706 12429 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:01.741830 12223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d405fb4053de42b8b7d1bb114e6d7951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.743749 12337 heartbeater.cc:499] Master 127.11.78.62:46569 was elected leader, sending a full tablet report...
I20260709 13:06:01.747207 12429 ts_tablet_manager.cc:1434] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:06:01.747740 12375 tablet_service.cc:1511] Processing CreateTablet for tablet d405fb4053de42b8b7d1bb114e6d7951 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:01.748608 12429 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:01.749245 12375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d405fb4053de42b8b7d1bb114e6d7951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.749380 12222 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf71f08ea584a4780bca91e02db419a (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:01.749409 12226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50eee84d3c847da94637683aed78352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.752991 12224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8cded4125441b8829cdecbada6c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.758430 12429 tablet_bootstrap.cc:654] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.767238 12221 tablet_service.cc:1511] Processing CreateTablet for tablet e60c3debbe734128867220558fddd6eb (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:01.769057 12221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c3debbe734128867220558fddd6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.771785 12429 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:01.772655 12222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf71f08ea584a4780bca91e02db419a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.772467 12429 ts_tablet_manager.cc:1403] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 13:06:01.776872 12225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f449824f869c43ea84a75ef539102a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.767064 12374 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf71f08ea584a4780bca91e02db419a (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:01.776737 12429 raft_consensus.cc:359] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.777603 12429 raft_consensus.cc:385] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.777977 12429 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.778265 12374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf71f08ea584a4780bca91e02db419a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.779148 12431 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.779670 12431 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:01.781462 12300 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf71f08ea584a4780bca91e02db419a (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:01.782953 12300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf71f08ea584a4780bca91e02db419a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.791960 12429 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.794433 12431 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455), 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:01.796010 12301 tablet_service.cc:1511] Processing CreateTablet for tablet e60c3debbe734128867220558fddd6eb (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:01.798105 12301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c3debbe734128867220558fddd6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.804682 12429 ts_tablet_manager.cc:1434] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.006s
I20260709 13:06:01.806221 12429 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:01.824726 12429 tablet_bootstrap.cc:654] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.824520 12376 tablet_service.cc:1511] Processing CreateTablet for tablet e60c3debbe734128867220558fddd6eb (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:01.826020 12376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c3debbe734128867220558fddd6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.829403 12435 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.830035 12435 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.833132 12435 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:01.836117 12386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:01.837908 12429 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:01.837991 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:01.838693 12429 ts_tablet_manager.cc:1403] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.003s
W20260709 13:06:01.840241 12276 leader_election.cc:343] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:01.841045 12276 leader_election.cc:343] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.842077 12429 raft_consensus.cc:359] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.842885 12429 raft_consensus.cc:385] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.843185 12429 raft_consensus.cc:740] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.844129 12220 tablet_service.cc:1511] Processing CreateTablet for tablet 851dd7df72fa421c9e3c01571cf2b71c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:01.844352 12429 consensus_queue.cc:260] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.845719 12220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851dd7df72fa421c9e3c01571cf2b71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.853260 12429 ts_tablet_manager.cc:1434] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:06:01.854709 12429 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:01.869501 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:01.872403 12276 leader_election.cc:343] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.872931 12276 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373; no voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:01.874125 12435 raft_consensus.cc:2749] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:01.875684 12276 leader_election.cc:343] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Not found: Tablet not found: e6a8cded4125441b8829cdecbada6c99
I20260709 13:06:01.876215 12276 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373; no voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:01.877154 12435 raft_consensus.cc:2749] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.878435 12429 tablet_bootstrap.cc:654] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.883082 12432 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:01.885251 12298 tablet_service.cc:1511] Processing CreateTablet for tablet 851dd7df72fa421c9e3c01571cf2b71c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:01.886770 12298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851dd7df72fa421c9e3c01571cf2b71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.892002 12373 tablet_service.cc:1511] Processing CreateTablet for tablet 851dd7df72fa421c9e3c01571cf2b71c (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:01.893563 12373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851dd7df72fa421c9e3c01571cf2b71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.897622 12429 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:01.898383 12429 ts_tablet_manager.cc:1403] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.012s
W20260709 13:06:01.900835 12183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:01.902485 12227 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45895a0c6f4551aad4a379ba3c7ec4 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:01.903980 12227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45895a0c6f4551aad4a379ba3c7ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.903861 12429 raft_consensus.cc:359] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.921262 12429 raft_consensus.cc:385] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.908488 12302 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45895a0c6f4551aad4a379ba3c7ec4 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:01.923187 12302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45895a0c6f4551aad4a379ba3c7ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.925150 12376 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45895a0c6f4551aad4a379ba3c7ec4 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:01.909744 12437 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:01.926745 12376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45895a0c6f4551aad4a379ba3c7ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.932476 12429 raft_consensus.cc:740] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.933511 12429 consensus_queue.cc:260] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.948630 12432 tablet_bootstrap.cc:654] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.949940 12224 tablet_service.cc:1511] Processing CreateTablet for tablet e6f98afa11ce4234827cdbfd225c5f94 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:01.951370 12224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f98afa11ce4234827cdbfd225c5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.957290 12299 tablet_service.cc:1511] Processing CreateTablet for tablet e6f98afa11ce4234827cdbfd225c5f94 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:01.958757 12299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f98afa11ce4234827cdbfd225c5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.953715 12437 tablet_bootstrap.cc:654] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.967056 12374 tablet_service.cc:1511] Processing CreateTablet for tablet e6f98afa11ce4234827cdbfd225c5f94 (DEFAULT_TABLE table=test-workload [id=dd35f7f3dbad41668ca910617740aafa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:01.967918 12429 ts_tablet_manager.cc:1434] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.012s
I20260709 13:06:01.968642 12374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f98afa11ce4234827cdbfd225c5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.971573 12429 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:01.976305 12435 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.976933 12435 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.979156 12435 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:01.981273 12432 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:01.981849 12432 ts_tablet_manager.cc:1403] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.099s	user 0.004s	sys 0.009s
I20260709 13:06:01.982064 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:01.983512 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
W20260709 13:06:01.985592 12276 leader_election.cc:343] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.985460 12432 raft_consensus.cc:359] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:01.986033 12429 tablet_bootstrap.cc:654] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.986378 12432 raft_consensus.cc:385] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:01.986461 12276 leader_election.cc:343] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.992130 12276 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373; no voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:01.992964 12435 raft_consensus.cc:2749] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.011089 12437 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:01.995826 12432 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.011605 12437 ts_tablet_manager.cc:1403] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.006s
I20260709 13:06:02.012256 12432 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.016853 12411 heartbeater.cc:499] Master 127.11.78.62:46569 was elected leader, sending a full tablet report...
I20260709 13:06:02.017227 12437 raft_consensus.cc:359] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.018072 12437 raft_consensus.cc:385] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.017367 12432 ts_tablet_manager.cc:1434] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:06:02.018362 12437 raft_consensus.cc:740] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.018743 12429 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.019642 12429 ts_tablet_manager.cc:1403] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.016s
I20260709 13:06:02.020143 12432 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.019724 12437 consensus_queue.cc:260] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.023180 12429 raft_consensus.cc:359] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.024098 12429 raft_consensus.cc:385] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.024441 12429 raft_consensus.cc:740] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.025489 12429 consensus_queue.cc:260] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.028249 12432 tablet_bootstrap.cc:654] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.032332 12442 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.032902 12429 ts_tablet_manager.cc:1434] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:06:02.032967 12442 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.034550 12429 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:02.045389 12429 tablet_bootstrap.cc:654] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.049569 12442 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.064855 12262 heartbeater.cc:499] Master 127.11.78.62:46569 was elected leader, sending a full tablet report...
I20260709 13:06:02.069633 12437 ts_tablet_manager.cc:1434] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.058s	user 0.019s	sys 0.004s
I20260709 13:06:02.074275 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.078564 12432 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.079408 12432 ts_tablet_manager.cc:1403] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.023s
I20260709 13:06:02.070811 12437 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
W20260709 13:06:02.080971 12350 leader_election.cc:343] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.083420 12432 raft_consensus.cc:359] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.084491 12432 raft_consensus.cc:385] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.084889 12432 raft_consensus.cc:740] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.085906 12432 consensus_queue.cc:260] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.089002 12432 ts_tablet_manager.cc:1434] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:06:02.090312 12432 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.099310 12432 tablet_bootstrap.cc:654] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.110023 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.110811 12312 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.111325 12429 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.112080 12429 ts_tablet_manager.cc:1403] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.078s	user 0.035s	sys 0.037s
I20260709 13:06:02.112356 12351 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.112984 12437 tablet_bootstrap.cc:654] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.113891 12442 raft_consensus.cc:2804] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.114379 12442 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.114737 12442 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.116160 12429 raft_consensus.cc:359] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.117254 12429 raft_consensus.cc:385] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.117677 12429 raft_consensus.cc:740] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.118357 12429 consensus_queue.cc:260] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.120769 12432 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.121318 12432 ts_tablet_manager.cc:1403] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 13:06:02.123224 12429 ts_tablet_manager.cc:1434] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:06:02.124392 12429 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:02.124485 12432 raft_consensus.cc:359] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.125413 12432 raft_consensus.cc:385] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.125738 12432 raft_consensus.cc:740] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.126289 12437 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.126957 12437 ts_tablet_manager.cc:1403] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.003s
I20260709 13:06:02.126804 12432 consensus_queue.cc:260] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.128093 12442 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.133095 12429 tablet_bootstrap.cc:654] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.134207 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.130633 12437 raft_consensus.cc:359] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.135947 12432 ts_tablet_manager.cc:1434] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
W20260709 13:06:02.136107 12350 leader_election.cc:343] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.136189 12437 raft_consensus.cc:385] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.136775 12437 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.137180 12432 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.137853 12437 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.136658 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.140543 12437 ts_tablet_manager.cc:1434] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:06:02.140770 12312 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.141642 12437 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.148226 12442 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.152233 12437 tablet_bootstrap.cc:654] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.160571 12432 tablet_bootstrap.cc:654] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.171214 12312 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.177587 12351 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.179214 12442 raft_consensus.cc:2804] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.179886 12442 raft_consensus.cc:697] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:02.181102 12442 consensus_queue.cc:237] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.174698 12432 tablet_bootstrap.cc:492] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.184520 12432 ts_tablet_manager.cc:1403] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.008s
I20260709 13:06:02.189901 12432 raft_consensus.cc:359] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.192189 12432 raft_consensus.cc:385] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.192817 12432 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.196597 12429 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.195926 12432 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.197238 12437 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.197393 12429 ts_tablet_manager.cc:1403] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.073s	user 0.034s	sys 0.033s
I20260709 13:06:02.198132 12437 ts_tablet_manager.cc:1403] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.019s
I20260709 13:06:02.200258 12432 ts_tablet_manager.cc:1434] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:06:02.201817 12432 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.206506 12429 raft_consensus.cc:359] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.207453 12429 raft_consensus.cc:385] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.207082 12437 raft_consensus.cc:359] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.207983 12429 raft_consensus.cc:740] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.208531 12437 raft_consensus.cc:385] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.208948 12437 raft_consensus.cc:740] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.208055 12135 catalog_manager.cc:5697] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.209151 12429 consensus_queue.cc:260] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.210079 12437 consensus_queue.cc:260] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.211282 12432 tablet_bootstrap.cc:654] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.212349 12429 ts_tablet_manager.cc:1434] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.002s
I20260709 13:06:02.213822 12429 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:02.217303 12437 ts_tablet_manager.cc:1434] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:06:02.219072 12437 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.220775 12443 raft_consensus.cc:493] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.221338 12429 tablet_bootstrap.cc:654] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.221401 12443 raft_consensus.cc:515] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.227373 12437 tablet_bootstrap.cc:654] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.233309 12435 raft_consensus.cc:493] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.234063 12435 raft_consensus.cc:515] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.239387 12443 leader_election.cc:290] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.244935 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
W20260709 13:06:02.246964 12276 leader_election.cc:343] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.247716 12435 leader_election.cc:290] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.252864 12432 tablet_bootstrap.cc:492] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.253563 12432 ts_tablet_manager.cc:1403] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:06:02.257083 12432 raft_consensus.cc:359] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.257889 12432 raft_consensus.cc:385] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.258144 12435 raft_consensus.cc:493] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.258183 12432 raft_consensus.cc:740] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.259338 12435 raft_consensus.cc:515] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.260416 12432 consensus_queue.cc:260] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.264457 12432 ts_tablet_manager.cc:1434] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:06:02.265076 12435 leader_election.cc:290] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.266750 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.267026 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.267722 12236 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 0.
I20260709 13:06:02.269223 12432 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.269774 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:02.276225 12276 leader_election.cc:343] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.277879 12443 raft_consensus.cc:493] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.278644 12443 raft_consensus.cc:515] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.277722 12276 leader_election.cc:304] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:02.282666 12435 raft_consensus.cc:2804] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:02.283151 12276 leader_election.cc:343] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.283267 12435 raft_consensus.cc:493] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.283998 12435 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.283928 12276 leader_election.cc:304] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373; no voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:02.285095 12431 raft_consensus.cc:2749] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.285449 12443 leader_election.cc:290] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.287058 12432 tablet_bootstrap.cc:654] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.290228 12431 raft_consensus.cc:493] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.291134 12431 raft_consensus.cc:515] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.296154 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:02.298367 12276 leader_election.cc:343] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.300215 12431 leader_election.cc:290] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.302843 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.303812 12385 raft_consensus.cc:2468] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 0.
I20260709 13:06:02.305598 12276 leader_election.cc:304] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.307160 12431 raft_consensus.cc:2804] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.307658 12431 raft_consensus.cc:493] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.308136 12431 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.343293 12437 tablet_bootstrap.cc:492] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.343911 12437 ts_tablet_manager.cc:1403] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.125s	user 0.035s	sys 0.042s
I20260709 13:06:02.344993 12429 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.345826 12429 ts_tablet_manager.cc:1403] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.132s	user 0.054s	sys 0.075s
I20260709 13:06:02.346834 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.347628 12311 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 0.
I20260709 13:06:02.346858 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.349222 12202 leader_election.cc:304] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:02.350365 12443 raft_consensus.cc:2804] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.350175 12437 raft_consensus.cc:359] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.350781 12443 raft_consensus.cc:493] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.350919 12432 tablet_bootstrap.cc:492] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.350977 12437 raft_consensus.cc:385] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.351199 12443 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.352136 12432 ts_tablet_manager.cc:1403] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.028s
I20260709 13:06:02.351271 12429 raft_consensus.cc:359] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.352608 12429 raft_consensus.cc:385] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.353024 12429 raft_consensus.cc:740] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.354128 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.353911 12429 consensus_queue.cc:260] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.355525 12386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.356284 12386 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 0.
I20260709 13:06:02.356101 12432 raft_consensus.cc:359] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.357306 12432 raft_consensus.cc:385] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.357755 12432 raft_consensus.cc:740] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
W20260709 13:06:02.358068 12201 leader_election.cc:343] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.359203 12432 consensus_queue.cc:260] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.359702 12443 raft_consensus.cc:515] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.361541 12435 raft_consensus.cc:515] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.362831 12312 raft_consensus.cc:2393] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 436e5c88bcfe4f46b795aa12ef336a34 in current term 1: Already voted for candidate 5f320ea492f746d088d0ee95b9881373 in this term.
I20260709 13:06:02.363564 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.364244 12311 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.366175 12432 ts_tablet_manager.cc:1434] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:06:02.367456 12432 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.368990 12202 leader_election.cc:304] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34; no voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:02.368901 12431 raft_consensus.cc:515] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.374961 12386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:02.375677 12386 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.377769 12437 raft_consensus.cc:740] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.375377 12311 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 1.
I20260709 13:06:02.380120 12432 tablet_bootstrap.cc:654] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.380379 12437 consensus_queue.cc:260] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.384338 12386 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.385195 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:02.385919 12385 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.388947 12465 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.390545 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.393021 12237 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.393469 12385 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 1.
I20260709 13:06:02.395586 12435 leader_election.cc:290] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.391604 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.398597 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:02.399189 12385 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.399595 12431 leader_election.cc:290] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.401022 12276 leader_election.cc:304] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.404657 12435 raft_consensus.cc:2804] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.405128 12435 raft_consensus.cc:697] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:02.406083 12435 consensus_queue.cc:237] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.407439 12237 raft_consensus.cc:2468] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.392374 12202 leader_election.cc:304] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:02.385967 12443 leader_election.cc:290] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.411383 12442 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.411758 12276 leader_election.cc:304] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:02.412750 12431 raft_consensus.cc:2804] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.412279 12442 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.413242 12431 raft_consensus.cc:697] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:02.414143 12431 consensus_queue.cc:237] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.417151 12443 raft_consensus.cc:2804] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.419268 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.418977 12442 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:02.420169 12237 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.420274 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.421458 12350 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.422828 12437 ts_tablet_manager.cc:1434] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.003s
I20260709 13:06:02.423095 12442 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.423554 12442 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.423926 12442 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.427181 12429 ts_tablet_manager.cc:1434] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.046s
I20260709 13:06:02.428193 12311 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.428561 12429 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:02.429808 12385 raft_consensus.cc:2468] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.423942 12437 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.431632 12443 raft_consensus.cc:697] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:02.432655 12443 consensus_queue.cc:237] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.438447 12465 raft_consensus.cc:2749] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.441774 12442 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.443956 12442 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:02.446908 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.447542 12237 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.449882 12432 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.450743 12432 ts_tablet_manager.cc:1403] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.026s
I20260709 13:06:02.450923 12429 tablet_bootstrap.cc:654] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.451725 12236 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.451947 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.452657 12311 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.450923 12437 tablet_bootstrap.cc:654] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.454262 12432 raft_consensus.cc:359] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.455061 12432 raft_consensus.cc:385] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.455427 12432 raft_consensus.cc:740] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.456364 12432 consensus_queue.cc:260] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.458994 12432 ts_tablet_manager.cc:1434] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:06:02.460350 12432 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.460726 12311 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.461997 12351 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.462970 12442 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.463457 12442 raft_consensus.cc:697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:02.464346 12442 consensus_queue.cc:237] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:02.467617 12432 tablet_bootstrap.cc:654] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.472268 12237 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.443790 12135 catalog_manager.cc:5697] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.480836 12134 catalog_manager.cc:5697] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.490006 12437 tablet_bootstrap.cc:492] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.490638 12437 ts_tablet_manager.cc:1403] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.001s
I20260709 13:06:02.491395 12431 raft_consensus.cc:493] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.492287 12431 raft_consensus.cc:515] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.493868 12437 raft_consensus.cc:359] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.494607 12437 raft_consensus.cc:385] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.494887 12437 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.497177 12431 leader_election.cc:290] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.497902 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.498063 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.498152 12437 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
W20260709 13:06:02.499423 12276 leader_election.cc:343] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.500098 12276 leader_election.cc:343] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.500476 12276 leader_election.cc:304] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373; no voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:02.500769 12432 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.501103 12437 ts_tablet_manager.cc:1434] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:06:02.501188 12432 ts_tablet_manager.cc:1403] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.015s
I20260709 13:06:02.501735 12431 raft_consensus.cc:2749] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.502425 12437 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.504148 12432 raft_consensus.cc:359] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.504835 12432 raft_consensus.cc:385] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.505106 12432 raft_consensus.cc:740] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.505885 12432 consensus_queue.cc:260] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.507887 12432 ts_tablet_manager.cc:1434] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:02.507507 12134 catalog_manager.cc:5697] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.508862 12432 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.492010 12133 catalog_manager.cc:5697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.511416 12437 tablet_bootstrap.cc:654] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.514569 12432 tablet_bootstrap.cc:654] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.519547 12429 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.520829 12429 ts_tablet_manager.cc:1403] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.020s
I20260709 13:06:02.524704 12429 raft_consensus.cc:359] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.527712 12429 raft_consensus.cc:385] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.528535 12429 raft_consensus.cc:740] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.529320 12442 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.530165 12442 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.533828 12437 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.534607 12437 ts_tablet_manager.cc:1403] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.002s
I20260709 13:06:02.534878 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.536532 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.537376 12311 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.538218 12437 raft_consensus.cc:359] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.539038 12437 raft_consensus.cc:385] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.539345 12437 raft_consensus.cc:740] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.540548 12442 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.541150 12351 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
W20260709 13:06:02.542254 12350 leader_election.cc:343] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.542783 12429 consensus_queue.cc:260] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.544071 12442 raft_consensus.cc:2804] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.545006 12442 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.545531 12442 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.545775 12429 ts_tablet_manager.cc:1434] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:06:02.547012 12429 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: Bootstrap starting.
I20260709 13:06:02.549296 12437 consensus_queue.cc:260] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.552436 12437 ts_tablet_manager.cc:1434] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:06:02.553566 12429 tablet_bootstrap.cc:654] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.553534 12437 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.556829 12442 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.560766 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.560770 12442 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.561502 12311 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.562264 12432 tablet_bootstrap.cc:492] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.562716 12432 ts_tablet_manager.cc:1403] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.011s
I20260709 13:06:02.564587 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.565464 12432 raft_consensus.cc:359] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.566089 12432 raft_consensus.cc:385] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.566349 12432 raft_consensus.cc:740] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.567014 12432 consensus_queue.cc:260] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
W20260709 13:06:02.567982 12350 leader_election.cc:343] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.569113 12432 ts_tablet_manager.cc:1434] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:02.570422 12432 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: Bootstrap starting.
I20260709 13:06:02.576068 12432 tablet_bootstrap.cc:654] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.576735 12311 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.578231 12351 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.580179 12450 raft_consensus.cc:2804] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.580708 12450 raft_consensus.cc:697] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:02.581522 12450 consensus_queue.cc:237] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.580576 12437 tablet_bootstrap.cc:654] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.583454 12442 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.598641 12132 catalog_manager.cc:5697] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.610239 12450 raft_consensus.cc:493] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.611002 12450 raft_consensus.cc:515] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.615151 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:02.617182 12350 leader_election.cc:343] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.619845 12431 raft_consensus.cc:493] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.620570 12431 raft_consensus.cc:515] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.621376 12429 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: No bootstrap required, opened a new log
I20260709 13:06:02.621935 12429 ts_tablet_manager.cc:1403] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.013s
I20260709 13:06:02.625301 12437 tablet_bootstrap.cc:492] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.625051 12429 raft_consensus.cc:359] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.625826 12429 raft_consensus.cc:385] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.625950 12437 ts_tablet_manager.cc:1403] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.029s
I20260709 13:06:02.626161 12429 raft_consensus.cc:740] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.626945 12429 consensus_queue.cc:260] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.629119 12429 ts_tablet_manager.cc:1434] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:02.629276 12437 raft_consensus.cc:359] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.630134 12437 raft_consensus.cc:385] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.630462 12437 raft_consensus.cc:740] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.630580 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.631397 12237 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 0.
I20260709 13:06:02.631357 12437 consensus_queue.cc:260] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.632382 12432 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: No bootstrap required, opened a new log
I20260709 13:06:02.632900 12432 ts_tablet_manager.cc:1403] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.022s
I20260709 13:06:02.632802 12276 leader_election.cc:304] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:02.633754 12435 raft_consensus.cc:2804] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.634145 12435 raft_consensus.cc:493] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.634470 12435 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.634662 12431 leader_election.cc:290] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.636415 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.637104 12385 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 0.
I20260709 13:06:02.638252 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.639175 12312 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.641223 12351 leader_election.cc:304] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.642025 12437 ts_tablet_manager.cc:1434] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:06:02.642357 12442 raft_consensus.cc:2804] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.642843 12442 raft_consensus.cc:493] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.638260 12450 leader_election.cc:290] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.643230 12442 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.643239 12437 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.643839 12432 raft_consensus.cc:359] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.644624 12432 raft_consensus.cc:385] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.644912 12432 raft_consensus.cc:740] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.645654 12432 consensus_queue.cc:260] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.647822 12432 ts_tablet_manager.cc:1434] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:06:02.650858 12437 tablet_bootstrap.cc:654] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.652612 12442 raft_consensus.cc:515] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.655084 12442 leader_election.cc:290] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.656569 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.657248 12312 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.659742 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.663712 12237 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.642356 12435 raft_consensus.cc:515] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.670846 12437 tablet_bootstrap.cc:492] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.677102 12437 ts_tablet_manager.cc:1403] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:06:02.671027 12435 leader_election.cc:290] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.671291 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.672503 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:02.680629 12437 raft_consensus.cc:359] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.680994 12237 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.674932 12450 raft_consensus.cc:493] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.675765 12235 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.681427 12437 raft_consensus.cc:385] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.681804 12437 raft_consensus.cc:740] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.680559 12236 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.682317 12350 leader_election.cc:304] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.683182 12442 raft_consensus.cc:2804] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.682715 12437 consensus_queue.cc:260] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.676319 12312 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.681110 12385 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.688874 12437 ts_tablet_manager.cc:1434] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:06:02.690045 12437 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.673158 12431 raft_consensus.cc:493] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.692201 12431 raft_consensus.cc:515] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.697204 12437 tablet_bootstrap.cc:654] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.697929 12450 raft_consensus.cc:515] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.700565 12386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.701319 12386 raft_consensus.cc:2468] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 0.
I20260709 13:06:02.702651 12276 leader_election.cc:304] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.703554 12435 raft_consensus.cc:2804] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.703958 12435 raft_consensus.cc:493] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.704512 12435 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.705910 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.707293 12450 leader_election.cc:290] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.709198 12234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:02.710880 12350 leader_election.cc:343] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.711112 12237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
W20260709 13:06:02.712535 12276 leader_election.cc:343] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.712806 12385 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.714886 12276 leader_election.cc:304] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.716426 12464 raft_consensus.cc:2804] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.716954 12442 raft_consensus.cc:697] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:02.716598 12435 raft_consensus.cc:515] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.718010 12312 raft_consensus.cc:2393] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb9389b2761f4c9f8dfacd470163d1d7 in current term 1: Already voted for candidate 5f320ea492f746d088d0ee95b9881373 in this term.
I20260709 13:06:02.718071 12442 consensus_queue.cc:237] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.720773 12351 leader_election.cc:304] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373
I20260709 13:06:02.719715 12431 leader_election.cc:290] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.723397 12236 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.724995 12487 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.733385 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.734517 12450 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:02.735138 12276 leader_election.cc:343] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.739638 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:02.741096 12435 leader_election.cc:290] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.749434 12464 raft_consensus.cc:697] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:02.753432 12437 tablet_bootstrap.cc:492] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.754088 12437 ts_tablet_manager.cc:1403] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.024s
I20260709 13:06:02.752873 12464 consensus_queue.cc:237] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.759514 12437 raft_consensus.cc:359] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.760572 12437 raft_consensus.cc:385] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.760943 12437 raft_consensus.cc:740] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.762014 12437 consensus_queue.cc:260] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.765195 12437 ts_tablet_manager.cc:1434] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:06:02.766579 12437 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: Bootstrap starting.
I20260709 13:06:02.777575 12437 tablet_bootstrap.cc:654] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.775620 12132 catalog_manager.cc:5697] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.792949 12487 raft_consensus.cc:2749] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.793232 12135 catalog_manager.cc:5697] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.807157 12385 raft_consensus.cc:2468] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 1.
I20260709 13:06:02.810446 12276 leader_election.cc:304] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:02.812188 12464 raft_consensus.cc:2804] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.812913 12464 raft_consensus.cc:697] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:02.814157 12464 consensus_queue.cc:237] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.823832 12437 tablet_bootstrap.cc:492] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: No bootstrap required, opened a new log
I20260709 13:06:02.824553 12437 ts_tablet_manager.cc:1403] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.027s
I20260709 13:06:02.827025 12437 raft_consensus.cc:359] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.827739 12437 raft_consensus.cc:385] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.828006 12437 raft_consensus.cc:740] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.828835 12437 consensus_queue.cc:260] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.830488 12437 ts_tablet_manager.cc:1434] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:02.832561 12132 catalog_manager.cc:5697] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.846854 12487 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.849534 12443 consensus_queue.cc:1048] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.864214 12465 consensus_queue.cc:1048] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.866492 12489 consensus_queue.cc:1048] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.874142 12442 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.879601 12431 consensus_queue.cc:1048] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:02.912226 12183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:02.927788 12450 raft_consensus.cc:493] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.928464 12450 raft_consensus.cc:515] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.930552 12450 leader_election.cc:290] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.931668 12235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34" is_pre_election: true
I20260709 13:06:02.932247 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.932524 12235 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.932956 12312 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 0.
I20260709 13:06:02.933771 12431 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.934183 12351 leader_election.cc:304] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.935107 12450 raft_consensus.cc:2804] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.935429 12450 raft_consensus.cc:493] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.935789 12450 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.942903 12450 raft_consensus.cc:515] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.945528 12465 raft_consensus.cc:493] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.946175 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:02.946146 12465 raft_consensus.cc:515] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.946951 12236 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.947880 12464 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.949211 12465 leader_election.cc:290] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:02.949105 12450 leader_election.cc:290] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:02.950230 12386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:02.950268 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:02.951217 12386 raft_consensus.cc:2393] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 436e5c88bcfe4f46b795aa12ef336a34 in current term 1: Already voted for candidate 5f320ea492f746d088d0ee95b9881373 in this term.
I20260709 13:06:02.951135 12312 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.953397 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:02.955565 12202 leader_election.cc:304] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34; no voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:02.957142 12443 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.957798 12236 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.959849 12350 leader_election.cc:304] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:02.960990 12450 raft_consensus.cc:2804] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.961769 12450 raft_consensus.cc:697] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:02.962895 12450 consensus_queue.cc:237] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:02.964170 12312 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 1.
I20260709 13:06:02.967809 12443 raft_consensus.cc:2749] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.982107 12133 catalog_manager.cc:5697] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.029259 12443 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.029896 12443 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.030122 12450 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.031810 12443 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.032697 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f320ea492f746d088d0ee95b9881373" is_pre_election: true
I20260709 13:06:03.033100 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" is_pre_election: true
I20260709 13:06:03.035094 12201 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34; no voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:03.036376 12443 raft_consensus.cc:2749] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.041980 12235 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.050760 12442 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.135437 12385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:03.136248 12385 raft_consensus.cc:606] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:03.153081 12311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50eee84d3c847da94637683aed78352"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:41058
I20260709 13:06:03.153856 12311 raft_consensus.cc:606] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:03.160871 12385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:03.161597 12385 raft_consensus.cc:606] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:03.168419 12385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:03.169155 12385 raft_consensus.cc:606] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:03.181214 12385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c3debbe734128867220558fddd6eb"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:03.181845 12385 raft_consensus.cc:606] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Received request to transfer leadership to TS 5f320ea492f746d088d0ee95b9881373
I20260709 13:06:03.191339 12385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:03.192142 12385 raft_consensus.cc:606] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Received request to transfer leadership to TS 5f320ea492f746d088d0ee95b9881373
I20260709 13:06:03.192745 12442 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.198541 12311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
mode: GRACEFUL
new_leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:41058
I20260709 13:06:03.199442 12311 raft_consensus.cc:606] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Received request to transfer leadership to TS eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:03.212167 12512 raft_consensus.cc:993] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.212718 12442 raft_consensus.cc:1081] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.214419 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39442
I20260709 13:06:03.214937 12236 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.215273 12236 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.216235 12464 consensus_queue.cc:1048] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.221271 12487 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.223058 12236 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.226393 12236 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.227270 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:03.227953 12312 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.232153 12435 consensus_queue.cc:1048] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.232728 12464 consensus_queue.cc:1048] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.233659 12385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.234561 12385 raft_consensus.cc:3055] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.234920 12385 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.235852 12385 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.237419 12385 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.243201 12312 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.245000 12202 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:03.246706 12443 raft_consensus.cc:2804] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.247325 12443 raft_consensus.cc:697] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:03.247437 12385 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.248427 12489 consensus_queue.cc:1048] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.252243 12443 consensus_queue.cc:237] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.263473 12464 raft_consensus.cc:993] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.263972 12435 raft_consensus.cc:1081] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.266800 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50eee84d3c847da94637683aed78352"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39430
I20260709 13:06:03.267373 12236 raft_consensus.cc:493] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.267773 12236 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.270825 12133 catalog_manager.cc:5697] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.274832 12236 raft_consensus.cc:515] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.275802 12464 raft_consensus.cc:993] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: : Instructing follower eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:03.276261 12435 raft_consensus.cc:1081] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Signalling peer eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:03.277817 12312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:03.278401 12312 raft_consensus.cc:3055] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.278723 12312 raft_consensus.cc:740] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:03.279543 12312 consensus_queue.cc:260] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.280717 12312 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.281368 12512 raft_consensus.cc:993] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:03.281894 12512 raft_consensus.cc:1081] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Signalling peer 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:03.284145 12310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60c3debbe734128867220558fddd6eb"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:41032
I20260709 13:06:03.284885 12310 raft_consensus.cc:493] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.285276 12310 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.289755 12236 leader_election.cc:290] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.290163 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50eee84d3c847da94637683aed78352" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.290771 12384 raft_consensus.cc:3060] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.292387 12312 raft_consensus.cc:2468] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.293998 12202 leader_election.cc:304] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:03.294806 12386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:06:03.295696 12386 raft_consensus.cc:493] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.296171 12386 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.297247 12384 raft_consensus.cc:2468] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.297453 12443 raft_consensus.cc:2804] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.298094 12443 raft_consensus.cc:697] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:03.299172 12443 consensus_queue.cc:237] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.302384 12310 raft_consensus.cc:515] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.304800 12310 leader_election.cc:290] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.307837 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.308624 12384 raft_consensus.cc:3055] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.308604 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:03.309433 12384 raft_consensus.cc:740] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.309880 12236 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.311228 12384 consensus_queue.cc:260] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.312851 12384 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.314307 12133 catalog_manager.cc:5697] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from 5f320ea492f746d088d0ee95b9881373 (127.11.78.2) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.317268 12236 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:03.318832 12276 leader_election.cc:304] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:03.319643 12489 raft_consensus.cc:2804] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.320132 12489 raft_consensus.cc:697] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:03.321161 12489 consensus_queue.cc:237] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.325918 12384 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:03.330361 12450 raft_consensus.cc:993] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.330924 12487 raft_consensus.cc:1081] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.332973 12386 raft_consensus.cc:515] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.334583 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39442
I20260709 13:06:03.335278 12236 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.335632 12386 leader_election.cc:290] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 2 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:03.335731 12236 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.336249 12235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:03.336886 12235 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.337162 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f98afa11ce4234827cdbfd225c5f94" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:03.337849 12310 raft_consensus.cc:3055] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.338155 12310 raft_consensus.cc:740] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:03.339229 12310 consensus_queue.cc:260] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.339635 12132 catalog_manager.cc:5697] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 1 to 2, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.341382 12310 raft_consensus.cc:3060] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.345003 12235 raft_consensus.cc:2468] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 2.
I20260709 13:06:03.346275 12350 leader_election.cc:304] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:03.347149 12450 raft_consensus.cc:2804] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.347652 12450 raft_consensus.cc:697] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.346951 12487 consensus_queue.cc:1048] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.348644 12450 consensus_queue.cc:237] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.344344 12236 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:03.353397 12236 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:03.354571 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:03.355222 12311 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.356649 12310 raft_consensus.cc:2468] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 2.
I20260709 13:06:03.357695 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.358307 12384 raft_consensus.cc:3055] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.358670 12384 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.359549 12384 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:03.360888 12384 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.368116 12450 consensus_queue.cc:1048] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.367753 12384 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.370179 12201 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:03.371049 12443 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.371506 12443 raft_consensus.cc:697] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:03.372332 12443 consensus_queue.cc:237] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:03.374579 12311 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.368927 12132 catalog_manager.cc:5697] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 1 to 2, leader changed from 5f320ea492f746d088d0ee95b9881373 (127.11.78.2) to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.390473 12442 raft_consensus.cc:993] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:03.391175 12442 raft_consensus.cc:1081] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Signalling peer 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:03.394269 12311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:41032
I20260709 13:06:03.396212 12311 raft_consensus.cc:493] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.395581 12134 catalog_manager.cc:5697] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.396673 12311 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.403841 12311 raft_consensus.cc:515] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.407955 12311 leader_election.cc:290] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.409437 12235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:03.409591 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b45895a0c6f4551aad4a379ba3c7ec4" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.410194 12235 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.410311 12384 raft_consensus.cc:3055] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.410761 12384 raft_consensus.cc:740] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.411590 12384 consensus_queue.cc:260] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.412933 12384 raft_consensus.cc:3060] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.416867 12235 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:03.418135 12276 leader_election.cc:304] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:03.418308 12384 raft_consensus.cc:2468] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:03.419078 12489 raft_consensus.cc:2804] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.419636 12489 raft_consensus.cc:697] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:03.420573 12489 consensus_queue.cc:237] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.427726 12133 catalog_manager.cc:5697] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 1 to 2, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.668401 12512 raft_consensus.cc:993] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.668903 12512 raft_consensus.cc:1081] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:03.670710 12235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39442
I20260709 13:06:03.671268 12235 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.671612 12235 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.676898 12235 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.678629 12235 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:03.679654 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:03.680150 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:03.680193 12311 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.680819 12384 raft_consensus.cc:3055] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.681113 12384 raft_consensus.cc:740] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:03.681875 12384 consensus_queue.cc:260] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.682899 12384 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.685631 12311 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.687002 12202 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:03.687893 12520 raft_consensus.cc:2804] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.688407 12520 raft_consensus.cc:697] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:03.689020 12384 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:03.689311 12520 consensus_queue.cc:237] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:03.697217 12133 catalog_manager.cc:5697] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.749801 12235 raft_consensus.cc:1275] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.751736 12489 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.755667 12384 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.757295 12520 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.761750 12386 raft_consensus.cc:1275] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.764003 12464 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.777722 12311 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.779597 12520 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:03.834921 12235 raft_consensus.cc:1275] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.836371 12521 consensus_queue.cc:1048] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.844890 12384 raft_consensus.cc:1275] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.846653 12521 consensus_queue.cc:1048] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.894493 12384 raft_consensus.cc:1275] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.895898 12520 consensus_queue.cc:1048] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.896623 12235 raft_consensus.cc:1275] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.898171 12512 consensus_queue.cc:1048] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.911490 12311 raft_consensus.cc:1275] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.913471 12450 consensus_queue.cc:1048] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.915189 12311 raft_consensus.cc:1275] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.917574 12523 consensus_queue.cc:1048] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.933807 12311 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.935942 12520 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.953887 12384 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.956002 12520 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.069425 12311 raft_consensus.cc:1275] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.070950 12520 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.081120 12384 raft_consensus.cc:1275] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.083724 12443 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.240746 11576 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:06:06.241668 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:06.270576 12235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:06.271368 12235 raft_consensus.cc:606] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Received request to transfer leadership to TS eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:06.274227 12235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:06.274904 12235 raft_consensus.cc:606] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Received request to transfer leadership to TS eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:06.276157 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:06.276669 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:06.558125 12443 raft_consensus.cc:993] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:06.559203 12538 raft_consensus.cc:1081] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Signalling peer eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:06.561925 12386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:32800
I20260709 13:06:06.562834 12386 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.563366 12386 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.571171 12386 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:06.573544 12386 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:06.574666 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:06.574962 12235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:06.575527 12310 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.575711 12235 raft_consensus.cc:3055] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.576172 12235 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:06.577090 12235 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:06.578254 12235 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.581496 12310 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:06.583043 12351 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:06.584236 12531 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:06.585357 12235 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:06.585723 12531 raft_consensus.cc:697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:06.586939 12531 consensus_queue.cc:237] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:06.594986 12132 catalog_manager.cc:5697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 2 to 3, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.777329 12443 raft_consensus.cc:993] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:06.777837 12538 raft_consensus.cc:1081] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Signalling peer eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:06.779525 12386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:32800
I20260709 13:06:06.780169 12386 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.780504 12386 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.786587 12386 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:06.788764 12386 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:06.789690 12235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:06.790094 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:06.790292 12235 raft_consensus.cc:3055] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.790621 12235 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:06.790706 12310 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.791425 12235 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:06.792527 12235 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.796723 12310 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:06.798025 12351 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:06.798377 12235 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:06.798960 12531 raft_consensus.cc:2804] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:06.799537 12531 raft_consensus.cc:697] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:06.800565 12531 consensus_queue.cc:237] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:06.808626 12132 catalog_manager.cc:5697] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 2 to 3, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.992420 12235 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:06.994127 12531 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.008175 12310 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:07.009749 12531 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.243665 12310 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:07.245364 12531 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.257155 12236 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:07.259411 12539 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.277832 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:07.291632 12384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:07.292272 12384 raft_consensus.cc:606] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:07.306241 12384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:32802
I20260709 13:06:07.306950 12384 raft_consensus.cc:606] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:07.316982 12310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:41058
I20260709 13:06:07.317624 12310 raft_consensus.cc:606] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:07.323586 12310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c3debbe734128867220558fddd6eb"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:41058
I20260709 13:06:07.324213 12310 raft_consensus.cc:606] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:07.330241 12310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
mode: GRACEFUL
new_leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:41058
I20260709 13:06:07.330938 12310 raft_consensus.cc:606] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Received request to transfer leadership to TS 436e5c88bcfe4f46b795aa12ef336a34
I20260709 13:06:07.331216 12532 raft_consensus.cc:993] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.331907 12546 raft_consensus.cc:1081] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.333750 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39430
I20260709 13:06:07.334336 12236 raft_consensus.cc:493] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.334707 12236 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.341370 12236 raft_consensus.cc:515] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.343278 12236 leader_election.cc:290] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:07.344455 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:07.344532 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:07.345242 12310 raft_consensus.cc:3055] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.345279 12384 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.345670 12310 raft_consensus.cc:740] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:07.346550 12310 consensus_queue.cc:260] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.348137 12310 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.352437 12384 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:07.353849 12310 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:07.354100 12201 leader_election.cc:304] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:07.355093 12538 raft_consensus.cc:2804] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.356212 12538 raft_consensus.cc:697] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:07.357067 12538 consensus_queue.cc:237] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.364688 12134 catalog_manager.cc:5697] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from 5f320ea492f746d088d0ee95b9881373 (127.11.78.2) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.448668 12549 raft_consensus.cc:993] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.449234 12539 raft_consensus.cc:1081] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.451371 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39442
I20260709 13:06:07.451956 12236 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.452273 12236 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.457573 12236 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:07.459231 12236 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 4 election: Requested vote from peers eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:07.460427 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:07.460469 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:07.461289 12310 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.461483 12384 raft_consensus.cc:3055] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:07.462080 12384 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:07.462955 12384 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:07.464392 12384 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.467972 12310 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 4.
I20260709 13:06:07.469229 12202 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:07.470086 12555 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:07.470587 12555 raft_consensus.cc:697] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:07.471342 12555 consensus_queue.cc:237] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:07.472091 12384 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 4.
I20260709 13:06:07.477900 12134 catalog_manager.cc:5697] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 3 to 4, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 4 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.578455 12532 raft_consensus.cc:993] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.579069 12546 raft_consensus.cc:1081] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.581044 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39430
I20260709 13:06:07.581557 12236 raft_consensus.cc:493] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.581828 12236 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.586598 12236 raft_consensus.cc:515] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.588464 12236 leader_election.cc:290] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:07.589558 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:07.589725 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851dd7df72fa421c9e3c01571cf2b71c" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:07.590101 12310 raft_consensus.cc:3055] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.590446 12384 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.590476 12310 raft_consensus.cc:740] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:07.591459 12310 consensus_queue.cc:260] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.592528 12310 raft_consensus.cc:3060] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.595969 12384 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:07.597344 12201 leader_election.cc:304] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:07.597904 12310 raft_consensus.cc:2468] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 2.
I20260709 13:06:07.598377 12555 raft_consensus.cc:2804] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.599018 12555 raft_consensus.cc:697] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:07.599978 12555 consensus_queue.cc:237] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.607596 12134 catalog_manager.cc:5697] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 1 to 2, leader changed from 5f320ea492f746d088d0ee95b9881373 (127.11.78.2) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.659658 12531 raft_consensus.cc:993] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.660235 12539 raft_consensus.cc:1081] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.661902 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39442
I20260709 13:06:07.662542 12236 raft_consensus.cc:493] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.662940 12236 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.668187 12236 raft_consensus.cc:515] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.670439 12236 leader_election.cc:290] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 4 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:07.671346 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:07.671557 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8cded4125441b8829cdecbada6c99" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:07.671994 12310 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.672185 12384 raft_consensus.cc:3055] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:07.672566 12384 raft_consensus.cc:740] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:07.673228 12384 consensus_queue.cc:260] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.674045 12384 raft_consensus.cc:3060] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.677606 12310 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 4.
I20260709 13:06:07.678272 12384 raft_consensus.cc:2468] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 4.
I20260709 13:06:07.678782 12202 leader_election.cc:304] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, 5f320ea492f746d088d0ee95b9881373; no voters: 
I20260709 13:06:07.679607 12555 raft_consensus.cc:2804] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:07.680202 12555 raft_consensus.cc:697] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:07.680996 12555 consensus_queue.cc:237] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.687322 12134 catalog_manager.cc:5697] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 3 to 4, leader changed from eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 4 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.783277 12384 raft_consensus.cc:1275] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:07.784709 12555 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.795885 12310 raft_consensus.cc:1275] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:07.797294 12555 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.886138 12532 raft_consensus.cc:993] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: : Instructing follower 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.886677 12532 raft_consensus.cc:1081] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Signalling peer 436e5c88bcfe4f46b795aa12ef336a34 to start an election
I20260709 13:06:07.888597 12236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60c3debbe734128867220558fddd6eb"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
 from {username='slave'} at 127.0.0.1:39430
I20260709 13:06:07.889169 12236 raft_consensus.cc:493] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.889482 12236 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.894292 12236 raft_consensus.cc:515] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.895916 12236 leader_election.cc:290] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 3 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:07.897118 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:07.897226 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c3debbe734128867220558fddd6eb" candidate_uuid: "436e5c88bcfe4f46b795aa12ef336a34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:07.897637 12384 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.897980 12310 raft_consensus.cc:3055] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.898308 12310 raft_consensus.cc:740] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:07.899127 12310 consensus_queue.cc:260] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.900462 12310 raft_consensus.cc:3060] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.903268 12384 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 3.
I20260709 13:06:07.904433 12201 leader_election.cc:304] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:07.905375 12555 raft_consensus.cc:2804] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:07.906817 12555 raft_consensus.cc:697] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 LEADER]: Becoming Leader. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:07.907596 12555 consensus_queue.cc:237] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:07.908177 12310 raft_consensus.cc:2468] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e5c88bcfe4f46b795aa12ef336a34 in term 3.
I20260709 13:06:07.915511 12132 catalog_manager.cc:5697] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 reported cstate change: term changed from 2 to 3, leader changed from 5f320ea492f746d088d0ee95b9881373 (127.11.78.2) to 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "436e5c88bcfe4f46b795aa12ef336a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.991660 12310 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:07.993280 12555 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.002169 12384 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:08.003965 12568 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.120283 12310 raft_consensus.cc:1275] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.121769 12568 consensus_queue.cc:1048] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:08.134647 12384 raft_consensus.cc:1275] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.136243 12566 consensus_queue.cc:1048] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.195878 12310 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:08.197311 12566 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.206542 12384 raft_consensus.cc:1275] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:08.208096 12555 consensus_queue.cc:1048] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.475950 12310 raft_consensus.cc:1275] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:08.477429 12555 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.487932 12384 raft_consensus.cc:1275] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Refusing update from remote peer 436e5c88bcfe4f46b795aa12ef336a34: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:08.489718 12555 consensus_queue.cc:1048] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.340083 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:10.349077 12236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:10.349689 12236 raft_consensus.cc:606] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Received request to transfer leadership to TS eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:10.352622 12236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:10.353138 12236 raft_consensus.cc:606] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Received request to transfer leadership to TS 5f320ea492f746d088d0ee95b9881373
I20260709 13:06:10.355728 12236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:10.356248 12236 raft_consensus.cc:606] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 LEADER]: Received request to transfer leadership to TS 5f320ea492f746d088d0ee95b9881373
I20260709 13:06:10.358819 12236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c"
dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
mode: GRACEFUL
new_leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:39446
I20260709 13:06:10.359315 12236 raft_consensus.cc:606] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Received request to transfer leadership to TS eb9389b2761f4c9f8dfacd470163d1d7
I20260709 13:06:10.360446 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:10.360957 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:10.483011 12538 raft_consensus.cc:993] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:10.483527 12576 raft_consensus.cc:1081] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Signalling peer eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:10.485618 12384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:32800
I20260709 13:06:10.486164 12384 raft_consensus.cc:493] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:10.486521 12384 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.491557 12384 raft_consensus.cc:515] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:10.493255 12384 leader_election.cc:290] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 5 election: Requested vote from peers 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935), 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909)
I20260709 13:06:10.494391 12310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:10.494628 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bde340c4b24422ba28405c87c38b47c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:10.495049 12310 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.495301 12236 raft_consensus.cc:3055] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:10.495692 12236 raft_consensus.cc:740] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:10.496508 12236 consensus_queue.cc:260] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:10.497637 12236 raft_consensus.cc:3060] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.499265 12538 raft_consensus.cc:993] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:10.500316 12538 raft_consensus.cc:1081] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 LEADER]: Signalling peer 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:10.502473 12311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:06:10.503125 12311 raft_consensus.cc:493] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:10.503499 12311 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.504688 12236 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 5.
I20260709 13:06:10.504855 12310 raft_consensus.cc:2468] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 5.
I20260709 13:06:10.506178 12350 leader_election.cc:304] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436e5c88bcfe4f46b795aa12ef336a34, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:10.507025 12575 raft_consensus.cc:2804] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:10.508539 12575 raft_consensus.cc:697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 5 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:10.509392 12575 consensus_queue.cc:237] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } }
I20260709 13:06:10.511212 12311 raft_consensus.cc:515] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.513386 12311 leader_election.cc:290] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:10.514981 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:10.515594 12384 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.515934 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d405fb4053de42b8b7d1bb114e6d7951" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:10.516687 12236 raft_consensus.cc:3055] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:10.517040 12236 raft_consensus.cc:740] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:10.517776 12236 consensus_queue.cc:260] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.519369 12236 raft_consensus.cc:3060] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.518720 12132 catalog_manager.cc:5697] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 4 to 5, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.522257 12384 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:10.523978 12276 leader_election.cc:304] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:10.525132 12532 raft_consensus.cc:2804] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:10.526374 12236 raft_consensus.cc:2468] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 2.
I20260709 13:06:10.529070 12532 raft_consensus.cc:697] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:10.530262 12532 consensus_queue.cc:237] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.539450 12132 catalog_manager.cc:5697] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 1 to 2, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.601503 12576 raft_consensus.cc:993] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:10.602150 12538 raft_consensus.cc:1081] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Signalling peer eb9389b2761f4c9f8dfacd470163d1d7 to start an election
I20260709 13:06:10.604113 12384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c"
dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
 from {username='slave'} at 127.0.0.1:32800
I20260709 13:06:10.604792 12384 raft_consensus.cc:493] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:10.605105 12384 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.610006 12384 raft_consensus.cc:515] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.611761 12384 leader_election.cc:290] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935)
I20260709 13:06:10.612797 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:10.613111 12311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f449824f869c43ea84a75ef539102a0c" candidate_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f320ea492f746d088d0ee95b9881373"
I20260709 13:06:10.613348 12236 raft_consensus.cc:3055] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.613701 12236 raft_consensus.cc:740] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:10.613757 12311 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.614583 12236 consensus_queue.cc:260] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.615650 12236 raft_consensus.cc:3060] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.620536 12311 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:10.620807 12236 raft_consensus.cc:2468] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9389b2761f4c9f8dfacd470163d1d7 in term 3.
I20260709 13:06:10.621907 12351 leader_election.cc:304] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:10.622745 12575 raft_consensus.cc:2804] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:10.623253 12575 raft_consensus.cc:697] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Becoming Leader. State: Replica: eb9389b2761f4c9f8dfacd470163d1d7, State: Running, Role: LEADER
I20260709 13:06:10.624123 12575 consensus_queue.cc:237] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.631090 12132 catalog_manager.cc:5697] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 reported cstate change: term changed from 2 to 3, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.664841 12576 raft_consensus.cc:993] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: : Instructing follower 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:10.665372 12576 raft_consensus.cc:1081] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Signalling peer 5f320ea492f746d088d0ee95b9881373 to start an election
I20260709 13:06:10.666996 12311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a"
dest_uuid: "5f320ea492f746d088d0ee95b9881373"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:06:10.667482 12311 raft_consensus.cc:493] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:10.667790 12311 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.672273 12311 raft_consensus.cc:515] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.673979 12311 leader_election.cc:290] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 3 election: Requested vote from peers 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909), eb9389b2761f4c9f8dfacd470163d1d7 (127.11.78.3:36455)
I20260709 13:06:10.674975 12236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "436e5c88bcfe4f46b795aa12ef336a34"
I20260709 13:06:10.675071 12384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf71f08ea584a4780bca91e02db419a" candidate_uuid: "5f320ea492f746d088d0ee95b9881373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb9389b2761f4c9f8dfacd470163d1d7"
I20260709 13:06:10.675652 12236 raft_consensus.cc:3055] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.675653 12384 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.676148 12236 raft_consensus.cc:740] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 436e5c88bcfe4f46b795aa12ef336a34, State: Running, Role: LEADER
I20260709 13:06:10.676833 12236 consensus_queue.cc:260] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.677739 12236 raft_consensus.cc:3060] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.680374 12384 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 3.
I20260709 13:06:10.681397 12276 leader_election.cc:304] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f320ea492f746d088d0ee95b9881373, eb9389b2761f4c9f8dfacd470163d1d7; no voters: 
I20260709 13:06:10.682109 12532 raft_consensus.cc:2804] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:10.682536 12532 raft_consensus.cc:697] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 3 LEADER]: Becoming Leader. State: Replica: 5f320ea492f746d088d0ee95b9881373, State: Running, Role: LEADER
I20260709 13:06:10.682746 12236 raft_consensus.cc:2468] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f320ea492f746d088d0ee95b9881373 in term 3.
I20260709 13:06:10.683331 12532 consensus_queue.cc:237] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } }
I20260709 13:06:10.691550 12132 catalog_manager.cc:5697] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 reported cstate change: term changed from 2 to 3, leader changed from 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1) to 5f320ea492f746d088d0ee95b9881373 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "5f320ea492f746d088d0ee95b9881373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.905664 12311 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 5 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:10.907152 12575 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:10.919615 12236 raft_consensus.cc:1275] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 5 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:10.921245 12575 consensus_queue.cc:1048] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:11.015478 12384 raft_consensus.cc:1275] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:11.017316 12532 consensus_queue.cc:1048] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.018226 12236 raft_consensus.cc:1275] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:11.019850 12532 consensus_queue.cc:1048] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.028931 12311 raft_consensus.cc:1275] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.032928 12575 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f320ea492f746d088d0ee95b9881373" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:11.066529 12235 raft_consensus.cc:1275] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.068347 12581 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.068684 12236 raft_consensus.cc:1275] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Refusing update from remote peer eb9389b2761f4c9f8dfacd470163d1d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.070322 12589 consensus_queue.cc:1048] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e5c88bcfe4f46b795aa12ef336a34" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.083658 12384 raft_consensus.cc:1275] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Refusing update from remote peer 5f320ea492f746d088d0ee95b9881373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.085327 12581 consensus_queue.cc:1048] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9389b2761f4c9f8dfacd470163d1d7" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.361800 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:11.368165 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:06:11.399592 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:11.400883 11576 tablet_replica.cc:333] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.401715 11576 raft_consensus.cc:2243] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.402357 11576 raft_consensus.cc:2272] T e6f98afa11ce4234827cdbfd225c5f94 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.404983 11576 tablet_replica.cc:333] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.405660 11576 raft_consensus.cc:2243] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.406190 11576 raft_consensus.cc:2272] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.408283 11576 tablet_replica.cc:333] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.408830 11576 raft_consensus.cc:2243] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.409276 11576 raft_consensus.cc:2272] T f449824f869c43ea84a75ef539102a0c P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.412339 11576 tablet_replica.cc:333] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.412966 11576 raft_consensus.cc:2243] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.413842 11576 raft_consensus.cc:2272] T e60c3debbe734128867220558fddd6eb P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.415558 11576 tablet_replica.cc:333] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.416195 11576 raft_consensus.cc:2243] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.416998 11576 raft_consensus.cc:2272] T e6a8cded4125441b8829cdecbada6c99 P 436e5c88bcfe4f46b795aa12ef336a34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.419525 11576 tablet_replica.cc:333] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.420377 11576 raft_consensus.cc:2243] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.421530 11576 raft_consensus.cc:2272] T f50eee84d3c847da94637683aed78352 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.424196 11576 tablet_replica.cc:333] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.424933 11576 raft_consensus.cc:2243] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.425854 11576 raft_consensus.cc:2272] T 851dd7df72fa421c9e3c01571cf2b71c P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.427817 11576 tablet_replica.cc:333] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.428398 11576 raft_consensus.cc:2243] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.428859 11576 raft_consensus.cc:2272] T d405fb4053de42b8b7d1bb114e6d7951 P 436e5c88bcfe4f46b795aa12ef336a34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.431232 11576 tablet_replica.cc:333] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.432098 11576 raft_consensus.cc:2243] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.432740 11576 raft_consensus.cc:2272] T 1bde340c4b24422ba28405c87c38b47c P 436e5c88bcfe4f46b795aa12ef336a34 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.435734 11576 tablet_replica.cc:333] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34: stopping tablet replica
I20260709 13:06:11.436370 11576 raft_consensus.cc:2243] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.436872 11576 raft_consensus.cc:2272] T 1bf71f08ea584a4780bca91e02db419a P 436e5c88bcfe4f46b795aa12ef336a34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.471982 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
I20260709 13:06:11.496423 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:06:11.516747 12276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 13:06:11.532440 12350 consensus_peers.cc:597] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 -> Peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Couldn't send request to peer 436e5c88bcfe4f46b795aa12ef336a34. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:11.536404 12276 consensus_peers.cc:597] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 -> Peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Couldn't send request to peer 436e5c88bcfe4f46b795aa12ef336a34. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:11.548092 12276 consensus_peers.cc:597] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 -> Peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Couldn't send request to peer 436e5c88bcfe4f46b795aa12ef336a34. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:11.551744 12350 consensus_peers.cc:597] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 -> Peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Couldn't send request to peer 436e5c88bcfe4f46b795aa12ef336a34. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:11.552263 12350 consensus_peers.cc:597] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 -> Peer 436e5c88bcfe4f46b795aa12ef336a34 (127.11.78.1:38909): Couldn't send request to peer 436e5c88bcfe4f46b795aa12ef336a34. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.555948 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:11.556924 11576 tablet_replica.cc:333] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.557889 11576 raft_consensus.cc:2243] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.558602 11576 raft_consensus.cc:2272] T e6f98afa11ce4234827cdbfd225c5f94 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.561270 11576 tablet_replica.cc:333] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.561810 11576 raft_consensus.cc:2243] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.562738 11576 raft_consensus.cc:2272] T 1bf71f08ea584a4780bca91e02db419a P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.565727 11576 tablet_replica.cc:333] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.566313 11576 raft_consensus.cc:2243] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.566756 11576 raft_consensus.cc:2272] T 851dd7df72fa421c9e3c01571cf2b71c P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.568859 11576 tablet_replica.cc:333] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.569406 11576 raft_consensus.cc:2243] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.570165 11576 raft_consensus.cc:2272] T d405fb4053de42b8b7d1bb114e6d7951 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.572788 11576 tablet_replica.cc:333] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.573388 11576 raft_consensus.cc:2243] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.573923 11576 raft_consensus.cc:2272] T f50eee84d3c847da94637683aed78352 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.576196 11576 tablet_replica.cc:333] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.576749 11576 raft_consensus.cc:2243] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.577226 11576 raft_consensus.cc:2272] T e6a8cded4125441b8829cdecbada6c99 P 5f320ea492f746d088d0ee95b9881373 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.578944 11576 tablet_replica.cc:333] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.579489 11576 raft_consensus.cc:2243] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.580443 11576 raft_consensus.cc:2272] T 1b45895a0c6f4551aad4a379ba3c7ec4 P 5f320ea492f746d088d0ee95b9881373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.583340 11576 tablet_replica.cc:333] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.583945 11576 raft_consensus.cc:2243] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.584484 11576 raft_consensus.cc:2272] T e60c3debbe734128867220558fddd6eb P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.586305 11576 tablet_replica.cc:333] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.586886 11576 raft_consensus.cc:2243] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.587422 11576 raft_consensus.cc:2272] T f449824f869c43ea84a75ef539102a0c P 5f320ea492f746d088d0ee95b9881373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.589918 11576 tablet_replica.cc:333] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373: stopping tablet replica
I20260709 13:06:11.590515 11576 raft_consensus.cc:2243] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.591034 11576 raft_consensus.cc:2272] T 1bde340c4b24422ba28405c87c38b47c P 5f320ea492f746d088d0ee95b9881373 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:11.603058 12351 consensus_peers.cc:597] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 -> Peer 5f320ea492f746d088d0ee95b9881373 (127.11.78.2:45935): Couldn't send request to peer 5f320ea492f746d088d0ee95b9881373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.625101 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
I20260709 13:06:11.646023 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
I20260709 13:06:11.676637 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:11.677313 11576 tablet_replica.cc:333] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.677911 11576 raft_consensus.cc:2243] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.678709 11576 raft_consensus.cc:2272] T e6f98afa11ce4234827cdbfd225c5f94 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.680691 11576 tablet_replica.cc:333] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.681203 11576 raft_consensus.cc:2243] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.681665 11576 raft_consensus.cc:2272] T 1bf71f08ea584a4780bca91e02db419a P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.684229 11576 tablet_replica.cc:333] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.684757 11576 raft_consensus.cc:2243] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.685472 11576 raft_consensus.cc:2272] T 1bde340c4b24422ba28405c87c38b47c P eb9389b2761f4c9f8dfacd470163d1d7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.687877 11576 tablet_replica.cc:333] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.688450 11576 raft_consensus.cc:2243] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.688879 11576 raft_consensus.cc:2272] T 1b45895a0c6f4551aad4a379ba3c7ec4 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.690677 11576 tablet_replica.cc:333] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.691188 11576 raft_consensus.cc:2243] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.691618 11576 raft_consensus.cc:2272] T e60c3debbe734128867220558fddd6eb P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.693238 11576 tablet_replica.cc:333] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.693722 11576 raft_consensus.cc:2243] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.694448 11576 raft_consensus.cc:2272] T f449824f869c43ea84a75ef539102a0c P eb9389b2761f4c9f8dfacd470163d1d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.696676 11576 tablet_replica.cc:333] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.697180 11576 raft_consensus.cc:2243] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.697623 11576 raft_consensus.cc:2272] T 851dd7df72fa421c9e3c01571cf2b71c P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.699386 11576 tablet_replica.cc:333] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.699961 11576 raft_consensus.cc:2243] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.700464 11576 raft_consensus.cc:2272] T d405fb4053de42b8b7d1bb114e6d7951 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.703276 11576 tablet_replica.cc:333] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.703913 11576 raft_consensus.cc:2243] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.704413 11576 raft_consensus.cc:2272] T f50eee84d3c847da94637683aed78352 P eb9389b2761f4c9f8dfacd470163d1d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.706782 11576 tablet_replica.cc:333] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7: stopping tablet replica
I20260709 13:06:11.707305 11576 raft_consensus.cc:2243] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.707800 11576 raft_consensus.cc:2272] T e6a8cded4125441b8829cdecbada6c99 P eb9389b2761f4c9f8dfacd470163d1d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.728120 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:06:11.747258 11576 master.cc:562] Master@127.11.78.62:46569 shutting down...
I20260709 13:06:11.778821 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.779572 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.779986 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0eed440e7ce64726874147a9633a9db5: stopping tablet replica
I20260709 13:06:11.803102 11576 master.cc:584] Master@127.11.78.62:46569 shutdown complete.
436e5c88bcfe4f46b795aa12ef336a34  5
5f320ea492f746d088d0ee95b9881373  4
eb9389b2761f4c9f8dfacd470163d1d7  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11121 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:11.852522 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:43083
I20260709 13:06:11.853806 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:11.861195 12607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:11.861373 12609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:11.861243 12606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:11.862900 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:11.863878 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:11.864187 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:11.864380 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602371864355 us; error 0 us; skew 500 ppm
I20260709 13:06:11.865032 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:11.867848 11576 webserver.cc:533] Webserver started at http://127.11.78.62:38695/ using document root <none> and password file <none>
I20260709 13:06:11.868470 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:11.868695 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:11.869001 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:11.870337 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "d95a6396e3d84f5fb98713ce86e01813"
format_stamp: "Formatted at 2026-07-09 13:06:11 on dist-test-slave-smzk"
I20260709 13:06:11.875943 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:11.879951 12614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:11.881058 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:11.881428 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "d95a6396e3d84f5fb98713ce86e01813"
format_stamp: "Formatted at 2026-07-09 13:06:11 on dist-test-slave-smzk"
I20260709 13:06:11.881743 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:11.908272 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:11.909735 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:11.956867 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:43083
I20260709 13:06:11.957068 12665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:43083 every 8 connection(s)
I20260709 13:06:11.961619 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:11.974306 12666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Bootstrap starting.
I20260709 13:06:11.979822 12666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.985275 12666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: No bootstrap required, opened a new log
I20260709 13:06:11.987803 12666 raft_consensus.cc:359] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER }
I20260709 13:06:11.988287 12666 raft_consensus.cc:385] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.988484 12666 raft_consensus.cc:740] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d95a6396e3d84f5fb98713ce86e01813, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.989117 12666 consensus_queue.cc:260] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER }
I20260709 13:06:11.989611 12666 raft_consensus.cc:399] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:11.989830 12666 raft_consensus.cc:493] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:11.990048 12666 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.994992 12666 raft_consensus.cc:515] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER }
I20260709 13:06:11.995586 12666 leader_election.cc:304] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d95a6396e3d84f5fb98713ce86e01813; no voters: 
I20260709 13:06:11.996961 12666 leader_election.cc:290] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:11.997563 12669 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.999162 12669 raft_consensus.cc:697] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 1 LEADER]: Becoming Leader. State: Replica: d95a6396e3d84f5fb98713ce86e01813, State: Running, Role: LEADER
I20260709 13:06:11.999970 12669 consensus_queue.cc:237] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER }
I20260709 13:06:12.000607 12666 sys_catalog.cc:565] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:12.005275 12670 sys_catalog.cc:455] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d95a6396e3d84f5fb98713ce86e01813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER } }
I20260709 13:06:12.006155 12671 sys_catalog.cc:455] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d95a6396e3d84f5fb98713ce86e01813. Latest consensus state: current_term: 1 leader_uuid: "d95a6396e3d84f5fb98713ce86e01813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a6396e3d84f5fb98713ce86e01813" member_type: VOTER } }
I20260709 13:06:12.006569 12670 sys_catalog.cc:458] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:12.008409 12671 sys_catalog.cc:458] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:12.010466 12676 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:12.019271 12676 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:12.020562 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:12.029631 12676 catalog_manager.cc:1383] Generated new cluster ID: 0e7e601f85494f09bec4f9f39d14b991
I20260709 13:06:12.030040 12676 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:12.055177 12676 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:12.056671 12676 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:12.069379 12676 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Generated new TSK 0
I20260709 13:06:12.070132 12676 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:12.087546 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:12.094648 12687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.095945 12688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.098251 12690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:12.098470 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:12.099530 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:12.099751 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:12.099979 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602372099960 us; error 0 us; skew 500 ppm
I20260709 13:06:12.100690 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:12.103612 11576 webserver.cc:533] Webserver started at http://127.11.78.1:35009/ using document root <none> and password file <none>
I20260709 13:06:12.104238 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:12.104491 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:12.104818 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:12.106045 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.111411 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:06:12.115346 12695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.116364 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:12.116725 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.117008 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:12.136674 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:12.138187 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:12.139938 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:12.142534 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:12.142761 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.143036 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:12.143232 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.191717 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:36161
I20260709 13:06:12.191884 12757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:36161 every 8 connection(s)
I20260709 13:06:12.197372 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:12.205361 12762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.207317 12763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.209908 12765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:12.210732 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:12.212260 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:12.212527 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:12.212740 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602372212719 us; error 0 us; skew 500 ppm
I20260709 13:06:12.213335 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:12.215548 12758 heartbeater.cc:344] Connected to a master server at 127.11.78.62:43083
I20260709 13:06:12.216023 12758 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:12.216672 11576 webserver.cc:533] Webserver started at http://127.11.78.2:37351/ using document root <none> and password file <none>
I20260709 13:06:12.217110 12758 heartbeater.cc:507] Master 127.11.78.62:43083 requested a full tablet report, sending...
I20260709 13:06:12.217260 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:12.217641 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:12.217937 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:12.219679 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "83d2731c4bc049b3929d6c39670f5fd8"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.219934 12631 ts_manager.cc:194] Registered new tserver with Master: 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:12.222643 12631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45886
I20260709 13:06:12.226748 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:12.231012 12770 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.231998 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:12.232489 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "83d2731c4bc049b3929d6c39670f5fd8"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.232817 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:12.249024 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:12.250564 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:12.252444 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:12.255052 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:12.255326 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.255594 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:12.255769 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.305500 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:36791
I20260709 13:06:12.305619 12832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:36791 every 8 connection(s)
I20260709 13:06:12.311345 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:12.320190 12836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.323443 12837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:12.330916 12833 heartbeater.cc:344] Connected to a master server at 127.11.78.62:43083
W20260709 13:06:12.331298 12839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:12.331382 12833 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:12.331991 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:12.333207 12833 heartbeater.cc:507] Master 127.11.78.62:43083 requested a full tablet report, sending...
I20260709 13:06:12.333510 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:12.333775 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:12.334041 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602372334020 us; error 0 us; skew 500 ppm
I20260709 13:06:12.334880 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:12.336063 12631 ts_manager.cc:194] Registered new tserver with Master: 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:12.337960 12631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45902
I20260709 13:06:12.346662 11576 webserver.cc:533] Webserver started at http://127.11.78.3:37741/ using document root <none> and password file <none>
I20260709 13:06:12.347550 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:12.347836 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:12.348249 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:12.349812 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "c45825bb09c34201b13ddcec07c4b3f1"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.355013 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:06:12.359210 12844 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.360370 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:12.360728 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "c45825bb09c34201b13ddcec07c4b3f1"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-smzk"
I20260709 13:06:12.361052 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:12.378075 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:12.379463 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:12.381131 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:12.383695 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:12.383924 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.384203 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:12.384377 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.432802 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:36899
I20260709 13:06:12.432948 12906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:36899 every 8 connection(s)
I20260709 13:06:12.451442 12907 heartbeater.cc:344] Connected to a master server at 127.11.78.62:43083
I20260709 13:06:12.451881 12907 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:12.452795 12907 heartbeater.cc:507] Master 127.11.78.62:43083 requested a full tablet report, sending...
I20260709 13:06:12.455209 12631 ts_manager.cc:194] Registered new tserver with Master: c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:12.455819 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019442517s
I20260709 13:06:12.457242 12631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45904
I20260709 13:06:12.488601 12631 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45906:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:12.495431 12631 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:12.698854 12872 tablet_service.cc:1511] Processing CreateTablet for tablet ea332acd0f07405e95b83103a4876e08 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:12.699503 12871 tablet_service.cc:1511] Processing CreateTablet for tablet cd420c179d854f04989e23d8e19b0505 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:12.700500 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea332acd0f07405e95b83103a4876e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.701139 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd420c179d854f04989e23d8e19b0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.704751 12870 tablet_service.cc:1511] Processing CreateTablet for tablet e76bdc6d77354bafb6cab7951596cb2a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:12.706274 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76bdc6d77354bafb6cab7951596cb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.718570 12869 tablet_service.cc:1511] Processing CreateTablet for tablet 96245329d8054ce88bb8c218f5069ede (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:12.720772 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96245329d8054ce88bb8c218f5069ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.726606 12719 tablet_service.cc:1511] Processing CreateTablet for tablet d4c62986a26c4716a060e64c82e8f5a7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:12.728233 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c62986a26c4716a060e64c82e8f5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.727965 12797 tablet_service.cc:1511] Processing CreateTablet for tablet cd420c179d854f04989e23d8e19b0505 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:12.729698 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd420c179d854f04989e23d8e19b0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.732811 12796 tablet_service.cc:1511] Processing CreateTablet for tablet e76bdc6d77354bafb6cab7951596cb2a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:12.734349 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76bdc6d77354bafb6cab7951596cb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.737309 12795 tablet_service.cc:1511] Processing CreateTablet for tablet 96245329d8054ce88bb8c218f5069ede (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:12.738792 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96245329d8054ce88bb8c218f5069ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.741202 12794 tablet_service.cc:1511] Processing CreateTablet for tablet d4c62986a26c4716a060e64c82e8f5a7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:12.742686 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c62986a26c4716a060e64c82e8f5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.745311 12723 tablet_service.cc:1511] Processing CreateTablet for tablet ea332acd0f07405e95b83103a4876e08 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:12.746809 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea332acd0f07405e95b83103a4876e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.749454 12722 tablet_service.cc:1511] Processing CreateTablet for tablet cd420c179d854f04989e23d8e19b0505 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:12.750589 12923 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:12.752077 12721 tablet_service.cc:1511] Processing CreateTablet for tablet e76bdc6d77354bafb6cab7951596cb2a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:12.752838 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 96245329d8054ce88bb8c218f5069ede (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:12.754393 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd420c179d854f04989e23d8e19b0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.726634 12798 tablet_service.cc:1511] Processing CreateTablet for tablet ea332acd0f07405e95b83103a4876e08 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:12.760301 12923 tablet_bootstrap.cc:654] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.761502 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96245329d8054ce88bb8c218f5069ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.766350 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea332acd0f07405e95b83103a4876e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.749439 12922 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:12.776270 12721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76bdc6d77354bafb6cab7951596cb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.786849 12719 tablet_service.cc:1511] Processing CreateTablet for tablet b6e93451194c4f75b90838546e466fe0 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:12.788291 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e93451194c4f75b90838546e466fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.788545 12870 tablet_service.cc:1511] Processing CreateTablet for tablet d4c62986a26c4716a060e64c82e8f5a7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:12.789753 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c62986a26c4716a060e64c82e8f5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.800849 12793 tablet_service.cc:1511] Processing CreateTablet for tablet b6e93451194c4f75b90838546e466fe0 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:12.801600 12871 tablet_service.cc:1511] Processing CreateTablet for tablet b6e93451194c4f75b90838546e466fe0 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:12.802915 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e93451194c4f75b90838546e466fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.803530 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e93451194c4f75b90838546e466fe0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:12.864398 12617 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53930.7us
I20260709 13:06:12.869472 12792 tablet_service.cc:1511] Processing CreateTablet for tablet dff29d178e6c42cd8abcbd3d7747b77a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:12.871022 12792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff29d178e6c42cd8abcbd3d7747b77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.873212 12722 tablet_service.cc:1511] Processing CreateTablet for tablet dff29d178e6c42cd8abcbd3d7747b77a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:12.874601 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff29d178e6c42cd8abcbd3d7747b77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.881527 12923 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:12.882120 12923 ts_tablet_manager.cc:1403] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.025s
I20260709 13:06:12.886646 12872 tablet_service.cc:1511] Processing CreateTablet for tablet dff29d178e6c42cd8abcbd3d7747b77a (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:12.888021 12721 tablet_service.cc:1511] Processing CreateTablet for tablet eb5990f0ee644c48952ecb885d6a405b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:12.888075 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff29d178e6c42cd8abcbd3d7747b77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.889236 12795 tablet_service.cc:1511] Processing CreateTablet for tablet eb5990f0ee644c48952ecb885d6a405b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:12.889497 12923 raft_consensus.cc:359] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:12.890317 12923 raft_consensus.cc:385] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.890516 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5990f0ee644c48952ecb885d6a405b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.890654 12923 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.891613 12923 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:12.894718 12922 tablet_bootstrap.cc:654] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.906683 12758 heartbeater.cc:499] Master 127.11.78.62:43083 was elected leader, sending a full tablet report...
I20260709 13:06:12.908897 12723 tablet_service.cc:1511] Processing CreateTablet for tablet f21936f5afa14460a22306512f82c201 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:12.911302 12923 ts_tablet_manager.cc:1434] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.007s
I20260709 13:06:12.911983 12869 tablet_service.cc:1511] Processing CreateTablet for tablet eb5990f0ee644c48952ecb885d6a405b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:12.912523 12923 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:12.913426 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5990f0ee644c48952ecb885d6a405b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.915325 12797 tablet_service.cc:1511] Processing CreateTablet for tablet f21936f5afa14460a22306512f82c201 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:12.918187 12868 tablet_service.cc:1511] Processing CreateTablet for tablet f21936f5afa14460a22306512f82c201 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:12.904270 12721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5990f0ee644c48952ecb885d6a405b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.925968 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21936f5afa14460a22306512f82c201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.928570 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21936f5afa14460a22306512f82c201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.930583 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21936f5afa14460a22306512f82c201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.945540 12923 tablet_bootstrap.cc:654] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.960273 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 844a3ff085274442b304f06473e07511 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:12.962321 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844a3ff085274442b304f06473e07511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.964264 12872 tablet_service.cc:1511] Processing CreateTablet for tablet 844a3ff085274442b304f06473e07511 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:12.964411 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 2b86cb4a548944109bfb911e2b3a2591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:12.965719 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844a3ff085274442b304f06473e07511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.966111 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b86cb4a548944109bfb911e2b3a2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.966579 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 2b86cb4a548944109bfb911e2b3a2591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:12.964264 12795 tablet_service.cc:1511] Processing CreateTablet for tablet 844a3ff085274442b304f06473e07511 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:12.967955 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b86cb4a548944109bfb911e2b3a2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.968854 12925 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:12.969010 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844a3ff085274442b304f06473e07511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.985914 12922 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:12.986559 12922 ts_tablet_manager.cc:1403] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.238s	user 0.020s	sys 0.010s
I20260709 13:06:12.987317 12870 tablet_service.cc:1511] Processing CreateTablet for tablet 2b86cb4a548944109bfb911e2b3a2591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:12.988778 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b86cb4a548944109bfb911e2b3a2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.991250 12923 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:12.991838 12923 ts_tablet_manager.cc:1403] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.003s
I20260709 13:06:12.994253 12925 tablet_bootstrap.cc:654] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.011946 12926 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.012656 12926 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:13.015174 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:13.026932 12926 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:13.029341 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 2226e1c2db5f441197fe25690778db23 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:13.030978 12925 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:13.031291 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2226e1c2db5f441197fe25690778db23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.031534 12925 ts_tablet_manager.cc:1403] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.000s
I20260709 13:06:13.033141 12922 raft_consensus.cc:359] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.034152 12922 raft_consensus.cc:385] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.034494 12922 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.034824 12925 raft_consensus.cc:359] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.035651 12925 raft_consensus.cc:385] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.036767 12923 raft_consensus.cc:359] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.037761 12923 raft_consensus.cc:385] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.038127 12923 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.035944 12925 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.039311 12925 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.041960 12922 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.046900 12923 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.050863 12923 ts_tablet_manager.cc:1434] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.003s
I20260709 13:06:13.089167 12923 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:13.061324 12792 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64952f9027442eb482fbc10cf426fe (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:13.093603 12792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64952f9027442eb482fbc10cf426fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.094736 12794 tablet_service.cc:1511] Processing CreateTablet for tablet cc137392724a42a1a95e4a0543808c28 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:13.066684 12869 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64952f9027442eb482fbc10cf426fe (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:13.075809 12793 tablet_service.cc:1511] Processing CreateTablet for tablet c36078b972bc46fe827c12e1015e239d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:13.096388 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc137392724a42a1a95e4a0543808c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.081887 12868 tablet_service.cc:1511] Processing CreateTablet for tablet c36078b972bc46fe827c12e1015e239d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:13.057718 12872 tablet_service.cc:1511] Processing CreateTablet for tablet 2226e1c2db5f441197fe25690778db23 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:13.089716 12922 ts_tablet_manager.cc:1434] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.103s	user 0.020s	sys 0.035s
I20260709 13:06:13.098215 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36078b972bc46fe827c12e1015e239d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.098783 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64952f9027442eb482fbc10cf426fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.100345 12907 heartbeater.cc:499] Master 127.11.78.62:43083 was elected leader, sending a full tablet report...
I20260709 13:06:13.096397 12871 tablet_service.cc:1511] Processing CreateTablet for tablet cc137392724a42a1a95e4a0543808c28 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:13.123386 12796 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5e3e97cfa425f9fb7a66612ed959b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:13.125499 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5e3e97cfa425f9fb7a66612ed959b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.129403 12925 ts_tablet_manager.cc:1434] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.097s	user 0.033s	sys 0.035s
I20260709 13:06:13.133791 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 2226e1c2db5f441197fe25690778db23 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:13.136214 12723 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64952f9027442eb482fbc10cf426fe (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:13.137912 12721 tablet_service.cc:1511] Processing CreateTablet for tablet c36078b972bc46fe827c12e1015e239d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:13.111353 12933 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.139168 12933 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.112793 12922 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:13.139611 12719 tablet_service.cc:1511] Processing CreateTablet for tablet cc137392724a42a1a95e4a0543808c28 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:13.146325 12833 heartbeater.cc:499] Master 127.11.78.62:43083 was elected leader, sending a full tablet report...
I20260709 13:06:13.150477 12870 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5e3e97cfa425f9fb7a66612ed959b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:13.151424 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:13.152985 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc137392724a42a1a95e4a0543808c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.153657 12721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36078b972bc46fe827c12e1015e239d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.157217 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64952f9027442eb482fbc10cf426fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.162890 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 4a839b697aea46da87cb69b00515389e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:13.164559 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2226e1c2db5f441197fe25690778db23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.141170 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2226e1c2db5f441197fe25690778db23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.170189 12925 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:13.170558 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9ae3e4f0c340f180826fd03f63f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.170965 12791 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:13.173733 12791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9ae3e4f0c340f180826fd03f63f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.174561 12923 tablet_bootstrap.cc:654] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.177299 12718 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:13.179147 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9ae3e4f0c340f180826fd03f63f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.179067 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 4a839b697aea46da87cb69b00515389e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:13.194512 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc137392724a42a1a95e4a0543808c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.195477 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5e3e97cfa425f9fb7a66612ed959b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:13.202883 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5e3e97cfa425f9fb7a66612ed959b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.203310 12716 tablet_service.cc:1511] Processing CreateTablet for tablet b16b34b3b4a04edca05d5f0f4a3ce868 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:13.203680 12715 tablet_service.cc:1511] Processing CreateTablet for tablet b0e30b9fd61a41b294bf248bd704492b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:13.205549 12716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16b34b3b4a04edca05d5f0f4a3ce868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.217833 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36078b972bc46fe827c12e1015e239d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.218734 12933 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:13.219483 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e30b9fd61a41b294bf248bd704492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.229151 12865 tablet_service.cc:1511] Processing CreateTablet for tablet b16b34b3b4a04edca05d5f0f4a3ce868 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:13.231355 12795 tablet_service.cc:1511] Processing CreateTablet for tablet 4a839b697aea46da87cb69b00515389e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:13.232712 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a839b697aea46da87cb69b00515389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.233515 12790 tablet_service.cc:1511] Processing CreateTablet for tablet b16b34b3b4a04edca05d5f0f4a3ce868 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:13.239212 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16b34b3b4a04edca05d5f0f4a3ce868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.242753 12864 tablet_service.cc:1511] Processing CreateTablet for tablet b0e30b9fd61a41b294bf248bd704492b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:13.252508 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a839b697aea46da87cb69b00515389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.256454 12714 tablet_service.cc:1511] Processing CreateTablet for tablet d985ce4f59254503949afda97665ffd4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:13.260397 12798 tablet_service.cc:1511] Processing CreateTablet for tablet d985ce4f59254503949afda97665ffd4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:13.239845 12789 tablet_service.cc:1511] Processing CreateTablet for tablet b0e30b9fd61a41b294bf248bd704492b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:13.276145 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d985ce4f59254503949afda97665ffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.280267 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a839b697aea46da87cb69b00515389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.280552 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d985ce4f59254503949afda97665ffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.284685 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e30b9fd61a41b294bf248bd704492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.288882 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5e3e97cfa425f9fb7a66612ed959b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.307822 12863 tablet_service.cc:1511] Processing CreateTablet for tablet d985ce4f59254503949afda97665ffd4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:13.310014 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d985ce4f59254503949afda97665ffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.314437 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e30b9fd61a41b294bf248bd704492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.314990 12925 tablet_bootstrap.cc:654] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.328653 12865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16b34b3b4a04edca05d5f0f4a3ce868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.336910 12794 tablet_service.cc:1511] Processing CreateTablet for tablet a18b1e83629843e7991a12a0e6370ca7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:13.348767 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b1e83629843e7991a12a0e6370ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.362104 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:13.364530 12699 leader_election.cc:343] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.399905 12932 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.400516 12932 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.406509 12932 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:13.442768 12796 tablet_service.cc:1511] Processing CreateTablet for tablet 682296e424dc4d959d7dbe0c329fc149 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:13.445334 12797 tablet_service.cc:1511] Processing CreateTablet for tablet e81eeec454b94074a55f46a651353f9e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:13.445528 12793 tablet_service.cc:1511] Processing CreateTablet for tablet e6a3cae9c8f5497a965082c096899998 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:13.455197 12923 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:13.447139 12868 tablet_service.cc:1511] Processing CreateTablet for tablet 682296e424dc4d959d7dbe0c329fc149 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:13.449312 12863 tablet_service.cc:1511] Processing CreateTablet for tablet e81eeec454b94074a55f46a651353f9e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:13.456815 12869 tablet_service.cc:1511] Processing CreateTablet for tablet a18b1e83629843e7991a12a0e6370ca7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:13.457823 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81eeec454b94074a55f46a651353f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.450918 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682296e424dc4d959d7dbe0c329fc149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.455859 12923 ts_tablet_manager.cc:1403] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.367s	user 0.010s	sys 0.018s
I20260709 13:06:13.466974 12718 tablet_service.cc:1511] Processing CreateTablet for tablet e81eeec454b94074a55f46a651353f9e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:13.474136 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81eeec454b94074a55f46a651353f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.476227 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b1e83629843e7991a12a0e6370ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.483774 12926 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.484488 12926 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.486836 12926 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:13.487151 12717 tablet_service.cc:1511] Processing CreateTablet for tablet a18b1e83629843e7991a12a0e6370ca7 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:13.488993 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b1e83629843e7991a12a0e6370ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.495354 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:13.483848 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81eeec454b94074a55f46a651353f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.501585 12922 tablet_bootstrap.cc:654] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.512458 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3cae9c8f5497a965082c096899998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.532212 12866 tablet_service.cc:1511] Processing CreateTablet for tablet e6a3cae9c8f5497a965082c096899998 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:13.545872 12925 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:13.546450 12925 ts_tablet_manager.cc:1403] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.377s	user 0.009s	sys 0.023s
I20260709 13:06:13.549117 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:13.550846 12925 raft_consensus.cc:359] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:13.551131 12848 leader_election.cc:343] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.551676 12925 raft_consensus.cc:385] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.552219 12923 raft_consensus.cc:359] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:13.553216 12923 raft_consensus.cc:385] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.553551 12923 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.554708 12923 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:13.557325 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:13.558854 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:13.561024 12847 leader_election.cc:343] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.561542 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:13.563047 12933 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:13.582185 12771 leader_election.cc:343] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.564417 12925 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.579619 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682296e424dc4d959d7dbe0c329fc149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.583551 12925 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.592437 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:13.593205 12808 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:13.593616 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3cae9c8f5497a965082c096899998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.596836 12923 ts_tablet_manager.cc:1434] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.000s
I20260709 13:06:13.597879 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:13.598898 12926 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.598537 12790 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc6ee27c224540914eb4905a44b4f1 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:13.599346 12926 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.599761 12926 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.600157 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc6ee27c224540914eb4905a44b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.601677 12864 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc6ee27c224540914eb4905a44b4f1 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:13.603688 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc6ee27c224540914eb4905a44b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.616385 12714 tablet_service.cc:1511] Processing CreateTablet for tablet e6a3cae9c8f5497a965082c096899998 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:13.618667 12925 ts_tablet_manager.cc:1434] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 13:06:13.619992 12925 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:13.630312 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:13.621450 12718 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc6ee27c224540914eb4905a44b4f1 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:13.636544 12925 tablet_bootstrap.cc:654] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.638042 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc6ee27c224540914eb4905a44b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.643580 12923 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:13.647518 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 682296e424dc4d959d7dbe0c329fc149 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:13.651337 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3cae9c8f5497a965082c096899998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.657301 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682296e424dc4d959d7dbe0c329fc149. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:13.658694 12696 leader_election.cc:343] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.659188 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:13.678042 12946 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.679718 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 390c91265699487c943fe0217424eb34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:13.681257 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c91265699487c943fe0217424eb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.682744 12870 tablet_service.cc:1511] Processing CreateTablet for tablet 390c91265699487c943fe0217424eb34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:13.684193 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c91265699487c943fe0217424eb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.685075 12922 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:13.685681 12922 ts_tablet_manager.cc:1403] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.573s	user 0.030s	sys 0.023s
I20260709 13:06:13.688931 12922 raft_consensus.cc:359] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.689713 12922 raft_consensus.cc:385] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.690032 12922 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.690951 12922 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.692312 12926 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.694718 12922 ts_tablet_manager.cc:1434] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:06:13.695156 12926 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:13.695353 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:13.695820 12922 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:13.696128 12808 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.704717 12808 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:13.705986 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:13.706869 12926 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.707954 12926 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:13.708777 12926 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.713017 12922 tablet_bootstrap.cc:654] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.714569 12925 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:13.715117 12925 ts_tablet_manager.cc:1403] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.020s
I20260709 13:06:13.718295 12925 raft_consensus.cc:359] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.719192 12925 raft_consensus.cc:385] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.718891 12793 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6c334df7c492f88316fe7c569e7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:13.719523 12925 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.720474 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6c334df7c492f88316fe7c569e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.720379 12925 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.722656 12925 ts_tablet_manager.cc:1434] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:13.723999 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6c334df7c492f88316fe7c569e7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:06:13.724411 12696 leader_election.cc:343] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.727982 12925 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:13.734579 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:13.735342 12882 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.738529 12922 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:13.739080 12922 ts_tablet_manager.cc:1403] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 13:06:13.740854 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6c334df7c492f88316fe7c569e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.745117 12882 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:13.750468 12922 raft_consensus.cc:359] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.750339 12798 tablet_service.cc:1511] Processing CreateTablet for tablet f7402969d1144da9a4a218d0c90ba138 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:13.751415 12922 raft_consensus.cc:385] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.754925 12925 tablet_bootstrap.cc:654] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.755918 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7402969d1144da9a4a218d0c90ba138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.751875 12922 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.757119 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:13.764799 12716 tablet_service.cc:1511] Processing CreateTablet for tablet f7402969d1144da9a4a218d0c90ba138 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:13.761615 12866 tablet_service.cc:1511] Processing CreateTablet for tablet f7402969d1144da9a4a218d0c90ba138 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:13.765146 12922 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.759301 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 390c91265699487c943fe0217424eb34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:13.766495 12716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7402969d1144da9a4a218d0c90ba138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.767206 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c91265699487c943fe0217424eb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.761983 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6c334df7c492f88316fe7c569e7e4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:13.767350 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7402969d1144da9a4a218d0c90ba138. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:13.776854 12773 leader_election.cc:343] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.768872 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6c334df7c492f88316fe7c569e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.780457 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:13.781492 12932 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.782634 12923 tablet_bootstrap.cc:654] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.789423 12869 tablet_service.cc:1511] Processing CreateTablet for tablet 562422a4dc1a44a7bca3a549839874be (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:13.791066 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562422a4dc1a44a7bca3a549839874be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.775033 12922 ts_tablet_manager.cc:1434] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 13:06:13.796291 12922 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:13.812202 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 562422a4dc1a44a7bca3a549839874be (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:13.813628 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562422a4dc1a44a7bca3a549839874be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.815327 12922 tablet_bootstrap.cc:654] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.827278 12923 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:13.827962 12923 ts_tablet_manager.cc:1403] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.000s
I20260709 13:06:13.829963 12870 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6c7d6191794b6790622bf51bb289ee (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:13.830343 12796 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6c7d6191794b6790622bf51bb289ee (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:13.831466 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6c7d6191794b6790622bf51bb289ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.831511 12933 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.831717 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6c7d6191794b6790622bf51bb289ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.832734 12933 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.835683 12933 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:13.836385 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:13.837419 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:13.837996 12848 leader_election.cc:343] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:13.838972 12847 leader_election.cc:343] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.839457 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:13.840683 12933 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.845301 12723 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6c7d6191794b6790622bf51bb289ee (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:13.846611 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6c7d6191794b6790622bf51bb289ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.848784 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 562422a4dc1a44a7bca3a549839874be (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:13.848837 12793 tablet_service.cc:1511] Processing CreateTablet for tablet bdd615dc3bb34a41801dd1dd2d6aa16e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:13.849794 12863 tablet_service.cc:1511] Processing CreateTablet for tablet bdd615dc3bb34a41801dd1dd2d6aa16e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:13.850706 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd615dc3bb34a41801dd1dd2d6aa16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.851346 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd615dc3bb34a41801dd1dd2d6aa16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.856745 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562422a4dc1a44a7bca3a549839874be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.851707 12629 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.863862 12925 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:13.864425 12925 ts_tablet_manager.cc:1403] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.003s
I20260709 13:06:13.867480 12925 raft_consensus.cc:359] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.867779 12926 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.862054 12923 raft_consensus.cc:359] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.868235 12925 raft_consensus.cc:385] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.868502 12923 raft_consensus.cc:385] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.868597 12925 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.868876 12923 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.868896 12926 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:13.869626 12925 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.869829 12923 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.870265 12714 tablet_service.cc:1511] Processing CreateTablet for tablet bdd615dc3bb34a41801dd1dd2d6aa16e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:13.871788 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd615dc3bb34a41801dd1dd2d6aa16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.872588 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:13.874089 12699 leader_election.cc:343] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.874644 12926 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:13.876991 12790 tablet_service.cc:1511] Processing CreateTablet for tablet 8631a18d7be543f29c587dad80ba4297 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:13.878280 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8631a18d7be543f29c587dad80ba4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.879575 12923 ts_tablet_manager.cc:1434] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:06:13.885174 12923 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:13.886056 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:13.888011 12696 leader_election.cc:343] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.888574 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:13.879594 12925 ts_tablet_manager.cc:1434] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:06:13.890125 12868 tablet_service.cc:1511] Processing CreateTablet for tablet 8631a18d7be543f29c587dad80ba4297 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:13.891917 12926 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.893236 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8631a18d7be543f29c587dad80ba4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.899231 12925 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:13.899866 12789 tablet_service.cc:1511] Processing CreateTablet for tablet 6e133c6f80354472a921214beecde238 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:13.900985 12923 tablet_bootstrap.cc:654] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.901324 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e133c6f80354472a921214beecde238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.910434 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 6e133c6f80354472a921214beecde238 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:13.912184 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e133c6f80354472a921214beecde238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.923022 12719 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc74d6c2504bad83ab3be06d6255c9 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:13.923414 12794 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc74d6c2504bad83ab3be06d6255c9 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:13.924670 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc74d6c2504bad83ab3be06d6255c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.924867 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc74d6c2504bad83ab3be06d6255c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.929312 12864 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc74d6c2504bad83ab3be06d6255c9 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:13.930123 12932 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.930883 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc74d6c2504bad83ab3be06d6255c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.931090 12925 tablet_bootstrap.cc:654] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.930686 12932 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.933073 12932 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:13.932649 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 8631a18d7be543f29c587dad80ba4297 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:13.934991 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8631a18d7be543f29c587dad80ba4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.935304 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:13.935990 12882 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:13.937835 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:13.940205 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:13.940886 12733 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:13.943758 12932 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.944319 12932 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.946695 12932 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.951932 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 6e133c6f80354472a921214beecde238 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:13.945907 12718 tablet_service.cc:1511] Processing CreateTablet for tablet c3d9f69b18784243b7b412c0ea27e1f4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:13.953357 12863 tablet_service.cc:1511] Processing CreateTablet for tablet c3d9f69b18784243b7b412c0ea27e1f4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:13.954933 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d9f69b18784243b7b412c0ea27e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.953408 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e133c6f80354472a921214beecde238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.960511 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d9f69b18784243b7b412c0ea27e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.965150 12715 tablet_service.cc:1511] Processing CreateTablet for tablet 098bf8b9f16c41adb5871161f995c638 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:13.965466 12796 tablet_service.cc:1511] Processing CreateTablet for tablet c3d9f69b18784243b7b412c0ea27e1f4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:13.966568 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098bf8b9f16c41adb5871161f995c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.967001 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d9f69b18784243b7b412c0ea27e1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.975713 12922 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:13.976643 12922 ts_tablet_manager.cc:1403] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.181s	user 0.008s	sys 0.015s
I20260709 13:06:13.976348 12795 tablet_service.cc:1511] Processing CreateTablet for tablet 098bf8b9f16c41adb5871161f995c638 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:13.977834 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098bf8b9f16c41adb5871161f995c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.996276 12932 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:13.999511 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:14.000392 12733 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.004895 12869 tablet_service.cc:1511] Processing CreateTablet for tablet 098bf8b9f16c41adb5871161f995c638 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:14.006302 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098bf8b9f16c41adb5871161f995c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.011070 12733 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.013903 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:14.015139 12882 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.014564 12932 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.032197 12789 tablet_service.cc:1511] Processing CreateTablet for tablet c227f9d3821443ccaf06901b122c4591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:14.033612 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c227f9d3821443ccaf06901b122c4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.034533 12865 tablet_service.cc:1511] Processing CreateTablet for tablet c227f9d3821443ccaf06901b122c4591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:14.035835 12865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c227f9d3821443ccaf06901b122c4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.040985 12722 tablet_service.cc:1511] Processing CreateTablet for tablet c227f9d3821443ccaf06901b122c4591 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:14.043105 12716 tablet_service.cc:1511] Processing CreateTablet for tablet cc76143509f64c4faa68973765829aec (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:14.046525 12798 tablet_service.cc:1511] Processing CreateTablet for tablet cc76143509f64c4faa68973765829aec (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:14.047071 12923 tablet_bootstrap.cc:492] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:14.047778 12923 ts_tablet_manager.cc:1403] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.002s
I20260709 13:06:14.048234 12932 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.051584 12932 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.053273 12923 raft_consensus.cc:359] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.054103 12923 raft_consensus.cc:385] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.054416 12923 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.050302 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc76143509f64c4faa68973765829aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.055308 12932 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.085577 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:14.084744 12867 tablet_service.cc:1511] Processing CreateTablet for tablet cc76143509f64c4faa68973765829aec (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:14.096221 12881 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:14.097842 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc76143509f64c4faa68973765829aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.098207 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:14.085597 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:14.084337 12773 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:14.088508 12922 raft_consensus.cc:359] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.100724 12922 raft_consensus.cc:385] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.101554 12922 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.100960 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c227f9d3821443ccaf06901b122c4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.110116 12716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc76143509f64c4faa68973765829aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.111086 12932 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:14.112409 12932 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:14.112747 12925 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:14.134073 12925 ts_tablet_manager.cc:1403] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.235s	user 0.033s	sys 0.031s
I20260709 13:06:14.128764 12790 tablet_service.cc:1511] Processing CreateTablet for tablet 281969f368e74705b0bebd5eaacc1e39 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:14.135406 12923 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.123880 12882 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.132239 12922 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.153080 12933 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.153687 12933 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.143100 12733 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:14.157992 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:14.180898 12848 leader_election.cc:343] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:14.158717 12723 tablet_service.cc:1511] Processing CreateTablet for tablet 281969f368e74705b0bebd5eaacc1e39 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:14.181967 12793 tablet_service.cc:1511] Processing CreateTablet for tablet c7d64be8779a42e0ad6540bfa7067f2b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:14.183039 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281969f368e74705b0bebd5eaacc1e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.171937 12955 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:14.194188 12955 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.194895 12955 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:14.151216 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53064.6us
I20260709 13:06:14.156023 12933 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:14.159443 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:14.173161 12925 raft_consensus.cc:359] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.202720 12925 raft_consensus.cc:385] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.203135 12925 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.204080 12925 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.201565 12714 tablet_service.cc:1511] Processing CreateTablet for tablet c7d64be8779a42e0ad6540bfa7067f2b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:14.206501 12923 ts_tablet_manager.cc:1434] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.158s	user 0.015s	sys 0.009s
I20260709 13:06:14.199942 12922 ts_tablet_manager.cc:1434] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.223s	user 0.008s	sys 0.007s
I20260709 13:06:14.171730 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281969f368e74705b0bebd5eaacc1e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.183324 12869 tablet_service.cc:1511] Processing CreateTablet for tablet c7d64be8779a42e0ad6540bfa7067f2b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:14.212502 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d64be8779a42e0ad6540bfa7067f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.174173 12796 tablet_service.cc:1511] Processing CreateTablet for tablet 9b483b06f72a4b6e863293d4c6099849 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:14.173651 12871 tablet_service.cc:1511] Processing CreateTablet for tablet 9b483b06f72a4b6e863293d4c6099849 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:14.224187 12925 ts_tablet_manager.cc:1434] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:06:14.225287 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b483b06f72a4b6e863293d4c6099849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.225447 12925 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:14.228866 12922 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:14.164974 12872 tablet_service.cc:1511] Processing CreateTablet for tablet 281969f368e74705b0bebd5eaacc1e39 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:14.170241 12721 tablet_service.cc:1511] Processing CreateTablet for tablet 9b483b06f72a4b6e863293d4c6099849 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:14.236187 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281969f368e74705b0bebd5eaacc1e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.236182 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:14.239825 12923 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:14.241176 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d64be8779a42e0ad6540bfa7067f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.244654 12796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b483b06f72a4b6e863293d4c6099849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.246521 12721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b483b06f72a4b6e863293d4c6099849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.240701 12733 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 0.
I20260709 13:06:14.172323 12932 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.249090 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:14.249951 12933 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:14.250306 12933 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.250615 12933 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.259428 12933 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.261404 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d64be8779a42e0ad6540bfa7067f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.261233 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 2b39827c8d024243a5a2883bc2c2bd83 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:14.262696 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b39827c8d024243a5a2883bc2c2bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.270802 12922 tablet_bootstrap.cc:654] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.272492 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:14.274154 12848 leader_election.cc:343] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:14.274530 12925 tablet_bootstrap.cc:654] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.274775 12933 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:14.287480 12926 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:14.290270 12795 tablet_service.cc:1511] Processing CreateTablet for tablet 2b39827c8d024243a5a2883bc2c2bd83 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:14.291723 12795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b39827c8d024243a5a2883bc2c2bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.297438 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 2b39827c8d024243a5a2883bc2c2bd83 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:14.298945 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b39827c8d024243a5a2883bc2c2bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.300881 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:14.301548 12733 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.303330 12955 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.309362 12923 tablet_bootstrap.cc:654] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.310187 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 250e6770457a4cb087d4ea1e4af49b0d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:14.310987 12794 tablet_service.cc:1511] Processing CreateTablet for tablet 250e6770457a4cb087d4ea1e4af49b0d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:14.311977 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e6770457a4cb087d4ea1e4af49b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.313412 12926 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:14.315590 12870 tablet_service.cc:1511] Processing CreateTablet for tablet 250e6770457a4cb087d4ea1e4af49b0d (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:14.322536 12955 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.326283 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e6770457a4cb087d4ea1e4af49b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.325943 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbc2136a4b642ca94a5ef49ef811508 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:14.327515 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbc2136a4b642ca94a5ef49ef811508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.327741 12863 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbc2136a4b642ca94a5ef49ef811508 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:14.328715 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:14.329465 12732 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.349300 12718 tablet_service.cc:1511] Processing CreateTablet for tablet 433127d30b7c4bdf91cac2059c29a3f5 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:14.351162 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433127d30b7c4bdf91cac2059c29a3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.391422 12925 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:14.391782 12732 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.392356 12925 ts_tablet_manager.cc:1403] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.007s
I20260709 13:06:14.392109 12790 tablet_service.cc:1511] Processing CreateTablet for tablet 433127d30b7c4bdf91cac2059c29a3f5 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:14.393441 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433127d30b7c4bdf91cac2059c29a3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.393620 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:14.394680 12932 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:14.395215 12932 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:14.396174 12932 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.404417 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbc2136a4b642ca94a5ef49ef811508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.411785 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e6770457a4cb087d4ea1e4af49b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.413499 12714 tablet_service.cc:1511] Processing CreateTablet for tablet 28ea7c094d994eea9ec8090103d1142e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:14.398296 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:14.414871 12881 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.415159 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ea7c094d994eea9ec8090103d1142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.413375 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 433127d30b7c4bdf91cac2059c29a3f5 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:14.421799 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433127d30b7c4bdf91cac2059c29a3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.415501 12789 tablet_service.cc:1511] Processing CreateTablet for tablet 28ea7c094d994eea9ec8090103d1142e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:14.425621 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ea7c094d994eea9ec8090103d1142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.396010 12925 raft_consensus.cc:359] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.431212 12925 raft_consensus.cc:385] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.437808 12925 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.442853 12881 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.400380 12630 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.443298 12925 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.447438 12925 ts_tablet_manager.cc:1434] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 13:06:14.448762 12925 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:14.451402 12955 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.399497 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbc2136a4b642ca94a5ef49ef811508 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:14.451920 12955 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.453106 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbc2136a4b642ca94a5ef49ef811508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.453354 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 28ea7c094d994eea9ec8090103d1142e (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:14.454083 12955 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.455183 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ea7c094d994eea9ec8090103d1142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.458901 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:14.460407 12771 leader_election.cc:343] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:14.460698 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:14.473783 12715 tablet_service.cc:1511] Processing CreateTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:14.473686 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:14.475384 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.469095 12732 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:14.475389 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.479490 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:14.481040 12955 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:14.481549 12955 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.481989 12955 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.529672 12922 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:14.531090 12922 ts_tablet_manager.cc:1403] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.302s	user 0.018s	sys 0.020s
I20260709 13:06:14.533954 12865 tablet_service.cc:1511] Processing CreateTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:14.534377 12922 raft_consensus.cc:359] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.535226 12922 raft_consensus.cc:385] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.535540 12865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:14.526933 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47575.6us
I20260709 13:06:14.545743 12923 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:14.546324 12923 ts_tablet_manager.cc:1403] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.308s	user 0.030s	sys 0.017s
I20260709 13:06:14.558290 12925 tablet_bootstrap.cc:654] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.558511 12923 raft_consensus.cc:359] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.559269 12923 raft_consensus.cc:385] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.559621 12923 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.564689 12719 tablet_service.cc:1511] Processing CreateTablet for tablet ad96a33cd7224ee8980e6312e22ec951 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:14.566061 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad96a33cd7224ee8980e6312e22ec951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.566282 12955 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.568539 12733 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:14.535573 12922 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.580468 12631 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.583468 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:14.584434 12732 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.625165 12793 tablet_service.cc:1511] Processing CreateTablet for tablet ad96a33cd7224ee8980e6312e22ec951 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:14.601264 12923 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.628909 12922 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.630676 12923 ts_tablet_manager.cc:1434] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:06:14.633450 12922 ts_tablet_manager.cc:1434] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.002s
I20260709 13:06:14.633672 12955 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.634871 12922 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:14.635149 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad96a33cd7224ee8980e6312e22ec951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.641156 12732 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.642606 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:14.637027 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:14.647485 12771 leader_election.cc:343] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:14.648764 12864 tablet_service.cc:1511] Processing CreateTablet for tablet ad96a33cd7224ee8980e6312e22ec951 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:14.652297 12923 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:14.645748 12955 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:14.653246 12955 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:14.654458 12955 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.657646 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 3f17b4815ff84374bc9e1b330d886c34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:14.659705 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f17b4815ff84374bc9e1b330d886c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.667528 12932 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.668169 12922 tablet_bootstrap.cc:654] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.668216 12932 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.670856 12932 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:14.601527 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 61418.7us
I20260709 13:06:14.674229 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:14.675009 12732 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:14.676188 12932 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:14.677014 12773 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:14.678135 12958 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:14.678496 12958 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.678798 12958 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.679374 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:14.680404 12880 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:14.690212 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad96a33cd7224ee8980e6312e22ec951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.690459 12958 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.705343 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:14.706792 12933 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:14.707458 12933 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:14.708665 12933 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.714255 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:14.715005 12732 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.716404 12923 tablet_bootstrap.cc:654] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.725368 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 3f17b4815ff84374bc9e1b330d886c34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:14.726964 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f17b4815ff84374bc9e1b330d886c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.728250 12732 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.731855 12631 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.737177 12773 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:14.738246 12955 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:14.738765 12955 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:14.739638 12955 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.743582 12717 tablet_service.cc:1511] Processing CreateTablet for tablet e22c9d890e514419a9265ab93f02ad09 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:14.743984 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:14.744750 12880 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:14.745020 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c9d890e514419a9265ab93f02ad09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.748603 12958 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:14.752444 12925 tablet_bootstrap.cc:492] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:14.753098 12925 ts_tablet_manager.cc:1403] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.305s	user 0.052s	sys 0.033s
I20260709 13:06:14.756266 12925 raft_consensus.cc:359] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.757014 12925 raft_consensus.cc:385] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.757318 12925 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.757571 12794 tablet_service.cc:1511] Processing CreateTablet for tablet 3f17b4815ff84374bc9e1b330d886c34 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:14.764425 12797 tablet_service.cc:1511] Processing CreateTablet for tablet e22c9d890e514419a9265ab93f02ad09 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:14.759004 12925 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.774631 12925 ts_tablet_manager.cc:1434] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 13:06:14.775286 12958 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:14.759848 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f17b4815ff84374bc9e1b330d886c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.777899 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c9d890e514419a9265ab93f02ad09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.791863 12880 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:14.796918 12925 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:14.811355 12867 tablet_service.cc:1511] Processing CreateTablet for tablet e22c9d890e514419a9265ab93f02ad09 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:14.813122 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c9d890e514419a9265ab93f02ad09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.821158 12925 tablet_bootstrap.cc:654] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.847457 12925 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:14.848390 12925 ts_tablet_manager.cc:1403] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.052s	user 0.000s	sys 0.019s
I20260709 13:06:14.853534 12923 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:14.854159 12923 ts_tablet_manager.cc:1403] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.009s
I20260709 13:06:14.854249 12925 raft_consensus.cc:359] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.855441 12925 raft_consensus.cc:385] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.855883 12925 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.856698 12925 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.857728 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 49874df91d324eee9febcb540541383f (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:14.858660 12925 ts_tablet_manager.cc:1434] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:14.859030 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49874df91d324eee9febcb540541383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.859692 12925 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:14.862022 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 49874df91d324eee9febcb540541383f (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:14.863812 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49874df91d324eee9febcb540541383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.872016 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 58d92b468aaa43eb88852feb36a41c17 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:14.873420 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d92b468aaa43eb88852feb36a41c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.865536 12925 tablet_bootstrap.cc:654] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:14.869861 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 49874df91d324eee9febcb540541383f (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:14.877107 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49874df91d324eee9febcb540541383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.833915 12631 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.884943 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 58d92b468aaa43eb88852feb36a41c17 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:14.886446 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d92b468aaa43eb88852feb36a41c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.897888 12923 raft_consensus.cc:359] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.898756 12923 raft_consensus.cc:385] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.899081 12923 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.899940 12923 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.902530 12923 ts_tablet_manager.cc:1434] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:06:14.903218 12794 tablet_service.cc:1511] Processing CreateTablet for tablet 58d92b468aaa43eb88852feb36a41c17 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:14.909838 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d92b468aaa43eb88852feb36a41c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.914270 12922 tablet_bootstrap.cc:492] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:14.913276 12630 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.914860 12922 ts_tablet_manager.cc:1403] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.280s	user 0.018s	sys 0.034s
I20260709 13:06:14.903651 12923 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:14.930379 12958 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.930101 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 226beb8cd35a475d90c160b1834a29b4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:14.930486 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 226beb8cd35a475d90c160b1834a29b4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:14.930943 12958 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:14.931577 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226beb8cd35a475d90c160b1834a29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.932693 12955 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:14.934549 12955 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:14.942113 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226beb8cd35a475d90c160b1834a29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.980196 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 226beb8cd35a475d90c160b1834a29b4 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:14.981607 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226beb8cd35a475d90c160b1834a29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.985299 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 0229d1c0cac14ba68f265bbecd5bf81b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:14.986857 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229d1c0cac14ba68f265bbecd5bf81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.994827 12922 raft_consensus.cc:359] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:14.997416 12922 raft_consensus.cc:385] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:14.997786 12922 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:14.997898 12958 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:14.998742 12922 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.008113 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 0229d1c0cac14ba68f265bbecd5bf81b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:15.009693 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229d1c0cac14ba68f265bbecd5bf81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.011339 12923 tablet_bootstrap.cc:654] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.015976 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.016810 12733 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 1: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:15.017786 12922 ts_tablet_manager.cc:1434] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.002s
I20260709 13:06:15.015758 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.025354 12925 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.025949 12925 ts_tablet_manager.cc:1403] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.166s	user 0.029s	sys 0.030s
I20260709 13:06:15.028894 12925 raft_consensus.cc:359] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.029649 12925 raft_consensus.cc:385] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.029948 12925 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.030076 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3f64a0226433382c2dc48213c8070 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:15.030632 12925 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.031698 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3f64a0226433382c2dc48213c8070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.030447 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.032940 12925 ts_tablet_manager.cc:1434] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:15.034019 12925 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.034123 12955 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.038731 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3f64a0226433382c2dc48213c8070 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:15.040431 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 2d23a1e845884d5e9ad733d5579dcf30 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:15.030105 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 0229d1c0cac14ba68f265bbecd5bf81b (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:15.045148 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3f64a0226433382c2dc48213c8070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.044819 12865 tablet_service.cc:1511] Processing CreateTablet for tablet 2d23a1e845884d5e9ad733d5579dcf30 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:15.046495 12715 tablet_service.cc:1511] Processing CreateTablet for tablet fb04297576e2483ca596edd2dd418b52 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:15.049268 12925 tablet_bootstrap.cc:654] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.032971 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3f64a0226433382c2dc48213c8070 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:15.056393 12797 tablet_service.cc:1511] Processing CreateTablet for tablet 2d23a1e845884d5e9ad733d5579dcf30 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:15.057507 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3f64a0226433382c2dc48213c8070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.050591 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d23a1e845884d5e9ad733d5579dcf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.051811 12793 tablet_service.cc:1511] Processing CreateTablet for tablet fb04297576e2483ca596edd2dd418b52 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:15.061107 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04297576e2483ca596edd2dd418b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.062690 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04297576e2483ca596edd2dd418b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.052975 12870 tablet_service.cc:1511] Processing CreateTablet for tablet fb04297576e2483ca596edd2dd418b52 (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:15.073369 12865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d23a1e845884d5e9ad733d5579dcf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.075611 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229d1c0cac14ba68f265bbecd5bf81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.076587 12870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04297576e2483ca596edd2dd418b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.055980 12922 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.103356 12797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d23a1e845884d5e9ad733d5579dcf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.055160 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 140b233442844af3b88e29b40d4f25ad (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:15.107625 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140b233442844af3b88e29b40d4f25ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.124272 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 140b233442844af3b88e29b40d4f25ad (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:15.125487 12955 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.125821 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140b233442844af3b88e29b40d4f25ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.127936 12793 tablet_service.cc:1511] Processing CreateTablet for tablet 140b233442844af3b88e29b40d4f25ad (DEFAULT_TABLE table=test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:15.129089 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140b233442844af3b88e29b40d4f25ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.154878 12923 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.156486 12923 ts_tablet_manager.cc:1403] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.253s	user 0.018s	sys 0.034s
I20260709 13:06:15.157331 12922 tablet_bootstrap.cc:654] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.159616 12923 raft_consensus.cc:359] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.160418 12955 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.160579 12923 raft_consensus.cc:385] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.161154 12923 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.160991 12955 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.162062 12923 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.163210 12955 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.164354 12923 ts_tablet_manager.cc:1434] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:15.164872 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.167085 12923 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.167853 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.168583 12732 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:15.169842 12773 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:15.170632 12771 leader_election.cc:343] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.170683 12958 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.172123 12958 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.172485 12958 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.172823 12958 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.182052 12925 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.183998 12923 tablet_bootstrap.cc:654] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.186965 12925 ts_tablet_manager.cc:1403] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.153s	user 0.009s	sys 0.010s
I20260709 13:06:15.187768 12958 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.192624 12925 raft_consensus.cc:359] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.193336 12925 raft_consensus.cc:385] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.193605 12925 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.194492 12925 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.196712 12925 ts_tablet_manager.cc:1434] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:15.198213 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.198246 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:15.199810 12771 leader_election.cc:343] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.199849 12733 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.201247 12922 tablet_bootstrap.cc:492] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.202914 12922 ts_tablet_manager.cc:1403] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.012s
I20260709 13:06:15.206223 12922 raft_consensus.cc:359] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.207037 12922 raft_consensus.cc:385] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.207329 12922 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.207406 12970 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.207978 12970 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.208180 12922 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.209205 12733 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:15.197043 12958 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.210271 12970 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.210470 12925 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.210722 12922 ts_tablet_manager.cc:1434] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:15.211777 12922 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.216327 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.217093 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.218730 12773 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.219480 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.220335 12880 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.221129 12955 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.221894 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.223703 12955 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:15.224566 12955 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.226503 12932 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.227942 12880 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.228231 12970 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.233394 12970 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.233781 12970 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.238649 12923 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.239197 12923 ts_tablet_manager.cc:1403] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.008s
I20260709 13:06:15.239547 12925 tablet_bootstrap.cc:654] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.241181 12932 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.242770 12923 raft_consensus.cc:359] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.243772 12923 raft_consensus.cc:385] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.244124 12923 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.245294 12923 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:15.245970 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:15.226970 12922 tablet_bootstrap.cc:654] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.255699 12932 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.256384 12925 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.257002 12925 ts_tablet_manager.cc:1403] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.001s
I20260709 13:06:15.262346 12925 raft_consensus.cc:359] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.263247 12925 raft_consensus.cc:385] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.263646 12925 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.267120 12923 ts_tablet_manager.cc:1434] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.011s
I20260709 13:06:15.268620 12923 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.270025 12925 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.273825 12933 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.274660 12922 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.275239 12922 ts_tablet_manager.cc:1403] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.002s
I20260709 13:06:15.275715 12923 tablet_bootstrap.cc:654] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.273921 12630 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.278676 12925 ts_tablet_manager.cc:1434] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.005s
I20260709 13:06:15.279613 12925 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.292076 12970 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.295261 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.296075 12808 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.298640 12933 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.303300 12925 tablet_bootstrap.cc:654] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.300206 12922 raft_consensus.cc:359] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.307186 12922 raft_consensus.cc:385] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.307440 12922 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.313426 12922 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.323868 12922 ts_tablet_manager.cc:1434] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.008s
I20260709 13:06:15.325122 12922 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.325971 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.326694 12881 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.328723 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.330482 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.331837 12922 tablet_bootstrap.cc:654] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.332409 12999 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.321709 12970 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.337162 12881 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.339582 12923 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.340492 12923 ts_tablet_manager.cc:1403] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.010s
I20260709 13:06:15.346462 12923 raft_consensus.cc:359] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.347241 12923 raft_consensus.cc:385] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.347517 12923 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.347813 12925 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.348351 12925 ts_tablet_manager.cc:1403] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.001s
I20260709 13:06:15.348347 12923 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.351608 12923 ts_tablet_manager.cc:1434] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:15.351706 12925 raft_consensus.cc:359] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.353237 12925 raft_consensus.cc:385] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.353605 12925 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.354460 12925 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.357290 12925 ts_tablet_manager.cc:1434] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:15.358338 12999 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:15.358850 12925 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.361119 12999 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.364881 12923 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.371690 12922 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.372428 12922 ts_tablet_manager.cc:1403] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:06:15.375116 12925 tablet_bootstrap.cc:654] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.384231 12984 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.384859 12984 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.385763 12922 raft_consensus.cc:359] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.386487 12922 raft_consensus.cc:385] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.389822 12984 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.391698 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.392604 12733 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:15.386795 12922 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
W20260709 13:06:15.393364 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48230.8us
I20260709 13:06:15.400286 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.401279 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.403440 12958 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.404111 12958 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.404557 12958 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.410338 12922 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.414445 12923 tablet_bootstrap.cc:654] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.415655 12881 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:15.418933 12922 ts_tablet_manager.cc:1434] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:06:15.420917 12922 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.430629 12958 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.432277 12922 tablet_bootstrap.cc:654] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.438339 12629 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.445437 12984 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.446462 12925 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.446977 12925 ts_tablet_manager.cc:1403] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.016s
I20260709 13:06:15.446223 12984 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.449218 12984 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.449749 12925 raft_consensus.cc:359] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.450444 12925 raft_consensus.cc:385] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.450739 12925 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.450920 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.451205 12923 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.451402 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.451776 12923 ts_tablet_manager.cc:1403] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.012s
I20260709 13:06:15.450472 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:15.452565 12733 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:15.453075 12771 leader_election.cc:343] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.451469 12925 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.454767 12923 raft_consensus.cc:359] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.455480 12923 raft_consensus.cc:385] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.455734 12923 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.455824 12925 ts_tablet_manager.cc:1434] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:15.456455 12923 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.456897 12925 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:15.456982 12773 leader_election.cc:343] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.457489 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.458701 12923 ts_tablet_manager.cc:1434] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:15.459604 12923 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.461244 12984 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.464807 12925 tablet_bootstrap.cc:654] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.466329 12923 tablet_bootstrap.cc:654] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.467573 12733 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:15.469156 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.470286 12922 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.470750 12922 ts_tablet_manager.cc:1403] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.009s
I20260709 13:06:15.471361 12984 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.471843 12984 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:15.472681 12984 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.473534 12922 raft_consensus.cc:359] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.474196 12922 raft_consensus.cc:385] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.474445 12922 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.475200 12922 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.477545 12922 ts_tablet_manager.cc:1434] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:15.478464 12922 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.486042 12999 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.486630 12999 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.488935 12999 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.490825 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.491624 12807 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.492859 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.493007 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.493999 12922 tablet_bootstrap.cc:654] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.493974 12999 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.495237 12999 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.494505 12696 leader_election.cc:343] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.496631 12923 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.497184 12923 ts_tablet_manager.cc:1403] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.013s
I20260709 13:06:15.499128 12958 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.499853 12999 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.500454 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.501108 12881 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.505174 12923 raft_consensus.cc:359] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.506273 12628 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.509214 12999 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.512434 12881 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:15.512801 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.513381 12807 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.520032 12925 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.506243 12923 raft_consensus.cc:385] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.520929 12925 ts_tablet_manager.cc:1403] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.011s
I20260709 13:06:15.520829 12923 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.522212 12923 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.524446 12925 raft_consensus.cc:359] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.525254 12925 raft_consensus.cc:385] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.525542 12925 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.526207 12925 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.527657 12807 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.528311 12925 ts_tablet_manager.cc:1434] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:15.529770 12999 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.529994 12925 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.532459 12958 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.533186 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.533282 12958 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:15.535383 12696 leader_election.cc:343] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.535972 12925 tablet_bootstrap.cc:654] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.536113 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.537463 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.537930 12999 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.539041 12923 ts_tablet_manager.cc:1434] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
W20260709 13:06:15.539342 12773 leader_election.cc:343] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.540273 12923 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.541239 12958 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.532259 12922 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.542313 12922 ts_tablet_manager.cc:1403] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.002s
I20260709 13:06:15.542433 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:15.543901 12771 leader_election.cc:343] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.544289 12999 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:15.544379 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.545518 12958 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.545236 12999 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.546223 12922 raft_consensus.cc:359] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.547125 12922 raft_consensus.cc:385] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.547495 12922 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.548398 12922 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.549870 12970 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.550788 12970 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.552680 12925 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.553207 12925 ts_tablet_manager.cc:1403] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 13:06:15.554414 12923 tablet_bootstrap.cc:654] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.555946 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.556684 12881 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.556473 12925 raft_consensus.cc:359] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.557312 12925 raft_consensus.cc:385] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.557627 12925 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.558899 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:15.560544 12997 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.561125 12997 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.561913 12997 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.563766 12970 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.566466 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.556192 12922 ts_tablet_manager.cc:1434] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:15.573154 12922 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.567404 12807 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.576362 12997 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.567906 12925 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.570982 13008 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.579422 13008 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.580610 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.581518 12807 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.582162 13008 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.582787 12958 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.583709 12958 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.583793 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.585318 12881 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.589886 12925 ts_tablet_manager.cc:1434] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.036s	user 0.016s	sys 0.000s
I20260709 13:06:15.590333 12958 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.571635 12923 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.591059 12923 ts_tablet_manager.cc:1403] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.006s
I20260709 13:06:15.592470 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.593667 12922 tablet_bootstrap.cc:654] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.593447 12923 raft_consensus.cc:359] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.594182 12923 raft_consensus.cc:385] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.594457 12923 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.594558 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.595553 12925 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.595131 12923 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.597281 12923 ts_tablet_manager.cc:1434] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:06:15.597244 12771 leader_election.cc:343] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.598387 12923 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.599468 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.600692 12731 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:15.603266 12925 tablet_bootstrap.cc:654] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.603238 12630 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.604521 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:15.605945 12773 leader_election.cc:343] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.606422 12773 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.606765 12847 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:15.609928 12958 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.610764 13008 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.612442 12997 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.614282 12807 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.616410 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.617460 12997 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.618189 12997 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:15.619170 12997 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.622184 13008 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.619736 12881 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.628264 12923 tablet_bootstrap.cc:654] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.637801 12925 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.638418 12922 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.638568 12925 ts_tablet_manager.cc:1403] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.008s
I20260709 13:06:15.639072 12922 ts_tablet_manager.cc:1403] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 13:06:15.639418 12628 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.642000 12922 raft_consensus.cc:359] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.642753 12922 raft_consensus.cc:385] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.642354 12925 raft_consensus.cc:359] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.643138 12922 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.643251 12925 raft_consensus.cc:385] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.643690 12925 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.645062 12925 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.644176 12922 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.653805 12922 ts_tablet_manager.cc:1434] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:15.646822 12925 ts_tablet_manager.cc:1434] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:15.656670 12922 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.656839 12925 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.660591 12923 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.661170 12923 ts_tablet_manager.cc:1403] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.014s
I20260709 13:06:15.665378 12923 raft_consensus.cc:359] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.666030 12923 raft_consensus.cc:385] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.666298 12923 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.666719 12922 tablet_bootstrap.cc:654] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.667305 12923 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.667348 12925 tablet_bootstrap.cc:654] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.689587 12923 ts_tablet_manager.cc:1434] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.014s
I20260709 13:06:15.690610 12923 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.696568 12923 tablet_bootstrap.cc:654] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.700197 12925 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.700753 12925 ts_tablet_manager.cc:1403] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.021s
I20260709 13:06:15.703706 12925 raft_consensus.cc:359] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.704501 12925 raft_consensus.cc:385] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.704784 12925 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.705470 12925 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.709383 12922 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.710114 12922 ts_tablet_manager.cc:1403] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.004s
I20260709 13:06:15.712532 12958 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.713383 12922 raft_consensus.cc:359] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.714143 12922 raft_consensus.cc:385] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.714263 12925 ts_tablet_manager.cc:1434] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:06:15.714469 12922 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.714933 12923 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.715400 12925 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.715402 12923 ts_tablet_manager.cc:1403] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:06:15.718981 12923 raft_consensus.cc:359] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.720206 12923 raft_consensus.cc:385] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.720618 12923 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.721573 12923 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.724671 12925 tablet_bootstrap.cc:654] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.729012 12923 ts_tablet_manager.cc:1434] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:15.730242 12923 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.733935 12922 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.737296 12922 ts_tablet_manager.cc:1434] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:06:15.745205 12985 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.750836 12984 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.751050 12985 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.752676 12923 tablet_bootstrap.cc:654] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.753734 12985 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.756129 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:15.758658 12771 leader_election.cc:343] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.759179 13008 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.759924 13008 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.762820 13008 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.764736 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:15.769816 12773 leader_election.cc:343] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.772446 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.773309 12807 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 0.
I20260709 13:06:15.774057 12923 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:15.775071 12923 ts_tablet_manager.cc:1403] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.010s
I20260709 13:06:15.777729 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.778584 12733 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 0.
I20260709 13:06:15.778848 12925 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.779670 12925 ts_tablet_manager.cc:1403] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.015s
I20260709 13:06:15.738384 12922 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.780020 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:15.780933 12997 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.772436 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.783823 12984 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.781106 13008 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.785097 13008 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.786376 13008 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.786892 12925 raft_consensus.cc:359] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.787707 12925 raft_consensus.cc:385] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.788210 12925 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.789083 12925 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.791285 12925 ts_tablet_manager.cc:1434] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:06:15.792620 12925 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.804247 12923 raft_consensus.cc:359] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.804991 12923 raft_consensus.cc:385] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.805249 12923 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.805995 12923 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.807380 12922 tablet_bootstrap.cc:654] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.807435 13009 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.808498 13009 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.810351 12923 ts_tablet_manager.cc:1434] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:06:15.811998 13008 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.814215 13008 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.817109 12923 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:15.818928 12925 tablet_bootstrap.cc:654] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.821370 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.824170 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.824848 12807 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.829017 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:15.829780 12733 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.831591 12999 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.840729 13009 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.845382 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.846621 12806 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:15.853125 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:15.854154 12999 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.854807 12999 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.859020 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.861166 12999 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:15.861352 12696 leader_election.cc:343] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.864111 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.865002 12806 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.867105 13009 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.866906 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.868680 12999 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.869202 12999 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.869645 12999 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.874485 12925 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:15.874948 12925 ts_tablet_manager.cc:1403] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.017s
I20260709 13:06:15.877754 12997 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.877223 12925 raft_consensus.cc:359] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.878611 12925 raft_consensus.cc:385] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.879046 12925 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.878535 12997 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.877631 12807 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:15.880920 13008 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.880003 12923 tablet_bootstrap.cc:654] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.881453 13008 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.879733 12925 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.883608 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:15.884321 12925 ts_tablet_manager.cc:1434] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:15.884441 12933 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.884939 12933 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:15.885331 12925 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:15.885743 12933 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.886129 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.882330 12997 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:15.889304 12696 leader_election.cc:343] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.888315 13008 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.890368 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:15.892320 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:15.892521 12847 leader_election.cc:343] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.893055 12806 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 0.
I20260709 13:06:15.893196 12997 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.893754 12997 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.894848 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:15.895787 13008 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.895869 12733 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:15.896324 13008 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.899695 13008 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.900744 12922 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:15.901612 12922 ts_tablet_manager.cc:1403] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.002s
I20260709 13:06:15.898365 12999 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.908356 12997 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.897601 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.909718 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:15.910748 12806 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.909957 12807 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:15.913100 12699 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.911829 12922 raft_consensus.cc:359] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.915205 12922 raft_consensus.cc:385] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.915604 12922 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:15.916983 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:15.921146 12922 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.914548 12997 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:15.919585 12696 leader_election.cc:343] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.927062 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:15.929459 12998 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:15.930014 12998 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.930500 12998 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.932556 12925 tablet_bootstrap.cc:654] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:15.933983 13008 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.934543 12922 ts_tablet_manager.cc:1434] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:06:15.928364 12997 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.939888 12630 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.942799 12997 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.940304 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.943833 12807 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.940675 12999 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.945187 13009 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:15.948884 12998 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.951354 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.949504 13008 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:15.958480 12806 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.955066 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:15.965994 12847 leader_election.cc:343] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.968472 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.976701 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:15.977473 12808 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:15.979544 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:15.967824 12807 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:15.971100 12923 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
W20260709 13:06:15.981318 12696 leader_election.cc:343] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.981690 12923 ts_tablet_manager.cc:1403] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.014s
I20260709 13:06:15.982234 12998 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:15.982551 12958 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.985172 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:15.990556 12922 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:15.991214 12970 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:15.992898 12999 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.985821 12923 raft_consensus.cc:359] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.998031 12923 raft_consensus.cc:385] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:15.998454 12923 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
W20260709 13:06:15.991329 12696 leader_election.cc:343] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:15.999432 12923 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:15.987913 12808 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:16.008167 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.012177 13043 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:16.012786 13043 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:16.017372 13043 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.032998 12999 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.035914 12999 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.040436 12999 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.044229 12970 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:16.086706 12970 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.083679 12984 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:16.099933 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.046737 12806 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
W20260709 13:06:16.102406 12699 leader_election.cc:343] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.068733 12923 ts_tablet_manager.cc:1434] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.087s	user 0.030s	sys 0.030s
I20260709 13:06:16.103878 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:16.105225 13008 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:16.106160 13008 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:16.106424 12955 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.107321 13008 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.107410 12955 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.067751 13041 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.111691 12955 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.104351 12923 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:16.048153 12997 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.079535 12925 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:16.120834 12925 ts_tablet_manager.cc:1403] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.236s	user 0.032s	sys 0.049s
I20260709 13:06:16.124598 12922 tablet_bootstrap.cc:654] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.131914 12925 raft_consensus.cc:359] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.138315 12925 raft_consensus.cc:385] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.138830 12925 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.141716 12925 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.149298 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:16.150135 12806 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.154739 12925 ts_tablet_manager.cc:1434] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 13:06:16.142370 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.162814 12922 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:16.163873 12922 ts_tablet_manager.cc:1403] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.008s
I20260709 13:06:16.158306 12925 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:16.169965 12923 tablet_bootstrap.cc:654] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.179782 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.180460 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.188792 12998 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.193763 12997 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.184542 12999 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:16.195591 12773 leader_election.cc:343] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.203189 12806 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
W20260709 13:06:16.213220 12771 leader_election.cc:343] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:16.207880 12696 leader_election.cc:343] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.210000 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:16.231355 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:16.221834 13047 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:06:16.242169 12923 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
W20260709 13:06:16.250054 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44178.9us
I20260709 13:06:16.242683 12771 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.252100 12984 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:16.249502 12923 ts_tablet_manager.cc:1403] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.008s
I20260709 13:06:16.256857 12922 raft_consensus.cc:359] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.257431 12922 raft_consensus.cc:385] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.257596 12922 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
W20260709 13:06:16.258759 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52468.1us
I20260709 13:06:16.244329 12699 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:16.242380 12999 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:16.269989 12997 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:16.270745 12922 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.246309 12628 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.276525 12923 raft_consensus.cc:359] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.272485 12997 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:16.279572 12923 raft_consensus.cc:385] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.280125 12923 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.280289 12997 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.280966 12923 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.283679 12923 ts_tablet_manager.cc:1434] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:06:16.284927 12923 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
W20260709 13:06:16.284783 12696 leader_election.cc:343] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.289311 12922 ts_tablet_manager.cc:1434] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.001s
I20260709 13:06:16.291045 12922 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:16.292469 13008 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.300804 12631 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:16.319731 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:16.324097 12925 tablet_bootstrap.cc:654] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.362612 12923 tablet_bootstrap.cc:654] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.364940 12922 tablet_bootstrap.cc:654] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.381726 12923 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:16.382552 12923 ts_tablet_manager.cc:1403] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.007s
I20260709 13:06:16.385079 13008 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.388386 12923 raft_consensus.cc:359] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.389534 12923 raft_consensus.cc:385] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.389851 12923 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.391180 12923 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.393260 12923 ts_tablet_manager.cc:1434] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:06:16.394229 12923 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:16.398914 12631 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.402205 12923 tablet_bootstrap.cc:654] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.405725 12925 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:16.406384 12925 ts_tablet_manager.cc:1403] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.248s	user 0.022s	sys 0.005s
I20260709 13:06:16.399924 12970 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.407227 12970 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.408447 12923 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:16.408922 12923 ts_tablet_manager.cc:1403] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:06:16.410209 12970 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.411451 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.411378 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.412760 12805 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 1: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:16.414503 12999 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.414299 12925 raft_consensus.cc:359] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.415096 12925 raft_consensus.cc:385] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.415014 12999 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.415524 12925 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.415501 12699 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.416934 12997 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.417397 12999 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.421242 12933 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.421947 12933 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.423352 12922 tablet_bootstrap.cc:492] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:16.423864 12922 ts_tablet_manager.cc:1403] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.005s
I20260709 13:06:16.424299 12997 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:16.425033 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.425115 12997 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.426097 12881 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:16.427161 12933 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:16.427100 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.416935 12923 raft_consensus.cc:359] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.428575 12923 raft_consensus.cc:385] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.428376 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:16.429065 12923 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.426990 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.429817 12923 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:16.430071 12848 leader_election.cc:343] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.431155 12925 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:16.432117 12699 leader_election.cc:343] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.433223 12922 raft_consensus.cc:359] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.433815 12925 ts_tablet_manager.cc:1434] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:06:16.439306 12923 ts_tablet_manager.cc:1434] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:06:16.441251 12925 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:16.441642 12923 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:16.442078 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.442914 12922 raft_consensus.cc:385] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.443213 12922 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.434201 12970 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:16.444657 12999 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.450408 12925 tablet_bootstrap.cc:654] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.450945 12881 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.444710 12970 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.452601 12970 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.445418 12999 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.458106 12999 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.444010 12922 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.459630 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.461273 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:16.464393 12699 leader_election.cc:343] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.468420 12958 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.467984 12970 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.469017 12958 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.469643 12733 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:16.471978 12958 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.472790 12970 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:16.469569 12696 leader_election.cc:343] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.476584 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:16.478075 12771 leader_election.cc:343] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.478525 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:16.476941 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:16.479700 12699 leader_election.cc:343] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.479923 12970 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:16.482913 12847 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:16.482913 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:16.484215 12933 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.485492 12922 ts_tablet_manager.cc:1434] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:06:16.484385 12923 tablet_bootstrap.cc:654] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.486819 12922 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:16.489578 12999 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.492202 12925 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:16.492774 12925 ts_tablet_manager.cc:1403] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.004s
I20260709 13:06:16.493551 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.494546 12733 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:16.496654 12925 raft_consensus.cc:359] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.497684 12925 raft_consensus.cc:385] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.497915 12922 tablet_bootstrap.cc:654] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.498093 12925 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.499584 12925 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.502346 12925 ts_tablet_manager.cc:1434] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:06:16.503647 12925 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:16.503911 12933 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:16.514669 12923 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:16.420800 12631 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.575855 12923 ts_tablet_manager.cc:1403] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.134s	user 0.022s	sys 0.007s
I20260709 13:06:16.579885 12955 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.582708 12997 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.584328 12997 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.595647 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.599947 12985 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:16.600682 12985 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.601253 12985 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.612416 12955 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.613960 12922 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:16.615559 12922 ts_tablet_manager.cc:1403] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.011s
I20260709 13:06:16.617035 12955 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.617987 12882 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.621402 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:16.629415 12771 leader_election.cc:343] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.636859 12997 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.640018 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:16.642146 12925 tablet_bootstrap.cc:654] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:16.644732 12696 leader_election.cc:343] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.639547 12922 raft_consensus.cc:359] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.647866 12922 raft_consensus.cc:385] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.648319 12922 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.649350 12922 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.651736 12922 ts_tablet_manager.cc:1434] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:06:16.657045 12923 raft_consensus.cc:359] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.658493 12923 raft_consensus.cc:385] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.658900 12923 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
W20260709 13:06:16.647330 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54733.6us
I20260709 13:06:16.719930 13009 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:16.802395 13009 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.666818 12878 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:16.704355 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.807245 12922 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:16.660017 12923 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.685101 13006 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.135s
I20260709 13:06:16.734158 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.813932 12985 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.814572 12806 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:16.780428 12970 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:06:16.822894 12923 ts_tablet_manager.cc:1434] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.246s	user 0.026s	sys 0.008s
I20260709 13:06:16.815949 12733 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:16.826581 12998 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:16.836957 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.837530 12923 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:16.842337 12933 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:16.845088 13009 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:16.844067 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:16.852521 12997 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:16.852571 12985 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.845065 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.854794 12997 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:16.860301 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:16.861476 12997 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.862686 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.864497 12970 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:16.864959 12970 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.865368 12970 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.866281 12925 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:16.867095 12925 ts_tablet_manager.cc:1403] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.364s	user 0.025s	sys 0.025s
I20260709 13:06:16.855821 13009 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.861840 12998 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 13:06:16.871356 12771 leader_election.cc:343] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.874194 13009 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.876248 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:16.883739 12732 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.899968 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:16.934813 13009 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:16.939255 12732 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:16.901425 12933 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:16.944394 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44640.5us
I20260709 13:06:16.951603 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:16.947932 12999 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.957294 12985 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.966176 12985 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.968078 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:16.968464 12985 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.968916 12805 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 0.
I20260709 13:06:16.969314 12922 tablet_bootstrap.cc:654] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:16.958972 12999 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.972081 12925 raft_consensus.cc:359] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.972920 12925 raft_consensus.cc:385] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:16.973249 12925 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:16.950605 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:16.974076 12925 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:16.974668 12999 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:16.989797 12984 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:16.993229 12984 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:16.995826 12847 leader_election.cc:343] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:16.996234 12925 ts_tablet_manager.cc:1434] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.129s	user 0.012s	sys 0.000s
I20260709 13:06:16.994654 12984 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:16.997730 12925 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:16.999558 12696 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.000154 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:16.994834 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46668.1us
W20260709 13:06:17.003417 12696 leader_election.cc:343] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.004433 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.005311 12808 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.010934 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:17.012626 12933 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.013044 12933 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.013406 12933 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.011096 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.025063 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.008607 12970 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.028396 12985 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.029130 12985 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:17.030720 12970 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.030377 12985 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.037182 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.043727 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.047873 12998 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.048421 12998 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.048837 12998 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.052838 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.062896 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:17.063207 12773 leader_election.cc:343] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.067845 12923 tablet_bootstrap.cc:654] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:17.072430 12771 leader_election.cc:343] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.074756 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.075706 12958 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:17.076390 12696 leader_election.cc:343] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.078378 12922 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.078871 12922 ts_tablet_manager.cc:1403] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.007s
I20260709 13:06:17.081733 12922 raft_consensus.cc:359] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.082372 12922 raft_consensus.cc:385] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.082645 12922 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.088063 12922 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.096210 13074 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.096805 13074 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.093461 12984 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.104193 12984 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.104813 12806 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:17.105243 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.106797 13074 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:17.106930 12771 leader_election.cc:343] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.108108 12933 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.108795 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.114166 12922 ts_tablet_manager.cc:1434] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:06:17.117014 12922 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.119195 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:17.119089 12998 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.119477 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:17.119876 12806 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.120503 12733 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:17.121371 12998 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.124861 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.129851 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.116585 12933 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:17.134754 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:17.136787 12696 leader_election.cc:343] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.136898 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.138861 12984 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.139463 12925 tablet_bootstrap.cc:654] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.138352 12630 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.143172 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:17.143846 12805 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:17.147439 12847 leader_election.cc:343] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.144896 12998 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.156083 12923 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.156612 12923 ts_tablet_manager.cc:1403] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.319s	user 0.020s	sys 0.003s
I20260709 13:06:17.161456 12631 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.163527 12923 raft_consensus.cc:359] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.164438 12923 raft_consensus.cc:385] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.164755 12923 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.165103 12805 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:17.165661 12923 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.167125 12922 tablet_bootstrap.cc:654] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.172809 12806 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:17.174650 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:17.175628 12933 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.176227 12933 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:17.167990 12923 ts_tablet_manager.cc:1434] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:17.177064 12933 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.178349 12923 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.168447 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.181877 12998 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.182421 12998 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:17.183318 12998 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.151260 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.185070 12732 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:17.186504 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:17.187675 13074 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.188675 12923 tablet_bootstrap.cc:654] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.197413 13074 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.198071 12925 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.198782 12925 ts_tablet_manager.cc:1403] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.201s	user 0.009s	sys 0.013s
I20260709 13:06:17.202044 12925 raft_consensus.cc:359] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.202730 12925 raft_consensus.cc:385] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.203075 12925 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.204576 12925 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.206724 12630 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.208354 12925 ts_tablet_manager.cc:1434] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:06:17.209309 12925 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:17.213551 12631 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.215332 12925 tablet_bootstrap.cc:654] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.227631 12925 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.228180 12925 ts_tablet_manager.cc:1403] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:06:17.230806 12925 raft_consensus.cc:359] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.231642 12925 raft_consensus.cc:385] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.231902 12925 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.232770 12922 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.233409 12985 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.234037 12922 ts_tablet_manager.cc:1403] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.011s
I20260709 13:06:17.234229 12923 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.233987 12985 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.234728 12923 ts_tablet_manager.cc:1403] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 13:06:17.237329 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.237255 12922 raft_consensus.cc:359] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.237576 12923 raft_consensus.cc:359] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.238058 12922 raft_consensus.cc:385] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.238233 12923 raft_consensus.cc:385] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.238400 12922 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.238622 12923 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.239322 12923 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.239210 12922 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.241247 12923 ts_tablet_manager.cc:1434] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:17.242259 12923 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.244530 12925 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.246639 12925 ts_tablet_manager.cc:1434] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:06:17.250432 12923 tablet_bootstrap.cc:654] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.252337 12925 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:17.255489 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.256472 12881 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:17.258147 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.259119 12984 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.259768 12922 ts_tablet_manager.cc:1434] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:06:17.261034 12922 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.263849 12925 tablet_bootstrap.cc:654] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.274685 12922 tablet_bootstrap.cc:654] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.277966 12985 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.280686 12923 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.281149 12923 ts_tablet_manager.cc:1403] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.020s
I20260709 13:06:17.282938 12984 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.283640 12925 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.283741 12998 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.284574 12925 ts_tablet_manager.cc:1403] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.007s
I20260709 13:06:17.284288 12923 raft_consensus.cc:359] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.284301 12998 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.285382 12923 raft_consensus.cc:385] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.285729 12923 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.286625 12922 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.286438 12923 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.287060 12922 ts_tablet_manager.cc:1403] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:06:17.287953 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.287854 12925 raft_consensus.cc:359] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.288729 12925 raft_consensus.cc:385] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.288730 12806 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.289222 12925 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.289420 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.290030 12925 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.289340 12923 ts_tablet_manager.cc:1434] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:17.290882 12699 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.292325 12925 ts_tablet_manager.cc:1434] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:17.292873 12999 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.293027 12923 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.293429 12925 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:17.293334 12999 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.293846 12999 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:17.295064 12696 leader_election.cc:343] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.299242 12970 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:17.300335 12923 tablet_bootstrap.cc:654] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.302423 12998 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.310792 12925 tablet_bootstrap.cc:654] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.315222 12923 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.315817 12923 ts_tablet_manager.cc:1403] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:06:17.318885 12923 raft_consensus.cc:359] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.319694 12923 raft_consensus.cc:385] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.320024 12923 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.320802 12923 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.323027 12923 ts_tablet_manager.cc:1434] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:17.324442 12923 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.292613 12922 raft_consensus.cc:359] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.337795 12925 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.338042 12922 raft_consensus.cc:385] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.338639 12922 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.338809 12925 ts_tablet_manager.cc:1403] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.012s
I20260709 13:06:17.301795 12999 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.339473 12922 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.339710 12970 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.347165 12922 ts_tablet_manager.cc:1434] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:06:17.346855 12970 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.348412 12922 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.349112 12970 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:17.351651 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:17.352115 12997 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:17.352634 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.354172 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.355226 12925 raft_consensus.cc:359] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.355950 12925 raft_consensus.cc:385] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.356315 12925 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.356371 12999 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.357209 12925 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.360020 12925 ts_tablet_manager.cc:1434] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:06:17.360625 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:17.361231 12806 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.361306 12925 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:17.364598 12699 leader_election.cc:343] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:17.366792 12696 leader_election.cc:343] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.367350 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.371083 12923 tablet_bootstrap.cc:654] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.378871 12997 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.373464 12806 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:17.373672 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.374322 12922 tablet_bootstrap.cc:654] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.380767 12984 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.381282 12984 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.381336 12699 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.382649 12998 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.383390 12998 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:17.384467 12998 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.383450 12984 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.387650 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:17.389640 12773 leader_election.cc:343] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.389865 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:17.391902 12696 leader_election.cc:343] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:17.393621 12771 leader_election.cc:343] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.394259 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.395012 12984 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.395833 12882 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.401369 12923 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.402019 12923 ts_tablet_manager.cc:1403] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.004s
I20260709 13:06:17.404078 12922 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.404682 12922 ts_tablet_manager.cc:1403] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.003s
I20260709 13:06:17.404968 12923 raft_consensus.cc:359] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.405699 12923 raft_consensus.cc:385] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.405998 12923 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.406653 12923 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.381367 12925 tablet_bootstrap.cc:654] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.408365 12922 raft_consensus.cc:359] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.408776 12923 ts_tablet_manager.cc:1434] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:17.409215 12922 raft_consensus.cc:385] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.409605 12922 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.409991 12923 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.410365 12922 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.412684 12922 ts_tablet_manager.cc:1434] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:17.413857 12922 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.417686 12923 tablet_bootstrap.cc:654] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.425114 12922 tablet_bootstrap.cc:654] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.433789 12630 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.439648 12923 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.440204 12923 ts_tablet_manager.cc:1403] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.002s
I20260709 13:06:17.451297 12922 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.451719 12925 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.451968 12922 ts_tablet_manager.cc:1403] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:06:17.451442 12923 raft_consensus.cc:359] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.452328 12925 ts_tablet_manager.cc:1403] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.002s
I20260709 13:06:17.452708 12923 raft_consensus.cc:385] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.453135 12923 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.453917 12923 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.454877 12922 raft_consensus.cc:359] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.455600 12922 raft_consensus.cc:385] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.455576 12925 raft_consensus.cc:359] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.456207 12922 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.456573 12925 raft_consensus.cc:385] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.456905 12925 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.457015 12923 ts_tablet_manager.cc:1434] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:06:17.457227 12922 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.458446 12923 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.457703 12925 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.459602 12922 ts_tablet_manager.cc:1434] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:17.460776 12922 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.465058 12925 ts_tablet_manager.cc:1434] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:17.466279 12925 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:17.466624 12923 tablet_bootstrap.cc:654] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.473342 12925 tablet_bootstrap.cc:654] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.491994 12922 tablet_bootstrap.cc:654] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.498539 12985 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:17.499601 12923 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.500187 12923 ts_tablet_manager.cc:1403] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.010s
I20260709 13:06:17.500384 12997 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.500957 12997 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.504024 12923 raft_consensus.cc:359] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.505014 12923 raft_consensus.cc:385] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.505295 12923 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.505960 12923 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.507639 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.507961 12923 ts_tablet_manager.cc:1434] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:17.508456 12806 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.509073 12923 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.509928 12922 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.510444 12922 ts_tablet_manager.cc:1403] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.008s
I20260709 13:06:17.506095 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.513767 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.515298 12923 tablet_bootstrap.cc:654] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.515522 12998 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.515902 12998 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.516431 12998 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.515973 12922 raft_consensus.cc:359] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.518832 12922 raft_consensus.cc:385] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.519166 12922 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
W20260709 13:06:17.519455 12696 leader_election.cc:343] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.520109 12922 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.503645 12997 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.526095 12922 ts_tablet_manager.cc:1434] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:06:17.530355 12922 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.532513 12998 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.535481 13096 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.542274 12925 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.542724 12925 ts_tablet_manager.cc:1403] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.020s
I20260709 13:06:17.541239 13096 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.545104 12985 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.546531 13096 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.547137 12998 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.548384 12985 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.550910 12985 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.551697 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.552095 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:17.552086 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.552670 12806 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 1: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:17.552950 12808 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.554304 12925 raft_consensus.cc:359] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.555100 12925 raft_consensus.cc:385] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.555397 12925 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.557526 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:17.557953 12771 leader_election.cc:343] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.557973 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.558786 12925 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.560424 12923 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.560423 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.561249 12923 ts_tablet_manager.cc:1403] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.006s
I20260709 13:06:17.561256 12733 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:17.564560 12808 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:17.565142 12923 raft_consensus.cc:359] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.565871 12923 raft_consensus.cc:385] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.566202 12923 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.566795 12925 ts_tablet_manager.cc:1434] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:06:17.563619 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.567162 12923 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.572809 13096 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.576798 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.579527 13096 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.580648 12997 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.581116 12997 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:17.581863 12997 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.586045 12985 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.586649 12985 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.587626 12925 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:17.588940 12696 leader_election.cc:343] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.590633 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.591357 12985 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.591180 13074 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:17.591226 12882 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:17.593408 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:17.594373 13068 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.594738 13068 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.595070 13068 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.595364 12925 tablet_bootstrap.cc:654] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.594926 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.599431 12922 tablet_bootstrap.cc:654] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.599850 12984 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.587687 12923 ts_tablet_manager.cc:1434] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:06:17.603240 12984 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.603600 12984 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.604012 12923 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.610873 12984 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.613194 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.614053 12732 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:17.614004 12985 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:17.616766 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:17.619094 12771 leader_election.cc:343] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.621017 12984 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.622581 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:17.624544 12730 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.628183 12923 tablet_bootstrap.cc:654] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.630097 12998 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:17.633109 12730 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:17.641659 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.646873 13074 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.647137 12958 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.647424 13074 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.647928 12958 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.650477 13074 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:17.650892 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.651995 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.653563 12881 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.661042 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:17.661751 12984 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.662515 12984 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:17.664845 12933 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.665710 12958 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.666968 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:17.668531 12771 leader_election.cc:343] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.668960 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:17.670534 12773 leader_election.cc:343] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.670994 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:17.663703 12984 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.623114 13068 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.673208 12628 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.675026 12997 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:17.673264 13112 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:17.685168 12923 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.685714 12923 ts_tablet_manager.cc:1403] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.006s
I20260709 13:06:17.689792 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:17.690379 12923 raft_consensus.cc:359] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.691748 12730 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.690876 12997 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.692158 12923 raft_consensus.cc:385] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.692519 12923 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.683807 13068 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.692584 12997 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.693269 12923 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.693701 12933 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:17.703799 12998 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.704551 12922 tablet_bootstrap.cc:492] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.704337 12998 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.704979 12922 ts_tablet_manager.cc:1403] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.175s	user 0.005s	sys 0.011s
I20260709 13:06:17.706415 12998 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.708432 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.709034 12808 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.711069 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.700525 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.712858 12881 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.713195 12999 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.713546 12999 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.713864 12999 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.707650 12922 raft_consensus.cc:359] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.716310 12922 raft_consensus.cc:385] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.716689 12922 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.724300 12923 ts_tablet_manager.cc:1434] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.004s
I20260709 13:06:17.725961 12923 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.732458 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.722920 12922 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.737305 12878 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.749775 12922 ts_tablet_manager.cc:1434] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:06:17.751459 12922 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:17.769012 12997 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.770128 13112 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.770813 13112 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.774071 12730 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:17.778723 12925 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:17.779407 12925 ts_tablet_manager.cc:1403] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.049s
I20260709 13:06:17.797885 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.799803 13074 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.800935 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.808854 12730 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:17.810389 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:17.811743 13068 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.812284 13068 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:17.813149 13068 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.813694 12881 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:17.786250 12999 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.824572 12999 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.800534 13074 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:17.827440 12696 leader_election.cc:343] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.829368 13074 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:17.830796 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.831431 12925 raft_consensus.cc:359] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.832019 12806 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:17.819703 12629 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.832283 12925 raft_consensus.cc:385] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.835602 12925 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.836572 12925 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.839443 12925 ts_tablet_manager.cc:1434] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:06:17.852435 12925 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:17.851665 12999 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.845575 13112 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.856537 12999 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.866722 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:17.871081 12923 tablet_bootstrap.cc:654] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.852115 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:17.875186 12999 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.878072 12922 tablet_bootstrap.cc:654] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.848209 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:17.879289 12771 leader_election.cc:343] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.879822 13068 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:17.880237 13068 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.880585 13068 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.884718 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:17.886647 12696 leader_election.cc:343] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:17.878746 12881 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.902186 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.905108 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:17.905782 12803 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.920936 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:17.921847 12730 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:17.931073 12882 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.933656 13068 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.938441 12803 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:17.938867 12933 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.939329 12933 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.942541 12881 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:17.948680 12933 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:17.950277 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:17.958565 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.959393 12923 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:17.959259 12808 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:17.959868 12923 ts_tablet_manager.cc:1403] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.234s	user 0.002s	sys 0.015s
I20260709 13:06:17.961817 13068 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.964347 12923 raft_consensus.cc:359] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.965132 12923 raft_consensus.cc:385] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.965423 12923 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.966120 12923 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.967720 12923 ts_tablet_manager.cc:1434] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:06:17.957558 13112 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.970083 13112 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.973542 12999 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:17.977013 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:17.977716 12808 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:17.976716 13112 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:17.958004 12970 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.981941 12925 tablet_bootstrap.cc:654] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.982023 12922 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:17.983192 12922 ts_tablet_manager.cc:1403] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.232s	user 0.023s	sys 0.004s
I20260709 13:06:17.983819 12970 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:17.984905 12970 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:17.985736 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:17.986354 12732 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.988022 12923 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:17.982877 12629 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.995873 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:17.998133 12773 leader_election.cc:343] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:17.999795 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50258.1us
I20260709 13:06:18.005103 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:18.005584 12847 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:18.006785 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:18.007021 13074 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.007951 12848 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:18.011902 12771 leader_election.cc:343] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:18.013408 12771 leader_election.cc:343] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.014575 12771 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.019804 12984 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.025159 12922 raft_consensus.cc:359] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.027124 12922 raft_consensus.cc:385] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.027431 12922 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.028997 12922 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.032975 12933 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:18.039115 13074 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.049127 12923 tablet_bootstrap.cc:654] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:18.051326 12699 leader_election.cc:343] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.051920 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.054044 12998 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.069590 12933 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:18.069655 12732 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:18.070525 12933 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.073328 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.074203 12925 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:18.074250 12922 ts_tablet_manager.cc:1434] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.090s	user 0.010s	sys 0.020s
I20260709 13:06:18.077266 12925 ts_tablet_manager.cc:1403] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.228s	user 0.012s	sys 0.006s
I20260709 13:06:18.057139 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.078229 13068 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:18.090018 13068 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:18.089792 12933 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.091018 12882 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:18.091120 13068 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.093318 12922 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:18.093273 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:18.094051 12808 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.094430 12933 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:18.096050 12999 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:18.096421 12999 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.096793 12999 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.096551 12970 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:18.084463 12925 raft_consensus.cc:359] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.097419 12925 raft_consensus.cc:385] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.097733 12925 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.097743 12970 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:18.098693 12970 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:18.099545 12970 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.100735 12970 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:18.102823 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46492.1us
I20260709 13:06:18.101933 13112 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:18.103367 12925 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.107314 12925 ts_tablet_manager.cc:1434] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:06:18.108562 12925 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:18.110051 12922 tablet_bootstrap.cc:654] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.129192 12923 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:18.129861 12923 ts_tablet_manager.cc:1403] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.000s
I20260709 13:06:18.124951 12808 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:18.155579 12923 raft_consensus.cc:359] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.156661 12923 raft_consensus.cc:385] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.157039 12923 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.158974 12925 tablet_bootstrap.cc:654] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.157891 12923 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.193893 12999 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.194653 12923 ts_tablet_manager.cc:1434] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 13:06:18.197059 12923 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:18.214430 12999 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.212730 12848 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:18.224104 13130 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.225389 13130 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:18.227015 13130 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.261332 12925 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:18.261548 12923 tablet_bootstrap.cc:654] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.262234 12925 ts_tablet_manager.cc:1403] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.154s	user 0.027s	sys 0.007s
I20260709 13:06:18.267519 12925 raft_consensus.cc:359] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.270615 12925 raft_consensus.cc:385] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.273017 12925 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.274020 12925 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.419404 13138 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.420395 13138 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.426076 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:18.428244 12696 leader_election.cc:343] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.429747 13130 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.430586 13130 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.432650 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:18.435381 12696 leader_election.cc:343] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.437875 13130 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:18.424487 13138 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.439601 12925 ts_tablet_manager.cc:1434] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.177s	user 0.010s	sys 0.002s
I20260709 13:06:18.440760 12925 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:18.445055 13138 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:18.447613 13139 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.448323 13139 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.449285 12925 tablet_bootstrap.cc:654] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.451040 13139 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.454455 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:18.457002 12773 leader_election.cc:343] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.461633 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:18.468922 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 357549us
I20260709 13:06:18.473994 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:18.475037 12730 raft_consensus.cc:2410] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:06:18.485425 12925 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:18.486101 12925 ts_tablet_manager.cc:1403] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.010s
W20260709 13:06:18.489063 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47025.3us
I20260709 13:06:18.491042 12923 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:18.491567 12923 ts_tablet_manager.cc:1403] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.296s	user 0.020s	sys 0.008s
I20260709 13:06:18.489764 12925 raft_consensus.cc:359] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.492393 12925 raft_consensus.cc:385] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.492741 12925 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.494481 13096 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.494843 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:18.495204 13096 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.497812 13096 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.502043 12923 raft_consensus.cc:359] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.502938 12923 raft_consensus.cc:385] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.503268 12923 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.504974 12881 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.504657 12923 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.507824 12923 ts_tablet_manager.cc:1434] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:06:18.494482 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:18.509331 12923 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:18.514345 12925 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.528725 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:18.530855 12925 ts_tablet_manager.cc:1434] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
W20260709 13:06:18.532131 12696 leader_election.cc:343] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.537505 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:18.538230 12807 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.543223 12985 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:18.543474 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:18.544327 12803 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
W20260709 13:06:18.544422 12771 leader_election.cc:343] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.545075 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.532469 13144 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 13:06:18.559113 13133 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.352s	user 0.003s	sys 0.001s
I20260709 13:06:18.560312 13139 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.538381 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:18.568238 12925 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:18.594732 13144 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:18.607319 12922 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:18.607810 12922 ts_tablet_manager.cc:1403] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.515s	user 0.015s	sys 0.007s
W20260709 13:06:18.620111 12696 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.619390 12733 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:18.641064 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:18.641296 12922 raft_consensus.cc:359] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.641963 12922 raft_consensus.cc:385] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.642244 12922 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.642341 12923 tablet_bootstrap.cc:654] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.643054 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:18.642964 12922 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.643442 13130 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.643848 12805 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:18.644690 12807 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:18.644789 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.646087 12922 ts_tablet_manager.cc:1434] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:06:18.648526 12629 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.653375 12997 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:18.653456 13145 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:06:18.657614 12997 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.658057 12999 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:18.664085 12922 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:18.658075 12997 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.677311 13120 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:18.684456 12699 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:18.689648 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:18.688261 13138 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:18.712335 13138 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.712904 13138 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:18.724823 12771 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.731321 13138 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.752183 12925 tablet_bootstrap.cc:654] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.761904 12923 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:18.762151 12922 tablet_bootstrap.cc:654] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.762462 12923 ts_tablet_manager.cc:1403] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.033s
I20260709 13:06:18.743175 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.767414 13137 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:18.767982 13137 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:18.768725 13074 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.768823 13137 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.769474 13074 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.774827 12923 raft_consensus.cc:359] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.775372 12923 raft_consensus.cc:385] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.776325 12627 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.778889 13138 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.780133 12627 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:06:18.781844 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:18.783172 12696 leader_election.cc:343] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.783553 13074 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:18.775702 12923 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.787580 12923 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.793382 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:18.802173 12997 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.808532 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:18.785594 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:18.809890 12923 ts_tablet_manager.cc:1434] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.047s	user 0.000s	sys 0.007s
I20260709 13:06:18.785586 13138 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.809381 12806 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.821873 12923 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:18.825152 12805 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:18.816609 13138 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.828578 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:18.829998 12933 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.834328 12925 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:18.835059 12925 ts_tablet_manager.cc:1403] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.278s	user 0.009s	sys 0.010s
I20260709 13:06:18.843954 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:18.844725 12805 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:18.845810 12802 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.850649 12806 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:18.852537 13074 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:18.853170 12925 raft_consensus.cc:359] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.854602 13138 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.854472 12933 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.855257 12925 raft_consensus.cc:385] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.855878 12925 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.857599 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:18.860160 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:18.860836 12699 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.857520 12997 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:18.863291 12699 leader_election.cc:343] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.865237 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:18.867015 12696 leader_election.cc:343] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.869792 12922 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:18.870405 12922 ts_tablet_manager.cc:1403] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.009s
I20260709 13:06:18.870261 12696 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.885939 12923 tablet_bootstrap.cc:654] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:18.886760 12696 leader_election.cc:343] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.887223 12998 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:18.881047 12733 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.882311 12922 raft_consensus.cc:359] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.882195 12925 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.889484 12922 raft_consensus.cc:385] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.889843 12922 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.874250 13137 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:18.892127 12925 ts_tablet_manager.cc:1434] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 13:06:18.892431 13137 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:18.874665 13145 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.895802 13137 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.895229 12922 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.898747 12922 ts_tablet_manager.cc:1434] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.008s
I20260709 13:06:18.899734 12922 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:18.906880 13074 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.907490 13074 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.909598 13074 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:18.910117 13074 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.913976 12925 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:18.921634 13161 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:18.921958 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:18.923967 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:18.925912 12805 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:18.902539 13145 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.930344 13145 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:18.931545 12922 tablet_bootstrap.cc:654] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.933320 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:18.939756 12771 leader_election.cc:343] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:18.945649 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:18.946949 13137 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:18.955041 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:18.949252 13137 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:18.956838 13137 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:18.950112 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:18.973393 13125 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.002856 12997 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.003710 12997 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.015873 13096 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.016902 13096 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.022881 12923 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:19.023687 12628 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.026031 12925 tablet_bootstrap.cc:654] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:19.015888 12773 leader_election.cc:343] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.027837 12773 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.027796 12923 ts_tablet_manager.cc:1403] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.207s	user 0.018s	sys 0.014s
W20260709 13:06:19.031656 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63442us
I20260709 13:06:19.046195 12922 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:19.046852 12922 ts_tablet_manager.cc:1403] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.027s
I20260709 13:06:19.031771 12985 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.040729 13139 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.047446 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.049010 13096 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.048975 13140 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.072435 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.060920 13139 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.070430 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.076017 13140 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.085911 12922 raft_consensus.cc:359] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.086613 12922 raft_consensus.cc:385] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.086907 12922 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.087486 13140 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:19.090245 12699 leader_election.cc:343] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.089422 12922 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.080890 12808 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
W20260709 13:06:19.112488 12696 leader_election.cc:343] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.115170 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.116751 13120 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.100234 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.100227 12879 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.099711 13139 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.091780 12997 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.101820 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.137457 12881 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:19.128468 12922 ts_tablet_manager.cc:1434] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.081s	user 0.002s	sys 0.005s
I20260709 13:06:19.094928 13169 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.122226 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.142519 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:19.142881 12878 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:19.143079 13169 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.143676 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:19.146111 12696 leader_election.cc:343] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.094583 12923 raft_consensus.cc:359] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.147909 12923 raft_consensus.cc:385] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.148332 12923 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.155997 12771 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:19.156965 13140 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.157467 13140 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.158468 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.159551 13140 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.160250 13144 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.160655 13144 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.160988 13144 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.165580 13145 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:19.166324 13145 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.166714 13145 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:19.097841 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.149367 12923 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.177294 12733 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:19.184690 13175 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.180641 12731 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:19.185223 13175 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.185616 13175 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.187830 12922 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:19.188638 12925 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:19.189184 12925 ts_tablet_manager.cc:1403] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.287s	user 0.013s	sys 0.014s
I20260709 13:06:19.199225 13145 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.203423 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.208091 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:19.211032 12773 leader_election.cc:343] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.215905 12925 raft_consensus.cc:359] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.216707 12925 raft_consensus.cc:385] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.216990 12925 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.217072 13144 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.219957 13144 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.217707 12925 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.204440 13169 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.222229 12805 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:19.223233 13145 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.225060 12925 ts_tablet_manager.cc:1434] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:06:19.226063 12925 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:19.226356 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:19.227088 12731 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.230978 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:19.232682 12923 ts_tablet_manager.cc:1434] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.202s	user 0.014s	sys 0.018s
I20260709 13:06:19.232334 12733 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:19.228890 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.238744 12923 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:19.240408 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.244387 12880 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:19.261334 12733 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:19.262835 12731 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:19.263092 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:19.263842 13144 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:19.264341 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:19.265339 13139 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.267375 13139 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:19.264360 13144 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:19.268883 13139 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.269191 13144 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.270406 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:19.242908 13175 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.272910 12881 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.273916 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:19.274518 12771 leader_election.cc:343] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.280017 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.281167 12925 tablet_bootstrap.cc:654] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.281617 12922 tablet_bootstrap.cc:654] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.282001 12696 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:19.283022 13096 raft_consensus.cc:2764] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:19.281837 12985 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:19.289171 12662 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ba0 after lost signal to thread 11579
I20260709 13:06:19.276017 12880 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:19.291455 12662 debug-util.cc:398] Leaking SignalData structure 0x7b0800091280 after lost signal to thread 12665
I20260709 13:06:19.291831 13175 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.294952 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:19.295933 12805 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.304813 12627 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.309509 12629 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.311998 12629 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:19.308007 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080019dac0 after lost signal to thread 12757
I20260709 13:06:19.322898 12923 tablet_bootstrap.cc:654] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.315541 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:19.334702 12881 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
W20260709 13:06:19.336107 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080020e500 after lost signal to thread 12832
W20260709 13:06:19.339411 12662 debug-util.cc:398] Leaking SignalData structure 0x7b0800221160 after lost signal to thread 12906
W20260709 13:06:19.344103 12696 leader_election.cc:343] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.349870 13175 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.329444 12880 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:19.353593 12805 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:19.357239 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.358428 12925 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:19.358969 12925 ts_tablet_manager.cc:1403] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.133s	user 0.019s	sys 0.008s
I20260709 13:06:19.359107 13096 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.359602 13096 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:19.360662 13096 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.364243 12925 raft_consensus.cc:359] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.365190 12925 raft_consensus.cc:385] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.373880 12925 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.375267 12925 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.377537 12925 ts_tablet_manager.cc:1434] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.007s
I20260709 13:06:19.378762 12925 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:19.380952 12922 tablet_bootstrap.cc:492] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:19.381579 12922 ts_tablet_manager.cc:1403] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.194s	user 0.020s	sys 0.022s
I20260709 13:06:19.384689 12922 raft_consensus.cc:359] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.385459 12922 raft_consensus.cc:385] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.385754 12922 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.391280 13175 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:19.402511 12696 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.397426 12922 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.398630 12629 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.410390 12922 ts_tablet_manager.cc:1434] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:06:19.412292 12923 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:19.412755 12923 ts_tablet_manager.cc:1403] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.027s
I20260709 13:06:19.417284 12922 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:19.420282 12925 tablet_bootstrap.cc:654] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.424736 12628 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.432168 13175 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.433347 13175 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.435314 12923 raft_consensus.cc:359] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.436192 12923 raft_consensus.cc:385] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.436457 12923 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.437268 12923 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.439144 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.439730 12923 ts_tablet_manager.cc:1434] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:06:19.440816 12923 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
W20260709 13:06:19.441403 12699 leader_election.cc:343] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.443152 13175 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.444746 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:19.446352 12696 leader_election.cc:343] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.446817 12696 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.447880 13175 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.449919 12923 tablet_bootstrap.cc:654] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.450446 12922 tablet_bootstrap.cc:654] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:19.460165 12908 tablet.cc:2406] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:19.475157 13175 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:19.489713 12923 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:19.490245 12923 ts_tablet_manager.cc:1403] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.016s
I20260709 13:06:19.494339 12925 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:19.494853 12925 ts_tablet_manager.cc:1403] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.003s
I20260709 13:06:19.499497 12923 raft_consensus.cc:359] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.500829 12923 raft_consensus.cc:385] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.501137 12923 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.507014 12925 raft_consensus.cc:359] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.508124 12925 raft_consensus.cc:385] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.508435 13169 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.509025 13169 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.511404 13169 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.512774 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.513561 12806 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:19.514001 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.515129 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:19.508498 12925 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
W20260709 13:06:19.517216 12696 leader_election.cc:343] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.518324 12925 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.520187 13175 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.501873 12923 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.520787 13175 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.521384 13175 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.522485 12923 ts_tablet_manager.cc:1434] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:06:19.523870 12925 ts_tablet_manager.cc:1434] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:06:19.529529 12925 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:19.532081 12923 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:19.558166 12923 tablet_bootstrap.cc:654] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.572803 12922 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:19.573276 12922 ts_tablet_manager.cc:1403] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.156s	user 0.032s	sys 0.024s
W20260709 13:06:19.577937 12696 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.577405 12925 tablet_bootstrap.cc:654] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.583490 12922 raft_consensus.cc:359] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.584445 12922 raft_consensus.cc:385] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.584713 12922 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.585342 12922 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.582231 13175 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.590512 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:19.590760 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:19.591303 12805 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:19.592406 12696 leader_election.cc:343] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.593032 13175 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.596325 12922 ts_tablet_manager.cc:1434] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:06:19.597414 12922 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:19.599507 12805 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:19.603504 12922 tablet_bootstrap.cc:654] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.603711 13125 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.604174 13125 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.604496 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.602581 12925 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:19.606106 12925 ts_tablet_manager.cc:1403] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.003s
I20260709 13:06:19.606462 13125 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:19.608810 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.609766 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.611315 13175 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.611562 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:19.613517 13125 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.614037 12925 raft_consensus.cc:359] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.614584 12922 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:19.614962 12925 raft_consensus.cc:385] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.615204 12922 ts_tablet_manager.cc:1403] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:06:19.615338 12925 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.616853 12925 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.619524 12922 raft_consensus.cc:359] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.619930 12925 ts_tablet_manager.cc:1434] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:19.620226 12922 raft_consensus.cc:385] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.620554 12922 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.621150 12925 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:19.622548 12923 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:19.623000 12923 ts_tablet_manager.cc:1403] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.093s	user 0.003s	sys 0.008s
I20260709 13:06:19.626003 12923 raft_consensus.cc:359] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.626693 12923 raft_consensus.cc:385] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.626998 12923 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.612016 13175 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:19.627632 12923 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.630203 12923 ts_tablet_manager.cc:1434] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:06:19.628086 12985 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.621166 12922 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.631528 12923 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:19.631052 12985 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.636682 12925 tablet_bootstrap.cc:654] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.641197 12922 ts_tablet_manager.cc:1434] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:06:19.642961 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.643795 12880 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:19.644886 13175 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.641430 12985 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.650045 12922 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:19.652201 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:19.649848 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.660535 13139 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.663573 13139 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.661768 13144 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.671660 12882 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:19.665069 12730 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:19.677495 12882 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.677021 13139 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.670852 13144 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.678228 13144 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.680352 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:19.690229 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:19.691854 12773 leader_election.cc:343] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.690297 13169 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:19.680418 13140 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:06:19.697445 12771 leader_election.cc:343] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.697947 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:19.718291 12922 tablet_bootstrap.cc:654] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.718555 12925 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:19.720719 12925 ts_tablet_manager.cc:1403] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.006s
I20260709 13:06:19.737277 12923 tablet_bootstrap.cc:654] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.741597 13125 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.742185 13125 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.745563 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.746227 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:19.747951 13125 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:19.747732 13145 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:19.729862 12985 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.752257 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:19.753976 13130 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.751941 12925 raft_consensus.cc:359] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.756990 12925 raft_consensus.cc:385] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.757934 12925 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.759100 12925 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.784420 12925 ts_tablet_manager.cc:1434] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.002s
I20260709 13:06:19.787395 12628 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.798434 12925 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:19.786350 13144 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.806442 13144 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.810479 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:19.811295 12731 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.822125 12733 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:19.829749 12985 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:19.840870 12696 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.841224 12922 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:19.841898 12922 ts_tablet_manager.cc:1403] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.017s
I20260709 13:06:19.857991 13137 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:19.871304 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:19.877851 12731 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:19.875274 13140 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.883651 13140 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.885864 13140 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:19.888682 12922 raft_consensus.cc:359] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.889467 12922 raft_consensus.cc:385] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.889741 12922 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.890554 12922 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.891455 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:19.892215 12733 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:19.894321 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:19.895385 13144 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.895736 13144 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.896066 13144 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.899735 13137 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.914466 12925 tablet_bootstrap.cc:654] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.916225 12922 ts_tablet_manager.cc:1434] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.001s
W20260709 13:06:19.898645 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 109143us
I20260709 13:06:19.921547 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:19.923158 13145 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.923588 12922 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:19.904887 13137 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.923681 13145 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:19.928941 13145 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:19.972718 12923 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:19.973492 12923 ts_tablet_manager.cc:1403] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.342s	user 0.041s	sys 0.038s
I20260709 13:06:19.965751 13140 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.975821 13140 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.010381 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:20.011168 12881 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.014133 12922 tablet_bootstrap.cc:654] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.017300 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.018251 13139 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.968652 13144 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.042466 13140 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.031489 12806 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:20.040096 13137 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.036458 13139 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.050009 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.055245 13144 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.064800 12925 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.065104 13137 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.065853 12925 ts_tablet_manager.cc:1403] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.268s	user 0.029s	sys 0.071s
I20260709 13:06:20.065757 13137 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.059372 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.067281 12699 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:20.070561 13169 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.071004 13169 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.071369 13169 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.071952 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:20.073657 13137 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.071600 12923 raft_consensus.cc:359] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.074483 12923 raft_consensus.cc:385] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.074864 12923 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.076162 12923 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.077622 13139 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.079649 12923 ts_tablet_manager.cc:1434] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.014s
I20260709 13:06:20.102715 12923 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:20.109967 12925 raft_consensus.cc:359] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:20.110080 12696 leader_election.cc:343] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.110706 12925 raft_consensus.cc:385] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.111023 12925 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.111599 12925 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.114089 12922 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:20.114635 12922 ts_tablet_manager.cc:1403] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.191s	user 0.016s	sys 0.012s
I20260709 13:06:20.116406 12881 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.121488 12925 ts_tablet_manager.cc:1434] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:06:20.114975 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:20.109666 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.122382 13096 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.125505 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:20.125973 12731 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.129878 13096 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:20.116465 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47651us
I20260709 13:06:20.163386 12730 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:20.166301 12923 tablet_bootstrap.cc:654] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.163578 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:20.171103 13169 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.175396 13096 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:20.179476 12699 leader_election.cc:343] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.181387 13169 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.183107 12629 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.185290 13211 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.187270 12922 raft_consensus.cc:359] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.188421 12922 raft_consensus.cc:385] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:20.188468 12771 leader_election.cc:343] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.189081 12922 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.191071 12922 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.192286 12925 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:20.190078 13210 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:20.194039 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.201876 12805 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:20.204424 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.205169 12882 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:20.205550 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.198642 12773 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:20.206754 12773 leader_election.cc:343] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.208822 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:20.209746 13211 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.209887 12805 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.210119 13211 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.210474 13211 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.218266 12805 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:20.209194 12699 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:20.219676 13169 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.219578 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.220669 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:20.223668 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.226033 12922 ts_tablet_manager.cc:1434] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.003s
I20260709 13:06:20.240696 12699 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:20.241403 12922 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:20.241616 13206 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.243770 13206 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:20.228520 13175 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:06:20.244634 13206 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:20.250578 12771 leader_election.cc:343] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.222909 13169 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.254230 13169 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:20.251327 12771 leader_election.cc:343] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.264479 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.265964 13145 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.262677 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:20.278975 12731 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:20.283443 12923 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:20.284080 12923 ts_tablet_manager.cc:1403] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.016s
I20260709 13:06:20.287298 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.292763 13140 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.293300 13140 raft_consensus.cc:697] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:20.294184 13140 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.296613 12923 raft_consensus.cc:359] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.297276 12923 raft_consensus.cc:385] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.297511 12923 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.298290 12923 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.302367 12923 ts_tablet_manager.cc:1434] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:06:20.303323 12923 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
W20260709 13:06:20.317217 12696 leader_election.cc:343] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.320757 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.323081 13096 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:20.322854 12696 leader_election.cc:343] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:20.332636 12696 leader_election.cc:343] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.344671 12628 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.346267 12925 tablet_bootstrap.cc:654] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.348838 13211 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.352968 12922 tablet_bootstrap.cc:654] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:20.355499 12696 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.361974 12923 tablet_bootstrap.cc:654] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.365499 12879 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.366343 13211 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.367821 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:20.368502 12877 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.371851 13169 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.373596 12627 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.379120 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:20.379622 13169 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.379710 12805 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.382081 12925 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.382647 12925 ts_tablet_manager.cc:1403] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.210s	user 0.011s	sys 0.001s
I20260709 13:06:20.389583 12925 raft_consensus.cc:359] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.390386 12925 raft_consensus.cc:385] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.390664 12925 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.396749 12925 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.400337 12925 ts_tablet_manager.cc:1434] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:06:20.401592 12925 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:20.405391 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:20.406113 12731 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.414436 13144 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:20.418313 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:20.424736 12923 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:20.425209 12923 ts_tablet_manager.cc:1403] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.015s
W20260709 13:06:20.426154 12696 leader_election.cc:343] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.427317 12877 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:20.428685 12923 raft_consensus.cc:359] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.436110 12923 raft_consensus.cc:385] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.436549 12923 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.436765 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:20.437786 13144 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.437490 12923 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.438323 13144 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:20.440094 13169 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.440641 13169 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.441520 12923 ts_tablet_manager.cc:1434] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:06:20.443082 12923 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:20.439692 13144 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.446688 12925 tablet_bootstrap.cc:654] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.442589 12731 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:20.429610 12805 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:20.468621 13169 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.470877 12922 tablet_bootstrap.cc:492] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:20.473834 12699 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.479651 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:20.481791 12696 leader_election.cc:343] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.486397 12922 ts_tablet_manager.cc:1403] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.245s	user 0.019s	sys 0.004s
I20260709 13:06:20.493477 13169 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.511855 13169 raft_consensus.cc:697] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:20.512501 13211 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.515741 12923 tablet_bootstrap.cc:654] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.525449 13169 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.532922 12922 raft_consensus.cc:359] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.533696 12922 raft_consensus.cc:385] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.534013 12922 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.534811 12922 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.537238 12922 ts_tablet_manager.cc:1434] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:06:20.537420 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.538280 12922 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:20.538386 12805 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:20.543407 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.546595 13096 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.547055 13096 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.547573 13096 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.557760 12925 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.558555 12925 ts_tablet_manager.cc:1403] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.157s	user 0.023s	sys 0.002s
I20260709 13:06:20.556131 12630 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.593106 12925 raft_consensus.cc:359] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.593890 12925 raft_consensus.cc:385] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.593780 13125 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.594347 12925 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.594640 13125 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.595077 12925 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.600018 13137 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.605014 13137 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.607100 13137 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.600736 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:20.596961 13125 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:20.603142 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.610383 12806 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:20.609054 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:20.614030 12699 leader_election.cc:343] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.614990 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:20.622851 13096 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.623818 12923 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:20.624347 12923 ts_tablet_manager.cc:1403] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.182s	user 0.018s	sys 0.014s
I20260709 13:06:20.627159 12922 tablet_bootstrap.cc:654] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.628582 13125 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.630059 12923 raft_consensus.cc:359] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.630805 12923 raft_consensus.cc:385] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.630733 12925 ts_tablet_manager.cc:1434] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.003s
I20260709 13:06:20.631094 12923 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.632584 12923 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.635419 12923 ts_tablet_manager.cc:1434] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:20.635686 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:20.636442 12923 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:20.636391 12805 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.648394 12925 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:20.655218 12923 tablet_bootstrap.cc:654] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.664427 13125 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:20.668851 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53975.7us
I20260709 13:06:20.674089 13096 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.679809 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.682562 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:20.683940 12696 leader_election.cc:343] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.688555 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.691061 13175 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.694451 12925 tablet_bootstrap.cc:654] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.703891 12630 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:20.707679 12771 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.710208 13175 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.713439 12805 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:20.698941 13096 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.716408 12696 leader_election.cc:343] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.720937 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.724160 13137 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.724721 13137 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:20.720641 13096 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.725528 13137 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.726018 12922 tablet_bootstrap.cc:492] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:20.726595 12922 ts_tablet_manager.cc:1403] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.189s	user 0.023s	sys 0.032s
I20260709 13:06:20.728425 13211 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:20.728828 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:20.731685 13096 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.733866 12923 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
W20260709 13:06:20.734503 12696 leader_election.cc:343] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.728958 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.735307 12923 ts_tablet_manager.cc:1403] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.008s
I20260709 13:06:20.739436 12925 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.761936 12925 ts_tablet_manager.cc:1403] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.006s
I20260709 13:06:20.764621 12923 raft_consensus.cc:359] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.765595 12923 raft_consensus.cc:385] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.765906 12923 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.778474 13137 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:20.753764 12805 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:20.789891 12922 raft_consensus.cc:359] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.790741 12922 raft_consensus.cc:385] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.791020 12922 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.791756 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.791739 12922 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.793066 13175 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.793468 13175 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.793655 12922 ts_tablet_manager.cc:1434] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.004s
I20260709 13:06:20.793848 13175 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.794988 12922 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:20.770081 12925 raft_consensus.cc:359] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.797353 12925 raft_consensus.cc:385] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.797676 12925 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.798367 12925 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.766655 12923 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.801380 12923 ts_tablet_manager.cc:1434] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:06:20.802294 12923 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:20.803283 12629 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.805369 12925 ts_tablet_manager.cc:1434] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:06:20.806484 12925 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:20.812179 12922 tablet_bootstrap.cc:654] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.835711 12925 tablet_bootstrap.cc:654] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.836301 12923 tablet_bootstrap.cc:654] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.845332 13211 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.845950 13211 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.850024 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:20.851871 12771 leader_election.cc:343] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.856590 13229 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.857123 12925 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.857717 12925 ts_tablet_manager.cc:1403] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:06:20.857306 13229 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.860869 12925 raft_consensus.cc:359] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.861675 12925 raft_consensus.cc:385] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.861974 12925 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.862736 12925 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.864306 13229 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:20.866322 13211 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.867867 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:20.868935 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:20.869526 12925 ts_tablet_manager.cc:1434] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:20.871040 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:20.872087 13230 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.875221 12923 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:20.875571 12925 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:20.875747 12923 ts_tablet_manager.cc:1403] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.004s
I20260709 13:06:20.882474 12923 raft_consensus.cc:359] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.884251 12922 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:20.897799 12922 ts_tablet_manager.cc:1403] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.017s
I20260709 13:06:20.897576 12923 raft_consensus.cc:385] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.898514 12923 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.899431 12923 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.900699 12922 raft_consensus.cc:359] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.901433 12922 raft_consensus.cc:385] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.901726 12922 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.902480 12922 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.903541 12923 ts_tablet_manager.cc:1434] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:06:20.803962 13175 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.890973 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:20.905043 12922 ts_tablet_manager.cc:1434] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:20.909276 12731 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:20.909973 12922 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:20.913276 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:20.914742 12696 leader_election.cc:343] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.917299 12922 tablet_bootstrap.cc:654] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.918437 13175 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.919829 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:20.920517 12806 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.888067 12925 tablet_bootstrap.cc:654] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:20.926076 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:20.936020 13137 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.936786 13137 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.941918 13137 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.943638 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:20.945444 12696 leader_election.cc:343] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.949823 12925 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:20.950474 12925 ts_tablet_manager.cc:1403] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 13:06:20.955015 12925 raft_consensus.cc:359] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.956395 13144 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.957062 13144 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.962236 12923 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:20.960943 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:20.966300 13211 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.966800 13211 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.967232 13211 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.967724 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:20.969874 12771 leader_election.cc:343] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.970577 13144 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:20.955928 12925 raft_consensus.cc:385] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.971850 12925 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.972927 12925 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:20.975710 12925 ts_tablet_manager.cc:1434] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:06:20.984316 12925 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:21.004856 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.013902 12925 tablet_bootstrap.cc:654] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.026649 12925 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:21.027273 12925 ts_tablet_manager.cc:1403] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.003s
I20260709 13:06:21.033228 13211 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.036350 12806 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:21.047457 13140 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.048224 13140 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.050264 13175 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.050846 13175 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.053543 13140 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.055303 13175 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.060235 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:21.062307 12696 leader_election.cc:343] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.068707 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:21.072774 12771 leader_election.cc:343] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.073202 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:21.074492 12803 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
W20260709 13:06:21.080998 12696 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.073319 12925 raft_consensus.cc:359] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.083985 12925 raft_consensus.cc:385] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.084559 12925 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.090265 12925 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.119236 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:21.120028 12802 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:21.128275 12925 ts_tablet_manager.cc:1434] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.101s	user 0.002s	sys 0.008s
I20260709 13:06:21.134739 13145 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.135327 13145 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.137617 13145 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.139209 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:21.140213 13230 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.140918 12771 leader_election.cc:343] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.140762 13230 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.141810 12879 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.142961 13230 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:21.148871 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:21.155010 12922 tablet_bootstrap.cc:492] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:21.155637 12922 ts_tablet_manager.cc:1403] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.246s	user 0.073s	sys 0.132s
I20260709 13:06:21.156886 13211 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.173779 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.175536 12923 tablet_bootstrap.cc:654] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.178833 12925 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:21.180966 12878 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.188997 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:21.189708 12728 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.192891 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.194193 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:21.197458 12773 leader_election.cc:343] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.197952 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:21.189061 12771 leader_election.cc:343] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.200979 12925 tablet_bootstrap.cc:654] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.203193 13144 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:21.202972 12922 raft_consensus.cc:359] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.203965 12922 raft_consensus.cc:385] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.204298 12922 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.205083 12922 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.207051 12923 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:21.207000 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.207782 12923 ts_tablet_manager.cc:1403] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.005s
I20260709 13:06:21.207989 12732 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:21.208343 12922 ts_tablet_manager.cc:1434] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:06:21.209285 12922 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:21.210819 12923 raft_consensus.cc:359] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.211570 12923 raft_consensus.cc:385] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.211844 13169 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.212428 13169 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:21.213301 13169 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.211941 12923 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.216902 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.219317 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.220938 13175 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.221295 13175 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.221604 13175 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.225561 13144 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.227387 12925 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:21.228008 12925 ts_tablet_manager.cc:1403] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 13:06:21.217774 12923 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.230189 13175 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.231287 12732 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:21.232785 13175 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.231294 12925 raft_consensus.cc:359] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.233618 12925 raft_consensus.cc:385] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.233978 12925 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.234743 12925 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.235275 12728 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:21.237720 12925 ts_tablet_manager.cc:1434] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:06:21.240293 13144 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.241436 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.243373 13096 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.244379 12923 ts_tablet_manager.cc:1434] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:06:21.244712 13096 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.245129 13096 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.245478 13096 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.245659 12923 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:21.247094 12925 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:21.250205 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.262400 12923 tablet_bootstrap.cc:654] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.253402 13244 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.273181 13244 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.273576 13244 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.270117 12922 tablet_bootstrap.cc:654] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.284217 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.284634 13251 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:21.289712 12696 leader_election.cc:343] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:21.304821 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47407us
I20260709 13:06:21.306090 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.308507 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.311122 12923 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:21.311887 12923 ts_tablet_manager.cc:1403] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.067s	user 0.004s	sys 0.013s
I20260709 13:06:21.309859 13140 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.314469 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:21.313313 13140 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.320546 13140 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.315944 13145 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.316920 13230 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:21.353067 12923 raft_consensus.cc:359] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.354053 12923 raft_consensus.cc:385] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.354437 12923 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.333401 13145 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:21.359015 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:21.357981 12923 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.339751 13096 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.381449 12923 ts_tablet_manager.cc:1434] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.005s
I20260709 13:06:21.352850 13140 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.389632 12630 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.393364 12923 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:21.382854 13230 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.395882 13244 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.363111 13145 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.416744 12922 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:21.421339 12922 ts_tablet_manager.cc:1403] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.212s	user 0.038s	sys 0.014s
I20260709 13:06:21.422842 12806 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:21.427922 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:21.433396 13096 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.434701 13244 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.408633 13230 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.430045 12732 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:21.442499 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58014.7us
I20260709 13:06:21.450037 12925 tablet_bootstrap.cc:654] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.458662 12922 raft_consensus.cc:359] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.459874 12922 raft_consensus.cc:385] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.460317 12922 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.461328 12922 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.449198 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.449201 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.476189 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.467226 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:21.485108 13263 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:06:21.490016 12771 leader_election.cc:343] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:21.491439 12771 leader_election.cc:343] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.471771 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:21.487464 13230 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:21.478016 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.495571 12923 tablet_bootstrap.cc:654] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:21.500530 12696 leader_election.cc:343] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.501766 12922 ts_tablet_manager.cc:1434] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.013s
I20260709 13:06:21.496956 13140 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.497422 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.503732 13253 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.504061 12731 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:21.504268 13253 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.502915 12804 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.508265 13253 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.512130 12922 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:21.515928 12925 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:21.516481 12925 ts_tablet_manager.cc:1403] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.270s	user 0.014s	sys 0.016s
I20260709 13:06:21.519026 12804 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:21.526204 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:21.527700 13144 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.534669 13144 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.526588 12925 raft_consensus.cc:359] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.536132 12925 raft_consensus.cc:385] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.536391 12925 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.536945 13144 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.537477 12732 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:21.537192 12925 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.545388 12925 ts_tablet_manager.cc:1434] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:06:21.549340 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.550320 12733 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:21.552960 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.554425 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.555397 13260 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.555791 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:21.556869 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:21.560262 12925 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:21.560374 12800 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 1: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:21.556299 13140 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:21.563364 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.566239 13175 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.566771 13175 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:21.567590 13175 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.563644 13260 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:21.559190 13145 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.563835 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.587392 13260 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.585460 12731 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:21.590829 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:21.593779 12771 leader_election.cc:343] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.579476 13145 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.596298 13266 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.602391 12923 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
W20260709 13:06:21.602752 12696 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.602968 12923 ts_tablet_manager.cc:1403] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.008s
I20260709 13:06:21.597347 13145 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.626322 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:21.648851 13266 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:21.650750 12771 leader_election.cc:343] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.668326 12923 raft_consensus.cc:359] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.669160 12923 raft_consensus.cc:385] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.669437 12923 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.671300 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.670280 12923 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.674295 13262 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.674696 13262 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.675017 13262 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.694707 13145 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:21.701628 13273 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:06:21.705237 13145 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.706174 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:21.707873 12771 leader_election.cc:343] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.710562 12923 ts_tablet_manager.cc:1434] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.022s
I20260709 13:06:21.716003 12882 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.716270 12925 tablet_bootstrap.cc:654] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.724277 12922 tablet_bootstrap.cc:654] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.728806 12627 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.734776 12923 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:21.756845 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:21.757782 12729 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.777793 13169 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:21.806735 13145 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.807864 13145 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.792973 13262 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.817687 13175 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:21.838124 12923 tablet_bootstrap.cc:654] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.842693 12922 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:21.843245 12922 ts_tablet_manager.cc:1403] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.336s	user 0.025s	sys 0.001s
I20260709 13:06:21.843320 12925 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:21.843971 12925 ts_tablet_manager.cc:1403] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.284s	user 0.025s	sys 0.047s
I20260709 13:06:21.849690 12925 raft_consensus.cc:359] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.853662 12925 raft_consensus.cc:385] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.854135 12925 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.856244 12925 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.864773 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:21.849854 12627 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.852527 13262 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:21.867547 12771 leader_election.cc:343] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.868536 12922 raft_consensus.cc:359] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.856148 13145 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.873216 12922 raft_consensus.cc:385] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.874469 12922 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.876780 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:21.879245 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:21.875192 12922 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:21.880903 12771 leader_election.cc:343] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.881707 12925 ts_tablet_manager.cc:1434] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:06:21.875463 13262 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.886780 12925 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:21.886718 12922 ts_tablet_manager.cc:1434] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.005s
I20260709 13:06:21.888940 13262 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.893204 12922 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:21.893926 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:21.894205 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:21.895267 12771 leader_election.cc:343] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.892938 13262 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:21.892829 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:21.897290 12773 leader_election.cc:343] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.897765 12773 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.884934 12731 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.901048 13260 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:21.899036 12773 leader_election.cc:343] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:21.902736 12773 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.903963 13144 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:21.910121 12923 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:21.910691 12923 ts_tablet_manager.cc:1403] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.176s	user 0.033s	sys 0.009s
I20260709 13:06:21.912956 12731 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:21.922485 12729 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:21.926576 12923 raft_consensus.cc:359] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.927462 12923 raft_consensus.cc:385] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.927747 12923 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.929030 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.930179 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:21.932736 13144 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.933314 13144 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:21.928825 12923 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.934201 13144 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.935537 12923 ts_tablet_manager.cc:1434] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:06:21.936851 12923 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:21.938683 13260 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.947158 12922 tablet_bootstrap.cc:654] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.947763 12925 tablet_bootstrap.cc:654] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.954334 12923 tablet_bootstrap.cc:654] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.943871 13260 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:21.966352 13260 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:21.989852 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:21.993713 12922 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:21.993788 12925 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:21.994282 12922 ts_tablet_manager.cc:1403] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.007s
I20260709 13:06:21.994488 12925 ts_tablet_manager.cc:1403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.004s
I20260709 13:06:21.995185 12923 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:21.995723 12923 ts_tablet_manager.cc:1403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.010s
I20260709 13:06:21.995642 13229 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.996486 13229 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.997613 12925 raft_consensus.cc:359] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:21.999491 12925 raft_consensus.cc:385] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.977504 12627 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.999858 12923 raft_consensus.cc:359] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.000783 12923 raft_consensus.cc:385] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.001089 12923 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.001186 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.001866 12923 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.003754 13229 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:22.005199 12923 ts_tablet_manager.cc:1434] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:06:22.006521 12923 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:22.009521 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:21.999855 12925 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.010843 12925 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.012131 12847 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:22.012954 13266 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:22.013288 12925 ts_tablet_manager.cc:1434] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:06:22.013657 12923 tablet_bootstrap.cc:654] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.015204 12925 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:22.028937 12771 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.033519 12925 tablet_bootstrap.cc:654] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.035959 12630 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.038473 12630 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.043085 12922 raft_consensus.cc:359] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.043872 12922 raft_consensus.cc:385] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.044189 12922 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.048528 12925 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:22.049170 12925 ts_tablet_manager.cc:1403] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.000s
I20260709 13:06:22.049167 13260 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:22.052438 12922 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.052767 12925 raft_consensus.cc:359] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.053722 12925 raft_consensus.cc:385] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.054078 12925 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.054868 12925 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.061192 12925 ts_tablet_manager.cc:1434] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:22.062377 12925 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:22.072389 12925 tablet_bootstrap.cc:654] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.076964 13169 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.077838 13169 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.081498 13169 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.084442 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:22.090986 12771 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.095248 12922 ts_tablet_manager.cc:1434] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.003s
W20260709 13:06:22.095955 12696 leader_election.cc:343] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.107139 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.108368 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:22.128381 12922 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:22.130159 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.135342 13096 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.135977 13096 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.136382 13096 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.146040 12925 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:22.146728 12925 ts_tablet_manager.cc:1403] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.008s
I20260709 13:06:22.154569 12925 raft_consensus.cc:359] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.156546 13169 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.161386 12925 raft_consensus.cc:385] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.161978 12925 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.162485 13169 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.166945 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:22.167512 13169 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:22.168517 12696 leader_election.cc:343] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.169939 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.170372 13209 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:22.170644 12802 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:22.172310 12925 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.172973 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.173770 13137 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.171766 13096 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.174459 13137 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.174841 13137 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.176851 12923 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:22.177397 12923 ts_tablet_manager.cc:1403] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.171s	user 0.060s	sys 0.076s
I20260709 13:06:22.181939 12923 raft_consensus.cc:359] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.185792 13096 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.199187 12923 raft_consensus.cc:385] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.199527 12923 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.200273 12923 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.188454 13137 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.203768 12923 ts_tablet_manager.cc:1434] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 13:06:22.204481 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:22.204881 12923 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:22.205147 12804 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.179107 12925 ts_tablet_manager.cc:1434] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 13:06:22.210979 12876 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.215535 13144 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.217407 13144 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.217792 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:22.220194 12696 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:22.221439 12696 leader_election.cc:343] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.233143 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:22.233839 12925 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:22.235080 12771 leader_election.cc:343] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.239784 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:22.240509 12729 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:22.243902 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.228878 13144 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.244925 13253 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.245381 13253 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.245733 13253 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.246230 13137 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.249255 12922 tablet_bootstrap.cc:654] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.251914 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:22.252532 12806 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.252539 13261 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:22.260198 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:22.271369 12806 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:22.272892 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:22.274394 13137 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:22.274845 13137 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:22.275959 12696 leader_election.cc:343] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.275667 13137 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.287521 13209 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.288015 13209 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.269434 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:22.289609 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.289976 13209 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.291286 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:22.292644 12923 tablet_bootstrap.cc:654] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:22.293231 12696 leader_election.cc:343] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.296139 13209 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:22.297907 13209 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:22.297498 13260 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.302800 13209 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.298949 13260 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.305692 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.306440 12804 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:22.309046 13260 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.309826 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:22.310331 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:22.313853 12771 leader_election.cc:343] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:22.316732 12773 leader_election.cc:343] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.317358 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.319386 12699 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.322875 13253 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.323920 12925 tablet_bootstrap.cc:654] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.325932 13096 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.326305 13096 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.326661 13096 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.325318 13260 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:22.343755 12922 tablet_bootstrap.cc:492] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:22.344089 13096 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.344591 12922 ts_tablet_manager.cc:1403] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.035s
I20260709 13:06:22.347404 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:22.347615 12922 raft_consensus.cc:359] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.348062 12802 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.348495 12922 raft_consensus.cc:385] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.348835 12922 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.349653 12922 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.351729 12922 ts_tablet_manager.cc:1434] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:22.354329 12922 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:22.358505 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:22.359972 12771 leader_election.cc:343] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.360626 13253 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.363792 12922 tablet_bootstrap.cc:654] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.366606 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:22.367280 12729 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.369640 12925 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:22.370014 12923 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:22.370172 12925 ts_tablet_manager.cc:1403] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.000s
I20260709 13:06:22.370776 12923 ts_tablet_manager.cc:1403] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.013s
I20260709 13:06:22.375720 12922 tablet_bootstrap.cc:492] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:22.373605 12925 raft_consensus.cc:359] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.379268 12922 ts_tablet_manager.cc:1403] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 13:06:22.379241 12925 raft_consensus.cc:385] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.381065 12925 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.373970 12923 raft_consensus.cc:359] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.383083 12923 raft_consensus.cc:385] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.383430 12923 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.383399 12925 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.384958 12923 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.386595 12925 ts_tablet_manager.cc:1434] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:06:22.384572 12922 raft_consensus.cc:359] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.387109 12922 raft_consensus.cc:385] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.387406 12922 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.387696 12925 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:22.387877 12923 ts_tablet_manager.cc:1434] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:06:22.388195 12922 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.389678 12922 ts_tablet_manager.cc:1434] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:22.390473 12922 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:22.395414 12925 tablet_bootstrap.cc:654] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.400800 12922 tablet_bootstrap.cc:654] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.400491 12876 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.402715 12923 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:22.410434 12923 tablet_bootstrap.cc:654] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.451103 12877 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.454955 12923 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:22.455631 12923 ts_tablet_manager.cc:1403] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.002s
I20260709 13:06:22.459203 12923 raft_consensus.cc:359] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.467274 12923 raft_consensus.cc:385] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.467648 12923 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.468333 12923 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.470120 12923 ts_tablet_manager.cc:1434] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:06:22.471148 12923 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:22.484469 13096 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.486213 12923 tablet_bootstrap.cc:654] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.488274 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:22.447798 12802 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:22.502025 12729 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
W20260709 13:06:22.547245 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48059us
W20260709 13:06:22.547982 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53233.1us
W20260709 13:06:22.553087 12696 leader_election.cc:343] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.565047 12628 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.568189 12923 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:22.568642 12923 ts_tablet_manager.cc:1403] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.004s
I20260709 13:06:22.570995 12699 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.574134 12628 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.575839 13096 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:22.586542 12922 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:22.587102 12922 ts_tablet_manager.cc:1403] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.197s	user 0.062s	sys 0.076s
I20260709 13:06:22.574059 13262 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.640234 12923 raft_consensus.cc:359] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.647745 12923 raft_consensus.cc:385] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.648290 12923 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.654258 12925 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:22.654877 12925 ts_tablet_manager.cc:1403] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.267s	user 0.090s	sys 0.111s
I20260709 13:06:22.656191 12922 raft_consensus.cc:359] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.657071 12922 raft_consensus.cc:385] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.657415 12922 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.606221 13262 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.649179 12923 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.671777 12922 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.614063 13096 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:22.694687 12923 ts_tablet_manager.cc:1434] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.126s	user 0.010s	sys 0.001s
I20260709 13:06:22.697008 12923 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:22.703003 12922 ts_tablet_manager.cc:1434] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
W20260709 13:06:22.703200 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46936.7us
I20260709 13:06:22.707314 13314 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.728403 12925 raft_consensus.cc:359] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.729223 12925 raft_consensus.cc:385] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.729534 12925 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.723781 13313 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.731315 13314 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:22.765192 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60972us
I20260709 13:06:22.755815 13314 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:22.779024 13262 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.779373 13319 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.779958 13319 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:22.787454 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115623us
I20260709 13:06:22.765125 12877 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.750548 13175 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.742909 13313 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.791257 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:22.797012 13312 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:22.797636 13312 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:22.798743 13312 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.801913 12922 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:22.807915 12925 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.809958 13230 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:22.810680 13230 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.817854 13175 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.828012 13175 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.818222 13319 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:22.821897 13313 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:22.822978 12923 tablet_bootstrap.cc:654] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.825405 13096 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:22.850579 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:22.837785 13230 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:22.839303 12925 ts_tablet_manager.cc:1434] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.184s	user 0.006s	sys 0.005s
I20260709 13:06:22.855516 12925 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:22.861912 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.862747 12802 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:22.865945 12922 tablet_bootstrap.cc:654] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.867975 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.868697 12802 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:22.869171 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.879776 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:22.885108 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:22.887784 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 145486us
I20260709 13:06:22.889780 12925 tablet_bootstrap.cc:654] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:22.894644 12771 leader_election.cc:343] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:22.908882 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:22.919817 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:22.908221 13260 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:22.895792 13324 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:06:22.941926 13309 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:06:22.950196 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54747.4us
I20260709 13:06:22.923456 13318 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.923566 13209 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:22.958374 12882 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:22.963465 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52057.8us
I20260709 13:06:22.963814 13209 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.961279 13318 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.974781 13209 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.978693 13318 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:22.968479 13253 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:23.011592 12922 tablet_bootstrap.cc:492] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:23.012225 12922 ts_tablet_manager.cc:1403] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.211s	user 0.025s	sys 0.011s
I20260709 13:06:23.018699 12923 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:23.018599 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:23.019239 12923 ts_tablet_manager.cc:1403] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.322s	user 0.028s	sys 0.010s
I20260709 13:06:23.021935 12923 raft_consensus.cc:359] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.022573 12923 raft_consensus.cc:385] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:23.022758 13333 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:23.022852 12923 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.023552 12923 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:23.047086 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91644.7us
I20260709 13:06:23.026993 13318 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.050194 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:23.051566 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:23.053213 12771 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.055215 12923 ts_tablet_manager.cc:1434] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
W20260709 13:06:23.056293 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91308.2us
W20260709 13:06:23.057058 12773 leader_election.cc:343] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.057468 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:23.058668 12925 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:23.059212 12925 ts_tablet_manager.cc:1403] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.204s	user 0.029s	sys 0.013s
I20260709 13:06:23.058251 13144 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:23.073280 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 132438us
I20260709 13:06:23.077790 13318 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.084890 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.139204 13337 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.139914 13337 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.155956 13319 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.170578 13319 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:23.195665 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 103040us
W20260709 13:06:23.198662 12696 leader_election.cc:343] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.141857 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:23.207051 12925 raft_consensus.cc:359] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.207765 12925 raft_consensus.cc:385] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.208209 12925 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.213796 12922 raft_consensus.cc:359] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.216909 12922 raft_consensus.cc:385] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.217222 12922 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.218042 12922 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.220674 12922 ts_tablet_manager.cc:1434] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.208s	user 0.007s	sys 0.002s
I20260709 13:06:23.227018 13209 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.229414 13209 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.210454 13318 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.232791 12696 leader_election.cc:343] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.236338 12925 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:23.239212 12696 leader_election.cc:343] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.254230 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.246776 13319 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.232899 13318 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.270358 12923 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:23.270664 13318 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.278525 13337 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.298357 12925 ts_tablet_manager.cc:1434] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.239s	user 0.016s	sys 0.005s
I20260709 13:06:23.301276 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.306282 12925 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:23.306010 12771 leader_election.cc:343] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:23.312100 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86893.2us
I20260709 13:06:23.316915 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.310117 13261 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.326135 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:23.395118 12773 leader_election.cc:343] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.395897 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:23.395041 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.407970 13315 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.411957 13337 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.432996 13313 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.459897 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 138631us
I20260709 13:06:23.339401 13261 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.487243 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:23.488648 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 80689.7us
I20260709 13:06:23.493402 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:23.494215 12806 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.500387 12923 tablet_bootstrap.cc:654] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.452737 13315 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.508982 12806 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:23.465598 13313 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.546259 13261 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.548152 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:23.571499 13345 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.574398 13315 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:23.600816 13345 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:23.619117 12922 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:23.619762 13345 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.659983 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.660876 12733 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:23.675590 12925 tablet_bootstrap.cc:654] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.680768 12922 tablet_bootstrap.cc:654] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.683630 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.684379 12724 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:23.686553 13313 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:23.708703 13313 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:23.709295 13313 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.711615 13313 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:23.727517 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:23.729326 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:23.729599 12847 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:23.731074 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:23.731405 13266 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:23.735914 12696 consensus_peers.cc:597] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.736378 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:23.737314 13336 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:06:23.738579 12696 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.739164 12696 leader_election.cc:343] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.739048 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:23.745797 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:23.747140 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.749432 12923 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:23.750106 12923 ts_tablet_manager.cc:1403] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.480s	user 0.013s	sys 0.014s
I20260709 13:06:23.752306 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:23.734808 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:23.746673 13314 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.778733 13327 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:23.781697 12923 raft_consensus.cc:359] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.783293 12923 raft_consensus.cc:385] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.783645 12923 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.784488 12923 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.786034 12923 ts_tablet_manager.cc:1434] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:06:23.789573 12925 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:23.789842 12923 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:23.790046 12925 ts_tablet_manager.cc:1403] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.485s	user 0.027s	sys 0.042s
I20260709 13:06:23.794607 13328 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.795409 13342 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:23.795785 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:23.772140 13325 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:23.800494 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52447.7us
I20260709 13:06:23.804788 12922 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
W20260709 13:06:23.805362 13357 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:23.805344 12922 ts_tablet_manager.cc:1403] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.021s
I20260709 13:06:23.798401 13342 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.815238 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.811470 12925 raft_consensus.cc:359] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.816206 12925 raft_consensus.cc:385] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.816511 12925 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.817255 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.808341 13325 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.822525 12925 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.832195 12925 ts_tablet_manager.cc:1434] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.003s
I20260709 13:06:23.833784 12925 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
W20260709 13:06:23.834424 12696 leader_election.cc:343] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:23.835798 12696 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.837904 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:23.838579 13314 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:23.839123 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:23.839748 13314 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.842249 12925 tablet_bootstrap.cc:654] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.822022 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:23.844359 12876 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.846666 12922 raft_consensus.cc:359] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.847425 12922 raft_consensus.cc:385] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.847687 12922 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.848469 12922 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:23.853397 12771 leader_election.cc:343] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.857299 12922 ts_tablet_manager.cc:1434] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.002s
I20260709 13:06:23.858498 12922 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:23.859225 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:23.859964 12800 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.865728 12922 tablet_bootstrap.cc:654] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.866647 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 90) took 1410 ms. Trace:
I20260709 13:06:23.867133 12630 rpcz_store.cc:276] 0709 13:06:22.456699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.476717 (+ 20018us) service_pool.cc:224] Handling call
0709 13:06:23.866536 (+1389819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377537,"reported_tablets":1}
I20260709 13:06:23.818369 13342 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:23.890601 12696 leader_election.cc:343] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.855165 13325 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.965523 12882 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:23.988654 12922 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
W20260709 13:06:24.033877 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55790.2us
I20260709 13:06:24.065542 12923 tablet_bootstrap.cc:700] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent opening tablet: real 0.129s	user 0.013s	sys 0.000s
I20260709 13:06:24.071226 12922 ts_tablet_manager.cc:1403] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.003s
W20260709 13:06:24.071995 12771 consensus_peers.cc:597] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.033787 12628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 72) took 1615 ms. Trace:
I20260709 13:06:24.076380 12923 tablet_bootstrap.cc:654] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.076422 12925 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:24.079216 12925 ts_tablet_manager.cc:1403] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.246s	user 0.023s	sys 0.015s
I20260709 13:06:24.083375 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 105) took 1231 ms. Trace:
I20260709 13:06:24.083762 12627 rpcz_store.cc:276] 0709 13:06:22.851799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.851968 (+   169us) service_pool.cc:224] Handling call
0709 13:06:24.083301 (+1231333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66512,"reported_tablets":12}
I20260709 13:06:24.007714 13325 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:23.990244 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:24.101701 12805 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 1: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:24.106634 13325 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.099364 12802 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:24.015570 13342 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.114087 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:24.116848 13372 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:24.117983 12771 leader_election.cc:343] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:24.122254 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:24.123245 12925 raft_consensus.cc:359] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.124274 12925 raft_consensus.cc:385] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.124639 12925 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.075673 12628 rpcz_store.cc:276] 0709 13:06:22.418307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.418546 (+   239us) service_pool.cc:224] Handling call
0709 13:06:24.033711 (+1615165us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:22.634219 (+     0us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f3eae90ac 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f4562816c
0709 13:06:22.789136 (+154917us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:22.789949 (+   813us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:22.789992 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:06:22.790023 (+    31us) tablet.cc:662] Decoding operations
0709 13:06:22.790546 (+   523us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:22.790625 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:22.790666 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:22.791025 (+   359us) tablet.cc:701] Row locks acquired
0709 13:06:22.791041 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:22.791186 (+   145us) write_op.cc:270] Start()
0709 13:06:22.791389 (+   203us) write_op.cc:276] Timestamp: P: 1783602382791149 usec, L: 0
0709 13:06:22.791411 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:22.842810 (+ 51399us) log.cc:844] Serialized 916 byte log entry
0709 13:06:22.892687 (+ 49877us) op_driver.cc:464] REPLICATION: finished
0709 13:06:23.051856 (+159169us) write_op.cc:301] APPLY: starting
0709 13:06:23.056475 (+  4619us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:23.058087 (+  1612us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:23.058116 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:23.064948 (+  6832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:23.065199 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:23.065270 (+    71us) write_op.cc:312] APPLY: finished
0709 13:06:23.065535 (+   265us) log.cc:844] Serialized 28 byte log entry
0709 13:06:23.065762 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:23.065905 (+   143us) write_op.cc:454] Released schema lock
0709 13:06:23.065951 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:23.066526 (+   575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:23.066567 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":222115,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":151180,"apply.run_cpu_time_us":2367,"apply.run_wall_time_us":19350,"num_ops":2,"prepare.queue_time_us":145633,"prepare.run_cpu_time_us":3711,"prepare.run_wall_time_us":66172,"replication_time_us":101096,"spinlock_wait_cycles":3617536,"thread_start_us":151833,"threads_started":2}]]}
I20260709 13:06:24.127687 13342 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.128173 12922 raft_consensus.cc:359] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.128917 12922 raft_consensus.cc:385] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.129205 12922 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.129595 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:24.130168 12873 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.129869 12922 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.138774 12922 ts_tablet_manager.cc:1434] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:06:24.141018 12879 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.141584 12800 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:24.145125 12925 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.150866 12925 ts_tablet_manager.cc:1434] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:06:24.155283 12922 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:24.162053 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:24.166034 12628 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.169983 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:24.167775 12628 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:06:24.177065 12925 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:24.172873 13318 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.195335 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:24.196112 12731 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.197012 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:24.201858 13209 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.217103 12731 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:24.188369 13378 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.230566 12873 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:24.231716 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:24.213529 13209 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.247121 12922 tablet_bootstrap.cc:654] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.250914 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:24.257841 13352 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.258428 13352 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:24.259307 13352 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:24.267390 13374 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:06:24.231940 13378 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.277964 13262 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.278628 13378 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.311058 13318 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:24.317003 13209 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.310896 13346 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:06:24.318419 13262 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.362725 13262 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.364653 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:24.367606 12771 leader_election.cc:343] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.381891 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:24.342063 12923 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:24.394743 12923 ts_tablet_manager.cc:1403] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.605s	user 0.054s	sys 0.023s
I20260709 13:06:24.406508 12730 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:24.344982 12925 tablet_bootstrap.cc:654] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.345376 13310 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.434393 13310 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:24.435737 13310 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:24.449604 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 160950us
I20260709 13:06:24.472232 12923 raft_consensus.cc:359] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.463514 13266 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:24.486016 12923 raft_consensus.cc:385] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.486549 12923 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
W20260709 13:06:24.485580 12696 leader_election.cc:343] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:24.488476 12696 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.478188 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:24.570575 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 49254us
I20260709 13:06:24.570736 12923 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.494339 13266 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:24.630185 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45782.9us
I20260709 13:06:24.578951 12800 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:24.632747 12923 ts_tablet_manager.cc:1434] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.238s	user 0.010s	sys 0.000s
I20260709 13:06:24.653338 13378 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.657761 12923 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
W20260709 13:06:24.703414 13388 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:24.825621 12923 tablet_bootstrap.cc:654] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.826733 12922 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:24.827353 12922 ts_tablet_manager.cc:1403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.676s	user 0.020s	sys 0.012s
I20260709 13:06:24.829727 13266 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:24.833907 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:24.836174 13378 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.855530 13385 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.856138 13385 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.859412 12922 raft_consensus.cc:359] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.860384 12922 raft_consensus.cc:385] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.860644 12925 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:24.860751 12922 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.861305 12925 ts_tablet_manager.cc:1403] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.693s	user 0.014s	sys 0.009s
I20260709 13:06:24.861665 12922 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.862834 13385 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.867630 12923 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:24.868160 12923 ts_tablet_manager.cc:1403] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.211s	user 0.039s	sys 0.005s
I20260709 13:06:24.870182 12922 ts_tablet_manager.cc:1434] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:06:24.871330 12922 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:24.870909 12923 raft_consensus.cc:359] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.871717 12923 raft_consensus.cc:385] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.872006 12923 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.872761 12923 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.874723 12923 ts_tablet_manager.cc:1434] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:24.878760 12922 tablet_bootstrap.cc:654] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:24.890179 12628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.003s	sys 0.030s
W20260709 13:06:24.890718 12628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.031s
I20260709 13:06:24.893857 12922 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:24.894433 12922 ts_tablet_manager.cc:1403] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:06:24.897848 12922 raft_consensus.cc:359] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.898586 12922 raft_consensus.cc:385] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.898874 12922 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.899551 12922 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.902405 12922 ts_tablet_manager.cc:1434] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:24.908397 13351 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.909060 13351 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.912426 13351 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.913901 12922 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:24.923699 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:24.936861 12925 raft_consensus.cc:359] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.937685 12925 raft_consensus.cc:385] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.937951 12925 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.927313 13252 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.927961 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:24.940886 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:24.939105 12925 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.943499 12925 ts_tablet_manager.cc:1434] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.002s
I20260709 13:06:24.944643 12925 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Bootstrap starting.
I20260709 13:06:24.939281 13252 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.945955 13252 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.950729 12848 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:24.952327 13361 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.956630 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:24.970095 12923 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:24.980927 13252 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.983392 13252 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:24.988829 13392 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.989409 13392 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:24.991518 13392 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:24.995817 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:24.998368 12881 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:25.002840 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.007037 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:25.013284 12696 leader_election.cc:343] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.015935 12881 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.021617 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:25.025542 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:25.026245 13261 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:25.051074 12925 tablet_bootstrap.cc:654] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:25.046232 12771 leader_election.cc:343] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:25.060452 12696 leader_election.cc:343] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.032577 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:25.059437 13353 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.064579 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:25.067456 12880 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.071745 13353 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.072875 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:25.074999 13353 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.091328 12922 tablet_bootstrap.cc:654] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.096135 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:25.100165 12771 leader_election.cc:343] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.103595 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.082868 12808 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.115432 12923 tablet_bootstrap.cc:654] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:25.116986 12696 leader_election.cc:343] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:25.121765 12696 consensus_peers.cc:597] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:25.123664 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:25.124547 12807 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.170328 12808 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:25.184820 12733 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:25.187911 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.192651 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.193513 12733 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:25.189064 13327 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.200963 13261 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.208702 13261 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:25.180864 12807 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:25.209702 13261 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:25.233003 12773 leader_election.cc:343] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.234148 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:25.236821 12699 leader_election.cc:343] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.240854 13209 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.242247 12925 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: No bootstrap required, opened a new log
I20260709 13:06:25.244159 12925 ts_tablet_manager.cc:1403] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent bootstrapping tablet: real 0.300s	user 0.015s	sys 0.015s
I20260709 13:06:25.245087 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:25.248860 12773 leader_election.cc:343] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.250280 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.248929 13345 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.258024 12628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 106) took 1110 ms. Trace:
I20260709 13:06:25.249259 13398 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.254691 13340 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.258415 12628 rpcz_store.cc:276] 0709 13:06:24.148023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.148290 (+   267us) service_pool.cc:224] Handling call
0709 13:06:25.257947 (+1109657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.675795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.706082 (+ 30287us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.706130 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:06:24.706157 (+    27us) tablet.cc:662] Decoding operations
0709 13:06:24.733264 (+ 27107us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.733373 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.733424 (+    51us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:24.747432 (+ 14008us) tablet.cc:701] Row locks acquired
0709 13:06:24.747462 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:06:24.747674 (+   212us) write_op.cc:270] Start()
0709 13:06:24.747832 (+   158us) write_op.cc:276] Timestamp: P: 1783602384747612 usec, L: 0
0709 13:06:24.747861 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.760954 (+ 13093us) log.cc:844] Serialized 916 byte log entry
0709 13:06:24.953577 (+192623us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18000f6d60. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:06:25.105530 (+151953us) op_driver.cc:464] REPLICATION: finished
0709 13:06:25.211464 (+105934us) write_op.cc:301] APPLY: starting
0709 13:06:25.211550 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:25.211677 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:25.211704 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:25.214414 (+  2710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:25.227927 (+ 13513us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:25.227975 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:25.228279 (+   304us) log.cc:844] Serialized 28 byte log entry
0709 13:06:25.238230 (+  9951us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.238345 (+   115us) write_op.cc:454] Released schema lock
0709 13:06:25.238388 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:25.254312 (+ 15924us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.255137 (+   825us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":105687,"apply.run_cpu_time_us":2860,"apply.run_wall_time_us":37991,"num_ops":2,"prepare.queue_time_us":485201,"prepare.run_cpu_time_us":21379,"prepare.run_wall_time_us":184440,"raft.queue_time_us":149205,"raft.run_cpu_time_us":14660,"raft.run_wall_time_us":83547,"replication_time_us":357499,"spinlock_wait_cycles":12215040,"thread_start_us":943838,"threads_started":4,"wal-append.queue_time_us":92151}]]}
I20260709 13:06:25.267969 12922 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.268906 12922 ts_tablet_manager.cc:1403] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.355s	user 0.038s	sys 0.056s
I20260709 13:06:25.271615 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.263605 12627 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.277639 12923 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:25.278276 12923 ts_tablet_manager.cc:1403] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.309s	user 0.017s	sys 0.006s
I20260709 13:06:25.279989 13340 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:25.280622 13340 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.281191 13340 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:25.280141 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:25.281550 12925 raft_consensus.cc:359] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.289129 12925 raft_consensus.cc:385] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.289628 12925 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Initialized, Role: FOLLOWER
W20260709 13:06:25.292527 13402 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:25.274400 13353 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:25.299154 12923 raft_consensus.cc:359] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.300122 12923 raft_consensus.cc:385] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.300431 12923 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.302920 12923 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.285074 13361 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:25.290578 12925 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.316891 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.322018 12923 ts_tablet_manager.cc:1434] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:06:25.323071 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.325119 13252 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.325903 13252 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:25.326306 13347 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.326906 13347 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:25.327764 13347 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.327459 13252 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.337632 12925 ts_tablet_manager.cc:1434] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.003s
I20260709 13:06:25.321537 13361 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.373344 12923 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Bootstrap starting.
I20260709 13:06:25.376688 12922 raft_consensus.cc:359] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.379381 12922 raft_consensus.cc:385] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.379729 12922 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.386426 12922 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.390151 13361 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:25.391961 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.393126 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:25.387027 13340 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.408408 12922 ts_tablet_manager.cc:1434] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.000s
I20260709 13:06:25.413411 13261 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.433651 13261 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.434214 12922 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:25.435992 13261 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.418291 12923 tablet_bootstrap.cc:654] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.420230 13372 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.439211 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.438885 12628 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.439858 12733 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 0.
I20260709 13:06:25.423281 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:25.437028 13372 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.440941 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:25.441215 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:25.442396 13261 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:25.442836 13261 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.443238 13261 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.443564 13372 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.446061 12628 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.441581 12729 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.455467 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:25.457059 12696 leader_election.cc:343] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.460564 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:25.463500 12800 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:25.440297 13340 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.467978 13391 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.468528 13391 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.469863 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.472702 13391 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:25.473819 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.483256 12922 tablet_bootstrap.cc:654] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.469172 13392 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.488996 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:25.492264 13261 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.484254 13372 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:25.494907 13372 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.495304 13372 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.495726 13261 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.496929 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:25.487605 12729 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:25.517387 13372 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.519788 13372 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:25.525692 12922 tablet_bootstrap.cc:492] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.526367 12922 ts_tablet_manager.cc:1403] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.004s
I20260709 13:06:25.519534 12628 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:06:25.534126 12922 raft_consensus.cc:359] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.534935 12922 raft_consensus.cc:385] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.535210 12922 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.544214 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:25.555552 12800 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.555801 12922 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.559324 12922 ts_tablet_manager.cc:1434] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:06:25.552608 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:25.560600 12922 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:25.563024 12800 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:25.564659 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:25.565568 12771 leader_election.cc:343] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.578385 12922 tablet_bootstrap.cc:654] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.581020 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:25.581876 12729 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.589977 13327 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.590516 13327 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.591547 12729 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:25.594775 13327 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:25.596745 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.590509 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:25.603353 12696 leader_election.cc:343] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.605568 13327 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.611347 12922 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.611967 12922 ts_tablet_manager.cc:1403] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.013s
I20260709 13:06:25.615880 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:25.618626 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:25.620654 12771 leader_election.cc:343] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.625029 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:25.630999 12771 leader_election.cc:343] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:25.632283 13337 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.632881 13337 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:25.636626 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.637806 13351 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.638274 12923 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: No bootstrap required, opened a new log
I20260709 13:06:25.638809 13351 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:25.639729 13351 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.642279 12922 raft_consensus.cc:359] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.643046 12922 raft_consensus.cc:385] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.643358 12922 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.639573 13337 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.644104 12922 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.646474 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:25.638827 12923 ts_tablet_manager.cc:1403] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent bootstrapping tablet: real 0.266s	user 0.027s	sys 0.027s
I20260709 13:06:25.647521 13327 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.650952 12923 raft_consensus.cc:359] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.654681 12923 raft_consensus.cc:385] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.655120 12923 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.658223 12923 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.635277 12630 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.646776 12922 ts_tablet_manager.cc:1434] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:06:25.662214 12922 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:25.662602 12923 ts_tablet_manager.cc:1434] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:06:25.663897 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:25.663825 12630 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.669278 12881 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.676213 13372 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.680326 13372 raft_consensus.cc:697] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:25.681365 13372 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.683138 12922 tablet_bootstrap.cc:654] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.723686 12922 tablet_bootstrap.cc:492] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.724187 12922 ts_tablet_manager.cc:1403] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.002s
I20260709 13:06:25.727753 13327 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.728257 13327 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.732249 12630 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.733208 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:25.726819 12922 raft_consensus.cc:359] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.734912 12922 raft_consensus.cc:385] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.734211 12630 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.735206 12922 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.736464 12922 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.738567 12922 ts_tablet_manager.cc:1434] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:06:25.739449 12922 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:25.742738 12627 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.746528 12922 tablet_bootstrap.cc:654] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.747665 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:25.749334 12848 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:25.750392 13392 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.746531 13327 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:25.758410 12922 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.759006 12922 ts_tablet_manager.cc:1403] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:06:25.761792 12922 raft_consensus.cc:359] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.762449 12922 raft_consensus.cc:385] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.762480 12874 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.762764 12922 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.763731 12922 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.765952 12922 ts_tablet_manager.cc:1434] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:25.766983 13351 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.774415 12922 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
W20260709 13:06:25.775408 12696 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:25.791051 12922 tablet_bootstrap.cc:654] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.798730 12881 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:25.818548 12696 consensus_peers.cc:597] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:25.820974 12922 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:25.821512 12922 ts_tablet_manager.cc:1403] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.014s
I20260709 13:06:25.822834 13351 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.833884 13347 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.839385 12922 raft_consensus.cc:359] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.840497 12922 raft_consensus.cc:385] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.840827 12922 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.841583 12922 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:25.844194 12922 ts_tablet_manager.cc:1434] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:06:25.845258 12922 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:25.852074 12922 tablet_bootstrap.cc:654] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:25.864306 13347 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:26.014489 13429 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:26.020753 12922 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:26.023624 12922 ts_tablet_manager.cc:1403] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.179s	user 0.072s	sys 0.070s
I20260709 13:06:26.030392 12922 raft_consensus.cc:359] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.031307 12922 raft_consensus.cc:385] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:26.031672 12922 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.032686 12922 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.035714 12922 ts_tablet_manager.cc:1434] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:26.037096 12922 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:26.049947 12922 tablet_bootstrap.cc:654] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:26.087800 12922 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:26.088418 12922 ts_tablet_manager.cc:1403] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.010s
I20260709 13:06:26.091656 12922 raft_consensus.cc:359] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.092495 12922 raft_consensus.cc:385] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:26.092790 12922 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.093317 13347 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.093598 12922 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.093969 13347 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.096426 12922 ts_tablet_manager.cc:1434] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:26.097311 13347 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:26.098536 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:26.099241 12800 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:26.100088 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:26.100817 12881 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 0.
I20260709 13:06:26.103356 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:26.105041 13372 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:26.105456 13372 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.105871 13372 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.097581 12922 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:26.119968 13372 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.122677 12874 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.122871 13372 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:26.126912 12771 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.128633 12922 tablet_bootstrap.cc:654] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:26.131047 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:26.131755 12804 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.139837 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:26.140681 12876 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.150203 12922 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:26.150943 12922 ts_tablet_manager.cc:1403] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.001s
I20260709 13:06:26.154269 12922 raft_consensus.cc:359] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.155107 12922 raft_consensus.cc:385] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:26.155396 12922 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.156288 12922 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.168166 12922 ts_tablet_manager.cc:1434] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:06:26.170107 12881 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.175666 12922 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
I20260709 13:06:26.176945 12876 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:26.181691 13326 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:26.183279 13327 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.184010 13327 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.186635 13327 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:26.187976 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:26.189815 12922 tablet_bootstrap.cc:654] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:26.192795 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:26.193020 12873 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.194669 12804 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:26.195607 13385 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:26.196125 13385 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:26.196943 13385 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.201550 12882 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.226362 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:26.224344 13353 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:06:26.241232 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:26.239102 12922 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:26.250764 12922 ts_tablet_manager.cc:1403] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.001s
I20260709 13:06:26.275671 12630 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.257457 13327 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:26.262408 13436 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
W20260709 13:06:26.305716 12696 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:26.306283 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45278.3us
I20260709 13:06:26.316294 12922 raft_consensus.cc:359] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.317606 12922 raft_consensus.cc:385] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:26.317997 12922 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.339277 12922 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:26.347369 13437 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:26.363719 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 107328us
I20260709 13:06:26.309911 13326 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:06:26.378190 12922 ts_tablet_manager.cc:1434] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.003s
I20260709 13:06:26.437130 12922 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Bootstrap starting.
W20260709 13:06:26.439515 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 137697us
W20260709 13:06:26.441584 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 61194.4us
I20260709 13:06:26.518322 12922 tablet_bootstrap.cc:654] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:26.523654 12679 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:26.513639 13445 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:26.533617 13445 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.595808 13392 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.596427 13392 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.597677 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:26.599108 13392 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:26.595148 13445 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:26.649102 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:26.666289 12880 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.674700 12922 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: No bootstrap required, opened a new log
I20260709 13:06:26.675305 12922 ts_tablet_manager.cc:1403] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Time spent bootstrapping tablet: real 0.238s	user 0.012s	sys 0.008s
I20260709 13:06:26.679890 12922 raft_consensus.cc:359] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.683374 12922 raft_consensus.cc:385] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:26.683830 12922 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.684561 12922 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.691757 12922 ts_tablet_manager.cc:1434] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:26.693958 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:26.694487 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:26.741868 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:26.743249 13392 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.744104 12847 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:26.746703 13445 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:26.765280 12874 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.838696 13392 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.840535 13392 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:26.865247 12880 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:26.872228 13392 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:26.877852 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:26.878640 13436 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:26.883821 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:26.917060 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:26.974928 13445 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:27.068208 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:06:27.096513 13461 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:06:27.152732 13474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:27.160640 13476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:27.192456 13478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:27.208846 11576 server_base.cc:1061] running on GCE node
I20260709 13:06:27.210807 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:27.211120 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:27.211360 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602387211340 us; error 0 us; skew 500 ppm
I20260709 13:06:27.212270 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:27.228828 11576 webserver.cc:533] Webserver started at http://127.11.78.4:35293/ using document root <none> and password file <none>
I20260709 13:06:27.229493 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:27.229759 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:27.230152 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:27.232337 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-3-root/instance:
uuid: "a865487bf1854df8a5619d42465bb36c"
format_stamp: "Formatted at 2026-07-09 13:06:27 on dist-test-slave-smzk"
I20260709 13:06:27.240217 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:27.255191 13483 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:27.256197 11576 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:06:27.256525 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
uuid: "a865487bf1854df8a5619d42465bb36c"
format_stamp: "Formatted at 2026-07-09 13:06:27 on dist-test-slave-smzk"
I20260709 13:06:27.256862 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:27.305537 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:27.307515 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:27.314083 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:27.318555 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:27.318971 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:27.319324 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:27.319590 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:27.493095 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.4:40809
I20260709 13:06:27.493345 13545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.4:40809 every 8 connection(s)
I20260709 13:06:27.502242 11576 auto_leader_rebalancer-test.cc:384] add a tserver: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:27.526384 13546 heartbeater.cc:344] Connected to a master server at 127.11.78.62:43083
I20260709 13:06:27.527036 13546 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:27.528164 13546 heartbeater.cc:507] Master 127.11.78.62:43083 requested a full tablet report, sending...
I20260709 13:06:27.533361 12627 ts_manager.cc:194] Registered new tserver with Master: a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:27.535384 12627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60338
I20260709 13:06:28.538913 13546 heartbeater.cc:499] Master 127.11.78.62:43083 was elected leader, sending a full tablet report...
I20260709 13:06:28.704515 12726 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:28.752556 12874 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.756220 12804 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.763329 13455 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.769866 13436 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:28.803570 13455 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:06:28.813688 12696 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d23a1e845884d5e9ad733d5579dcf30. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.807792 12800 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:28.822984 12874 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:28.832286 12725 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:28.845855 12627 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.875684 12874 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.878597 13436 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:28.885512 12696 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdd615dc3bb34a41801dd1dd2d6aa16e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.908855 12800 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.908739 13436 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:28.914361 12881 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:28.929814 13455 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:28.948385 12630 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.958058 12808 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:28.965577 12804 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:28.990060 12724 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.992460 13456 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:28.994426 12881 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:28.998870 13550 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:29.056365 12771 consensus_peers.cc:597] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb5990f0ee644c48952ecb885d6a405b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.075202 13456 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.076992 12881 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.088536 12724 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.101362 12628 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.103279 12725 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.129485 12874 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.132174 13347 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:29.144461 12696 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d985ce4f59254503949afda97665ffd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.146888 12808 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.149619 13347 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.160569 13455 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.167959 12874 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.193821 12627 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.200793 12808 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:29.240108 13576 ts_tablet_manager.cc:933] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:29.259912 13576 tablet_copy_client.cc:323] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:29.316170 12743 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 2d23a1e845884d5e9ad733d5579dcf30 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:29.317169 12743 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 2d23a1e845884d5e9ad733d5579dcf30 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-2d23a1e845884d5e9ad733d5579dcf30
I20260709 13:06:29.328559 12743 tablet_copy_source_session.cc:215] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.334141 13576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d23a1e845884d5e9ad733d5579dcf30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.367594 13580 ts_tablet_manager.cc:933] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:29.389366 13576 tablet_copy_client.cc:806] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:29.390635 13576 tablet_copy_client.cc:670] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:29.395028 13580 tablet_copy_client.cc:323] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:29.399194 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet bdd615dc3bb34a41801dd1dd2d6aa16e from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:29.400079 13576 tablet_copy_client.cc:538] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.399992 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet bdd615dc3bb34a41801dd1dd2d6aa16e from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-bdd615dc3bb34a41801dd1dd2d6aa16e
I20260709 13:06:29.410147 13576 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:29.410787 12742 tablet_copy_source_session.cc:215] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.415933 13580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd615dc3bb34a41801dd1dd2d6aa16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.452966 13580 tablet_copy_client.cc:806] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:29.453609 13580 tablet_copy_client.cc:670] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:29.464087 13580 tablet_copy_client.cc:538] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.474264 13580 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:29.487993 13584 ts_tablet_manager.cc:933] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:29.504459 13576 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.505589 13576 tablet_bootstrap.cc:492] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:29.506292 13576 ts_tablet_manager.cc:1403] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.096s	user 0.035s	sys 0.009s
I20260709 13:06:29.509799 13576 raft_consensus.cc:359] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.511097 13576 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:29.512516 13576 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.569418 13576 ts_tablet_manager.cc:1434] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.063s	user 0.020s	sys 0.033s
I20260709 13:06:29.570605 13584 tablet_copy_client.cc:323] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:29.571797 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-2d23a1e845884d5e9ad733d5579dcf30 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:29.572353 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-2d23a1e845884d5e9ad733d5579dcf30 on tablet 2d23a1e845884d5e9ad733d5579dcf30 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:29.581143 13580 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.584553 13580 tablet_bootstrap.cc:492] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:29.588122 13580 ts_tablet_manager.cc:1403] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.028s
I20260709 13:06:29.604677 13576 ts_tablet_manager.cc:933] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:29.596621 13580 raft_consensus.cc:359] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.606511 13580 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:29.608562 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet eb5990f0ee644c48952ecb885d6a405b from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:29.609112 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet eb5990f0ee644c48952ecb885d6a405b from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-eb5990f0ee644c48952ecb885d6a405b
I20260709 13:06:29.616299 12818 tablet_copy_source_session.cc:215] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.615931 13580 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.617166 13576 tablet_copy_client.cc:323] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:29.619824 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet d985ce4f59254503949afda97665ffd4 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:29.620482 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet d985ce4f59254503949afda97665ffd4 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-d985ce4f59254503949afda97665ffd4
I20260709 13:06:29.622553 13580 ts_tablet_manager.cc:1434] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:06:29.627839 12743 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-bdd615dc3bb34a41801dd1dd2d6aa16e received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:29.628398 12743 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-bdd615dc3bb34a41801dd1dd2d6aa16e on tablet bdd615dc3bb34a41801dd1dd2d6aa16e with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:29.633101 13584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5990f0ee644c48952ecb885d6a405b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.642349 12742 tablet_copy_source_session.cc:215] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.646557 13576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d985ce4f59254503949afda97665ffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.666909 13576 tablet_copy_client.cc:806] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:29.667732 13576 tablet_copy_client.cc:670] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:29.672773 13576 tablet_copy_client.cc:538] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.680888 13584 tablet_copy_client.cc:806] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:29.681972 13584 tablet_copy_client.cc:670] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:29.685415 13576 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:29.692708 13584 tablet_copy_client.cc:538] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.719787 13584 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:29.754812 13576 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.756068 13576 tablet_bootstrap.cc:492] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:29.756940 13576 ts_tablet_manager.cc:1403] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.013s
I20260709 13:06:29.769977 13576 raft_consensus.cc:359] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.771564 13576 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:29.772480 13576 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.776647 13584 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.777700 13584 tablet_bootstrap.cc:492] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:29.778415 13584 ts_tablet_manager.cc:1403] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.012s
I20260709 13:06:29.781745 13584 raft_consensus.cc:359] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.782727 13584 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:29.783464 13584 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:29.785831 13584 ts_tablet_manager.cc:1434] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:06:29.790709 13521 raft_consensus.cc:1217] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:29.791208 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-eb5990f0ee644c48952ecb885d6a405b received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:29.791777 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-eb5990f0ee644c48952ecb885d6a405b on tablet eb5990f0ee644c48952ecb885d6a405b with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:29.803860 13576 ts_tablet_manager.cc:1434] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 13:06:29.806083 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-d985ce4f59254503949afda97665ffd4 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:29.806663 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-d985ce4f59254503949afda97665ffd4 on tablet d985ce4f59254503949afda97665ffd4 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:29.913393 13521 raft_consensus.cc:1217] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.050546 13521 raft_consensus.cc:1217] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.078140 13521 raft_consensus.cc:1217] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.319164 13347 raft_consensus.cc:1064] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:30.322252 13347 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.335639 12874 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.337777 12804 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.339425 13521 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.340854 13564 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.342191 13594 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.352245 13455 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.373003 13455 raft_consensus.cc:1064] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:30.377044 13455 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.380666 13564 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.395871 13521 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.419977 12630 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.420385 12874 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.457373 12873 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.467006 13521 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.482672 13550 raft_consensus.cc:1064] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:30.482950 12800 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.536861 13550 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:30.507905 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.540618 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74583.3us
W20260709 13:06:30.551805 13600 log.cc:927] Time spent T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:30.564832 12804 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.570325 13564 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.582185 13604 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.599354 13564 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.603689 12878 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.606194 13521 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.628895 12725 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.652381 13560 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.657945 12725 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.665618 13550 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.681806 13603 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.713316 13560 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:30.724210 13593 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.738224 12874 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.744861 12873 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.754710 12804 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.763526 13604 raft_consensus.cc:1064] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:30.763502 13520 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.764334 12627 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.771651 13604 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.788069 12628 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.797711 13520 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.803860 12873 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.816069 13564 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:30.846108 13520 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.851711 12804 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.856737 12800 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.862259 13604 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:30.884068 13521 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.885624 13604 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:30.887907 12881 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.889254 13521 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.893661 12725 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:30.896266 12881 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.898530 13593 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:30.910827 13603 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.912441 12803 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.913203 13550 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:30.917146 13564 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.916923 13520 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.922505 13594 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:30.929364 12873 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.930769 13593 raft_consensus.cc:2955] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.941512 13519 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.968021 13594 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.959606 12629 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.969623 12878 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:30.988150 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdd615dc3bb34a41801dd1dd2d6aa16e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:30.996896 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd615dc3bb34a41801dd1dd2d6aa16e with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45482
I20260709 13:06:31.004289 13603 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.011399 12804 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.047114 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb5990f0ee644c48952ecb885d6a405b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.067879 13519 raft_consensus.cc:2955] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.093068 13347 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.075249 12629 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.095324 12630 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.105476 13455 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.115622 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d23a1e845884d5e9ad733d5579dcf30 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.107173 13619 tablet_replica.cc:333] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:06:31.146071 12874 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.148820 13521 raft_consensus.cc:2955] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.197366 13619 raft_consensus.cc:2243] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.201824 13619 raft_consensus.cc:2272] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.284505 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 131068us
I20260709 13:06:31.295682 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d23a1e845884d5e9ad733d5579dcf30 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37656
W20260709 13:06:31.297953 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 177663us
W20260709 13:06:31.323279 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 177276us
I20260709 13:06:31.331314 13619 ts_tablet_manager.cc:1916] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.321936 12629 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.347005 13627 tablet_replica.cc:333] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:06:31.348642 13627 raft_consensus.cc:2243] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.354869 13627 raft_consensus.cc:2272] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.393249 13627 ts_tablet_manager.cc:1916] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.398707 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5990f0ee644c48952ecb885d6a405b with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52108
I20260709 13:06:31.394965 12804 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.438160 13519 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.460027 13619 ts_tablet_manager.cc:1929] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.460747 13619 log.cc:1199] T bdd615dc3bb34a41801dd1dd2d6aa16e P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/bdd615dc3bb34a41801dd1dd2d6aa16e
I20260709 13:06:31.464370 13628 tablet_replica.cc:333] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:06:31.466090 13628 raft_consensus.cc:2243] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.466769 13628 pending_rounds.cc:70] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Trying to abort 1 pending ops.
I20260709 13:06:31.471416 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet bdd615dc3bb34a41801dd1dd2d6aa16e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:31.467128 13628 pending_rounds.cc:77] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635391422869504 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "eb5990f0ee644c48952ecb885d6a405b" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } } }
I20260709 13:06:31.476183 13628 raft_consensus.cc:2917] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:06:31.479388 13628 raft_consensus.cc:2889] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:06:31.479876 13628 raft_consensus.cc:2272] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.492982 12732 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:31.497649 13628 ts_tablet_manager.cc:1916] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.498550 13627 ts_tablet_manager.cc:1929] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.499528 13627 log.cc:1199] T 2d23a1e845884d5e9ad733d5579dcf30 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/2d23a1e845884d5e9ad733d5579dcf30
I20260709 13:06:31.500559 12804 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.502799 13603 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.506677 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 2d23a1e845884d5e9ad733d5579dcf30 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:31.519207 13624 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.529376 12808 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.550541 12629 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.558421 13628 ts_tablet_manager.cc:1929] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.559060 13628 log.cc:1199] T eb5990f0ee644c48952ecb885d6a405b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/eb5990f0ee644c48952ecb885d6a405b
I20260709 13:06:31.562569 13519 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.571511 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet d985ce4f59254503949afda97665ffd4 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37656
I20260709 13:06:31.572683 13627 tablet_replica.cc:333] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:06:31.573921 13627 raft_consensus.cc:2243] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.575935 13627 raft_consensus.cc:2272] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.579880 13627 ts_tablet_manager.cc:1916] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.580981 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d985ce4f59254503949afda97665ffd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.582365 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet eb5990f0ee644c48952ecb885d6a405b (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:31.584686 13594 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.599294 13519 raft_consensus.cc:2955] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:31.619385 13627 ts_tablet_manager.cc:1929] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.620028 13627 log.cc:1199] T d985ce4f59254503949afda97665ffd4 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/d985ce4f59254503949afda97665ffd4
I20260709 13:06:31.621917 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet d985ce4f59254503949afda97665ffd4 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:32.661270 12732 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:32.667349 12878 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.668965 12804 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:32.669566 12696 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f17b4815ff84374bc9e1b330d886c34. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.670068 13564 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.673586 13624 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.700738 13624 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.705953 12804 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.731034 12878 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.736354 12800 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:32.752449 12629 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.783566 12724 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.785184 12874 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:32.787752 12771 consensus_peers.cc:597] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 098bf8b9f16c41adb5871161f995c638. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.788237 13571 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.806716 13623 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.808147 12874 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.813314 13632 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.869863 12800 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:32.869928 12732 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.874544 12629 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.925454 12874 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:32.926818 12771 consensus_peers.cc:597] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dff29d178e6c42cd8abcbd3d7747b77a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.927644 13623 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.936153 12728 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.936743 13639 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.938773 12874 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:32.958863 12628 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.966161 12800 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:32.976145 12874 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:32.978466 13571 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:32.980660 12771 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a18b1e83629843e7991a12a0e6370ca7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.982036 13571 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.985603 12728 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:32.992579 13639 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.004159 12732 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:33.024238 13571 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:33.046335 12732 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:33.067829 12628 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.079968 12874 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:33.196170 13649 ts_tablet_manager.cc:933] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:33.200320 13649 tablet_copy_client.cc:323] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:33.209606 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 3f17b4815ff84374bc9e1b330d886c34 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:33.210227 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 3f17b4815ff84374bc9e1b330d886c34 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-3f17b4815ff84374bc9e1b330d886c34
I20260709 13:06:33.219875 12742 tablet_copy_source_session.cc:215] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.224020 13649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f17b4815ff84374bc9e1b330d886c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.242481 13649 tablet_copy_client.cc:806] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.243196 13649 tablet_copy_client.cc:670] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.247560 13649 tablet_copy_client.cc:538] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.258474 13651 ts_tablet_manager.cc:933] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:33.265513 13649 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:33.283608 13651 tablet_copy_client.cc:323] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:33.285657 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 098bf8b9f16c41adb5871161f995c638 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:33.286216 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 098bf8b9f16c41adb5871161f995c638 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-098bf8b9f16c41adb5871161f995c638
I20260709 13:06:33.294481 12818 tablet_copy_source_session.cc:215] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.298702 13651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098bf8b9f16c41adb5871161f995c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.301842 13649 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.303162 13649 tablet_bootstrap.cc:492] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:33.304098 13649 ts_tablet_manager.cc:1403] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.006s
I20260709 13:06:33.308648 13649 raft_consensus.cc:359] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.310900 13649 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:33.312198 13649 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.338603 13649 ts_tablet_manager.cc:1434] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.034s	user 0.013s	sys 0.012s
I20260709 13:06:33.344069 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-3f17b4815ff84374bc9e1b330d886c34 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:33.344588 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-3f17b4815ff84374bc9e1b330d886c34 on tablet 3f17b4815ff84374bc9e1b330d886c34 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:33.355005 13651 tablet_copy_client.cc:806] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.355800 13651 tablet_copy_client.cc:670] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.360634 13651 tablet_copy_client.cc:538] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.390609 13651 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:33.499166 13649 ts_tablet_manager.cc:933] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:33.511231 13651 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.515197 13649 tablet_copy_client.cc:323] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:33.517823 13651 tablet_bootstrap.cc:492] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:33.518904 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet a18b1e83629843e7991a12a0e6370ca7 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:33.519553 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet a18b1e83629843e7991a12a0e6370ca7 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-a18b1e83629843e7991a12a0e6370ca7
I20260709 13:06:33.530733 12818 tablet_copy_source_session.cc:215] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.532163 13651 ts_tablet_manager.cc:1403] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.142s	user 0.033s	sys 0.000s
I20260709 13:06:33.544008 13651 raft_consensus.cc:359] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.546188 13651 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:33.549288 13649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b1e83629843e7991a12a0e6370ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.559458 13651 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.574671 13651 ts_tablet_manager.cc:1434] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:06:33.581730 13649 tablet_copy_client.cc:806] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.582321 13649 tablet_copy_client.cc:670] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.583678 13657 ts_tablet_manager.cc:933] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:33.593070 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-098bf8b9f16c41adb5871161f995c638 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:33.593777 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-098bf8b9f16c41adb5871161f995c638 on tablet 098bf8b9f16c41adb5871161f995c638 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:33.596019 13657 tablet_copy_client.cc:323] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:33.600557 12817 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet dff29d178e6c42cd8abcbd3d7747b77a from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:33.601159 12817 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet dff29d178e6c42cd8abcbd3d7747b77a from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-dff29d178e6c42cd8abcbd3d7747b77a
I20260709 13:06:33.603984 13649 tablet_copy_client.cc:538] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.611224 12817 tablet_copy_source_session.cc:215] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.615164 13657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff29d178e6c42cd8abcbd3d7747b77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.640708 13649 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:06:33.654238 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55441us
I20260709 13:06:33.658025 13519 raft_consensus.cc:1217] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:33.750882 13657 tablet_copy_client.cc:806] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
W20260709 13:06:33.753691 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94887us
I20260709 13:06:33.751822 13657 tablet_copy_client.cc:670] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.772833 13649 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.777091 13649 tablet_bootstrap.cc:492] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:33.779381 13649 ts_tablet_manager.cc:1403] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.008s
I20260709 13:06:33.782770 13649 raft_consensus.cc:359] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.787101 13649 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:33.789305 13649 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.798269 13649 ts_tablet_manager.cc:1434] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260709 13:06:33.808308 12817 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-a18b1e83629843e7991a12a0e6370ca7 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:33.808786 12817 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-a18b1e83629843e7991a12a0e6370ca7 on tablet a18b1e83629843e7991a12a0e6370ca7 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:33.808960 13657 tablet_copy_client.cc:538] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.825423 13657 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:33.874514 13519 raft_consensus.cc:1217] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:33.909559 13657 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.910763 13657 tablet_bootstrap.cc:492] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:33.911561 13657 ts_tablet_manager.cc:1403] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.031s
I20260709 13:06:33.916939 13657 raft_consensus.cc:359] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.917903 13657 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:33.918607 13657 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:33.922147 13657 ts_tablet_manager.cc:1434] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:33.924981 12817 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-dff29d178e6c42cd8abcbd3d7747b77a received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:33.925423 12817 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-dff29d178e6c42cd8abcbd3d7747b77a on tablet dff29d178e6c42cd8abcbd3d7747b77a with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:33.943516 13519 raft_consensus.cc:1217] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.054489 13519 raft_consensus.cc:1217] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:34.234766 13623 raft_consensus.cc:1064] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:34.237530 13623 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.246143 12874 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.246143 13519 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.247956 12724 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.247980 13661 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.249904 13660 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.250926 13639 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.265247 13660 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.272883 13519 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.277101 12728 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.302448 12628 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.310971 12874 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:06:34.425812 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 134312us
I20260709 13:06:34.438751 12801 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.440497 13639 raft_consensus.cc:1064] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:34.443470 13639 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.449127 12881 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.455065 13520 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.460333 13671 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.464589 13623 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.456971 13672 raft_consensus.cc:1064] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:34.469076 13672 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.473027 13660 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.480938 12876 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.480386 13520 raft_consensus.cc:2955] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.505445 12874 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:34.506419 13519 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:34.506979 13671 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.512990 13661 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.515636 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 098bf8b9f16c41adb5871161f995c638 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.543927 12630 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.558497 13521 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.562884 12878 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.568682 12726 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:34.569828 12728 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.580472 13671 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.583251 13682 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:34.605837 13672 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.608831 13672 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.613693 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 098bf8b9f16c41adb5871161f995c638 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52108
I20260709 13:06:34.629937 13665 raft_consensus.cc:1064] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:34.633327 13665 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.642442 13686 tablet_replica.cc:333] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:06:34.642760 13680 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.656347 12801 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.661780 13624 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.646939 13519 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.677464 12880 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.678447 13520 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.686264 13664 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.694952 13660 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.694958 12880 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.715160 13686 raft_consensus.cc:2243] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.716086 13686 raft_consensus.cc:2272] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.716305 12630 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.721065 13686 ts_tablet_manager.cc:1916] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.727125 12874 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.731639 13519 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.754598 12630 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.758283 12801 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.787884 12804 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:34.790421 13520 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:34.792428 12726 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.792110 12724 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.795145 13660 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:34.807111 13520 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.810833 13682 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.811842 13665 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.810453 13680 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.814905 12881 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.818352 13519 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.824337 13664 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.828510 12726 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:34.847028 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a18b1e83629843e7991a12a0e6370ca7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.833653 13686 ts_tablet_manager.cc:1929] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:34.835309 12876 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.854499 13686 log.cc:1199] T 098bf8b9f16c41adb5871161f995c638 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/098bf8b9f16c41adb5871161f995c638
I20260709 13:06:34.857558 12804 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.864295 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 098bf8b9f16c41adb5871161f995c638 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:34.868588 13682 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:34.870844 13671 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.874850 13671 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.876204 13518 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.887142 12627 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.890034 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dff29d178e6c42cd8abcbd3d7747b77a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.890933 12726 raft_consensus.cc:2955] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.902318 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet a18b1e83629843e7991a12a0e6370ca7 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37656
I20260709 13:06:34.914350 12881 raft_consensus.cc:2955] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.936547 12629 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:34.938462 12629 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.941007 13694 tablet_replica.cc:333] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:06:34.948297 13694 raft_consensus.cc:2243] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.949153 13694 raft_consensus.cc:2272] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.963538 13694 ts_tablet_manager.cc:1916] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.952934 13521 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:35.014055 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet dff29d178e6c42cd8abcbd3d7747b77a with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52108
I20260709 13:06:35.016410 13686 tablet_replica.cc:333] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:06:35.037585 13686 raft_consensus.cc:2243] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.038568 13686 raft_consensus.cc:2272] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.046377 13686 ts_tablet_manager.cc:1916] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.053053 13694 ts_tablet_manager.cc:1929] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:06:35.058779 13694 log.cc:1199] T a18b1e83629843e7991a12a0e6370ca7 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/a18b1e83629843e7991a12a0e6370ca7
I20260709 13:06:35.061497 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet a18b1e83629843e7991a12a0e6370ca7 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:35.107494 13686 ts_tablet_manager.cc:1929] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:35.108104 13686 log.cc:1199] T dff29d178e6c42cd8abcbd3d7747b77a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/dff29d178e6c42cd8abcbd3d7747b77a
I20260709 13:06:35.110321 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet dff29d178e6c42cd8abcbd3d7747b77a (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:35.377297 12728 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:35.385507 12880 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.385507 13521 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.387832 13665 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.389708 13695 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.397432 13665 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:35.401607 13521 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:35.401908 12881 raft_consensus.cc:2955] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:35.420392 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f17b4815ff84374bc9e1b330d886c34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:35.424865 12629 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:35.442521 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f17b4815ff84374bc9e1b330d886c34 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45482
I20260709 13:06:35.444698 13696 tablet_replica.cc:333] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:06:35.448352 13696 raft_consensus.cc:2243] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.452212 13696 raft_consensus.cc:2272] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.455698 13696 ts_tablet_manager.cc:1916] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.471558 13696 ts_tablet_manager.cc:1929] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:35.471930 13696 log.cc:1199] T 3f17b4815ff84374bc9e1b330d886c34 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/3f17b4815ff84374bc9e1b330d886c34
I20260709 13:06:35.473531 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 3f17b4815ff84374bc9e1b330d886c34 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:36.511416 12724 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:36.517517 12876 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.517575 12801 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.519389 13695 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:36.520727 12696 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d9ae3e4f0c340f180826fd03f63f7e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.520727 13665 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:36.533128 13695 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.534752 12800 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.537586 12876 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.553498 12629 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.564725 12800 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:06:36.598774 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44476.7us
I20260709 13:06:36.601991 12724 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.603492 13698 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.604768 12876 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:36.603411 12771 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4dc74d6c2504bad83ab3be06d6255c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.607012 13698 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.624419 13698 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.630997 12724 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.645030 12881 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.699783 12876 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:36.705894 12629 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.718835 12800 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.720489 13675 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:36.723806 12724 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.725698 13675 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:36.750029 12845 consensus_peers.cc:597] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e64952f9027442eb482fbc10cf426fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.754032 13717 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.795843 12881 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:06:36.801433 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44977us
I20260709 13:06:36.806653 12627 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.809078 12800 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.810009 12728 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.834311 12800 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:36.838295 12845 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88a5e3e97cfa425f9fb7a66612ed959b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.838604 12728 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:36.838500 13720 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.841406 13720 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.850533 13721 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.852552 12801 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.852993 12728 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:36.884452 12630 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 3, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:37.059984 13728 ts_tablet_manager.cc:933] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:37.065399 13728 tablet_copy_client.cc:323] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:37.067698 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:37.068454 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 8d9ae3e4f0c340f180826fd03f63f7e4 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-8d9ae3e4f0c340f180826fd03f63f7e4
I20260709 13:06:37.080513 12742 tablet_copy_source_session.cc:215] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.085009 13728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9ae3e4f0c340f180826fd03f63f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.103508 13728 tablet_copy_client.cc:806] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.105427 13728 tablet_copy_client.cc:670] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.112133 13728 tablet_copy_client.cc:538] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.124492 13728 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:37.213675 13730 ts_tablet_manager.cc:933] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:37.222990 13731 ts_tablet_manager.cc:933] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:37.248590 13730 tablet_copy_client.cc:323] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:37.262709 12817 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet f4dc74d6c2504bad83ab3be06d6255c9 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:37.263581 12817 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet f4dc74d6c2504bad83ab3be06d6255c9 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-f4dc74d6c2504bad83ab3be06d6255c9
I20260709 13:06:37.265573 13728 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.266700 13728 tablet_bootstrap.cc:492] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:37.267485 13728 ts_tablet_manager.cc:1403] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.143s	user 0.028s	sys 0.006s
I20260709 13:06:37.268414 13731 tablet_copy_client.cc:323] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:06:37.286588 13728 raft_consensus.cc:359] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.298978 13728 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:37.300079 13728 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.313807 12817 tablet_copy_source_session.cc:215] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.341163 13730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc74d6c2504bad83ab3be06d6255c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.398340 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 3e64952f9027442eb482fbc10cf426fe from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:06:37.399050 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 3e64952f9027442eb482fbc10cf426fe from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-3e64952f9027442eb482fbc10cf426fe
I20260709 13:06:37.408545 13728 ts_tablet_manager.cc:1434] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.141s	user 0.022s	sys 0.058s
I20260709 13:06:37.410648 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-8d9ae3e4f0c340f180826fd03f63f7e4 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:37.411231 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-8d9ae3e4f0c340f180826fd03f63f7e4 on tablet 8d9ae3e4f0c340f180826fd03f63f7e4 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:37.417580 12892 tablet_copy_source_session.cc:215] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.426390 13731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64952f9027442eb482fbc10cf426fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.426815 13728 ts_tablet_manager.cc:933] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:37.451342 13730 tablet_copy_client.cc:806] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.452446 13728 tablet_copy_client.cc:323] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:06:37.452754 13730 tablet_copy_client.cc:670] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.454368 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 88a5e3e97cfa425f9fb7a66612ed959b from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:06:37.454968 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 88a5e3e97cfa425f9fb7a66612ed959b from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-88a5e3e97cfa425f9fb7a66612ed959b
I20260709 13:06:37.455732 13731 tablet_copy_client.cc:806] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.456331 13731 tablet_copy_client.cc:670] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.467406 12892 tablet_copy_source_session.cc:215] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.468178 13731 tablet_copy_client.cc:538] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.468612 13730 tablet_copy_client.cc:538] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.472868 13519 raft_consensus.cc:1217] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:37.480675 13731 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:37.481551 13730 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:37.483299 13728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5e3e97cfa425f9fb7a66612ed959b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.516117 13728 tablet_copy_client.cc:806] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.516772 13728 tablet_copy_client.cc:670] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.518690 13730 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.519850 13730 tablet_bootstrap.cc:492] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:37.520699 13730 ts_tablet_manager.cc:1403] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.010s
I20260709 13:06:37.528754 13728 tablet_copy_client.cc:538] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.532141 13731 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.533144 13731 tablet_bootstrap.cc:492] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:37.533835 13731 ts_tablet_manager.cc:1403] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.011s
I20260709 13:06:37.536974 13730 raft_consensus.cc:359] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.537891 13730 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:37.538656 13730 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.539549 13731 raft_consensus.cc:359] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.540565 13731 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:37.541636 13730 ts_tablet_manager.cc:1434] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:06:37.541328 13731 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.543658 12817 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-f4dc74d6c2504bad83ab3be06d6255c9 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:37.545738 12817 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-f4dc74d6c2504bad83ab3be06d6255c9 on tablet f4dc74d6c2504bad83ab3be06d6255c9 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:37.548655 13731 ts_tablet_manager.cc:1434] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:06:37.550868 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-3e64952f9027442eb482fbc10cf426fe received from {username='slave'} at 127.0.0.1:60686
I20260709 13:06:37.551414 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-3e64952f9027442eb482fbc10cf426fe on tablet 3e64952f9027442eb482fbc10cf426fe with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:37.553494 13728 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:37.606251 13728 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.607376 13728 tablet_bootstrap.cc:492] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:37.608183 13728 ts_tablet_manager.cc:1403] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.010s
I20260709 13:06:37.611275 13728 raft_consensus.cc:359] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.612079 13728 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:37.613404 13728 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:37.615898 13728 ts_tablet_manager.cc:1434] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:06:37.617650 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-88a5e3e97cfa425f9fb7a66612ed959b received from {username='slave'} at 127.0.0.1:60686
I20260709 13:06:37.618043 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-88a5e3e97cfa425f9fb7a66612ed959b on tablet 88a5e3e97cfa425f9fb7a66612ed959b with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:37.650043 13519 raft_consensus.cc:1217] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:37.822110 13519 raft_consensus.cc:1217] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:37.918092 13665 raft_consensus.cc:1064] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:37.920670 13665 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:37.935164 12880 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.937583 12803 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.939661 13703 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:37.940359 13519 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.943286 13695 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:37.952924 13519 raft_consensus.cc:1217] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:37.966554 13665 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:37.974865 13665 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:37.979905 12881 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.002055 12803 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.003293 12627 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.007990 13519 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.048538 12728 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.063251 13519 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.065961 12874 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.066833 13703 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.069072 13703 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.074609 13665 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.077332 12874 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.084857 13519 raft_consensus.cc:2955] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.107957 12628 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 3 to 4, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.115414 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:38.141848 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d9ae3e4f0c340f180826fd03f63f7e4 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45482
I20260709 13:06:38.151643 13753 tablet_replica.cc:333] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:06:38.156466 13720 raft_consensus.cc:1064] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:38.162638 13753 raft_consensus.cc:2243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.161541 13720 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.163731 13753 raft_consensus.cc:2272] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.169275 13753 ts_tablet_manager.cc:1916] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:38.178730 13519 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.181277 13720 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.182219 12803 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.185603 13743 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.188376 13753 ts_tablet_manager.cc:1929] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:38.188934 13753 log.cc:1199] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/8d9ae3e4f0c340f180826fd03f63f7e4
I20260709 13:06:38.188903 12726 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.191445 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 8d9ae3e4f0c340f180826fd03f63f7e4 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:38.202847 13720 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.216279 13721 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.220504 12804 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.224823 12728 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.243870 13519 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.261997 12628 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.288023 12881 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.299746 13519 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.302314 13721 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.307178 12804 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.308542 13721 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:38.311465 13743 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.312628 13519 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.318463 12804 raft_consensus.cc:2955] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.325532 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e64952f9027442eb482fbc10cf426fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:38.329015 12628 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 4, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 1 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.347146 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e64952f9027442eb482fbc10cf426fe with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52108
I20260709 13:06:38.349655 13758 tablet_replica.cc:333] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:06:38.351040 13758 raft_consensus.cc:2243] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.351980 13758 raft_consensus.cc:2272] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.356629 13758 ts_tablet_manager.cc:1916] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:38.372438 13758 ts_tablet_manager.cc:1929] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:38.372920 13758 log.cc:1199] T 3e64952f9027442eb482fbc10cf426fe P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/3e64952f9027442eb482fbc10cf426fe
I20260709 13:06:38.374918 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 3e64952f9027442eb482fbc10cf426fe (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:38.385947 13743 raft_consensus.cc:1064] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:38.388725 13743 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.397459 13519 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:38.404153 13721 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.411458 12803 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:38.413481 13720 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:38.427908 12728 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:38.430436 13720 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:38.442039 13720 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.445190 12801 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.455720 13519 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.463804 12630 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 3 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.469885 12728 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.503587 13699 raft_consensus.cc:1064] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:38.506528 13699 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.515581 12881 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.535378 13521 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.535650 12726 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.537882 13720 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.539134 13721 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.555428 13763 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.562526 13521 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.570989 12726 raft_consensus.cc:2955] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.579185 12881 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.580327 13521 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.580392 12728 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:38.580708 13699 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.582511 13713 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.583621 13764 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.582737 12628 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 4 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.609054 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 88a5e3e97cfa425f9fb7a66612ed959b with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45482
I20260709 13:06:38.610184 13753 tablet_replica.cc:333] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:06:38.611384 13753 raft_consensus.cc:2243] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.612318 13753 raft_consensus.cc:2272] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.616523 13753 ts_tablet_manager.cc:1916] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:38.627818 13699 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.629959 12728 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.632524 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88a5e3e97cfa425f9fb7a66612ed959b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:38.663203 12629 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.668377 12874 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.679028 13521 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.688519 13753 ts_tablet_manager.cc:1929] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:38.689049 13753 log.cc:1199] T 88a5e3e97cfa425f9fb7a66612ed959b P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/88a5e3e97cfa425f9fb7a66612ed959b
I20260709 13:06:38.690768 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 88a5e3e97cfa425f9fb7a66612ed959b (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:38.738828 12803 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:38.744266 12726 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.744400 13521 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:38.746994 13769 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:38.748757 13699 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:38.754920 13713 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.766629 13521 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.776551 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4dc74d6c2504bad83ab3be06d6255c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:38.776959 12726 raft_consensus.cc:2955] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:38.792553 12627 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 3 to 4, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.807636 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet f4dc74d6c2504bad83ab3be06d6255c9 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37656
I20260709 13:06:38.819766 13770 tablet_replica.cc:333] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:06:38.821226 13770 raft_consensus.cc:2243] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.822211 13770 raft_consensus.cc:2272] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.826206 13770 ts_tablet_manager.cc:1916] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:38.843336 13770 ts_tablet_manager.cc:1929] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:38.843740 13770 log.cc:1199] T f4dc74d6c2504bad83ab3be06d6255c9 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/f4dc74d6c2504bad83ab3be06d6255c9
I20260709 13:06:38.845685 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet f4dc74d6c2504bad83ab3be06d6255c9 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:06:39.888677 12728 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:39.897320 12880 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:39.897850 12803 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:39.897921 12696 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a839b697aea46da87cb69b00515389e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:39.899995 13771 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.901515 13664 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.912703 13771 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:39.914630 12880 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:39.917536 12803 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:39.934708 12803 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:39.935076 12627 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:39.956513 12771 consensus_peers.cc:597] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21f97de57a4f4bf7a4ac5fde6b3bc613. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:39.958271 12880 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:39.958710 12724 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:39.960187 13699 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:39.961308 13772 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.973305 13699 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:39.979281 12881 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:39.981448 12724 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.002743 12803 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:40.003168 12630 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.027976 12881 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:40.030287 12771 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 562422a4dc1a44a7bca3a549839874be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.030889 13713 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.037842 12724 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:40.041086 13772 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.045174 13713 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.053619 12881 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.064560 12724 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.088682 12630 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.090224 12724 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:40.099993 12881 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:40.103554 12803 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:40.105855 13771 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.108950 13703 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:40.110920 12696 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc76143509f64c4faa68973765829aec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.123482 13703 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.126118 12803 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.144419 12880 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.152323 12628 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 2, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 1 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:06:40.287007 13791 ts_tablet_manager.cc:933] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:40.289083 13791 tablet_copy_client.cc:323] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:06:40.291205 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 4a839b697aea46da87cb69b00515389e from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:40.291980 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 4a839b697aea46da87cb69b00515389e from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-4a839b697aea46da87cb69b00515389e
I20260709 13:06:40.299343 12742 tablet_copy_source_session.cc:215] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:40.304322 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a839b697aea46da87cb69b00515389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.322472 13791 tablet_copy_client.cc:806] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:40.329871 13791 tablet_copy_client.cc:670] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:40.338111 13791 tablet_copy_client.cc:538] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:40.347826 13791 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:40.368263 13791 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:40.369302 13791 tablet_bootstrap.cc:492] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:40.370044 13791 ts_tablet_manager.cc:1403] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.008s
I20260709 13:06:40.373965 13791 raft_consensus.cc:359] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:40.374950 13791 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:40.375725 13791 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:40.379583 13791 ts_tablet_manager.cc:1434] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:06:40.382539 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-4a839b697aea46da87cb69b00515389e received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:40.383080 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-4a839b697aea46da87cb69b00515389e on tablet 4a839b697aea46da87cb69b00515389e with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:40.587586 13791 ts_tablet_manager.cc:933] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:41.377578 13791 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.042s	sys 0.054s
W20260709 13:06:41.378111 13791 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.042s	sys 0.054s
I20260709 13:06:41.378825 13791 tablet_copy_client.cc:323] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:41.613528 13804 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:41.614838 13804 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:41.627426 13807 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:41.635457 13804 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:41.633682 13807 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:41.640348 12772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.013s	sys 0.016s
W20260709 13:06:41.640852 12772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.013s	sys 0.016s
I20260709 13:06:41.642004 13807 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:41.683537 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.010s	sys 0.006s
W20260709 13:06:41.684103 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.011s	sys 0.006s
I20260709 13:06:41.687466 13802 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:41.688124 13802 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:41.689616 13801 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:41.690371 13802 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:41.690158 13801 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:41.692384 13796 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:41.692889 13796 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:41.695272 13796 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:41.695848 12848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.006s	sys 0.005s
W20260709 13:06:41.696337 12848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.007s	sys 0.005s
I20260709 13:06:41.696199 13807 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:41.696768 13807 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:41.697081 13801 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:41.703635 12773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.003s	sys 0.001s
W20260709 13:06:41.853404 12773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.003s	sys 0.005s
I20260709 13:06:42.118822 13807 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.119880 13800 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.120724 13800 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.123404 13800 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.131322 13796 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.130102 13801 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.134684 13796 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.135255 13801 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.137319 13802 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.139024 12817 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:42.139050 13800 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.139243 13802 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.139847 12817 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-21f97de57a4f4bf7a4ac5fde6b3bc613
I20260709 13:06:42.139941 13800 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.141556 13802 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.142092 13800 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.142206 13798 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.146060 13796 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.147061 13807 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.147467 13800 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.148167 13807 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.148406 13800 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.150905 13807 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.151412 13800 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.147270 13796 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.148459 13801 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.144923 13802 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.207073 13807 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.144148 13798 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.207655 13807 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.208259 13814 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.212919 13814 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.214130 13807 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.209184 13800 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.215032 13814 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.212173 13815 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.200163 13802 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.215890 13812 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.216194 13815 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.218214 13812 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.214928 13800 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.220322 12817 tablet_copy_source_session.cc:215] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:42.220322 13815 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.221366 13800 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.221181 13812 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.223517 13800 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.200230 13813 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.225854 13813 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.228374 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.229745 13802 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.230460 13798 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:42.230845 12846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.434s	user 0.003s	sys 0.017s
W20260709 13:06:42.231217 12846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.434s	user 0.004s	sys 0.017s
I20260709 13:06:42.221187 13815 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.232124 13815 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.234674 13815 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.197038 13796 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.247505 13796 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.250840 13802 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.293457 13817 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.294265 13796 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.295060 13796 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.289533 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.296617 13823 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.293030 13802 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.297219 13823 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.251833 13721 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.299929 13802 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.301427 13802 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.302094 13802 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.305168 13802 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.267668 13800 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.308135 13800 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.273608 13813 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.294070 13817 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.317467 13817 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.305269 13825 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.318852 13802 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.319042 13825 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.319898 13802 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.321987 13825 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.348899 13825 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.353776 13825 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.356050 13801 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.356845 13801 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.357823 13812 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.358521 13812 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:42.359097 13801 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.359689 13801 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.360459 13814 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.360857 13812 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.360942 13814 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.361500 13798 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.361665 13812 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.362010 13798 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.362356 13812 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.363243 13814 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.363754 13814 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.299968 13823 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.364990 13814 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.300448 13721 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.365515 13812 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.337836 13826 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.366487 13826 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.367657 13814 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.369182 13826 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.357539 13797 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.340242 13813 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.369827 13814 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.346153 13796 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.356293 13822 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.368489 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.374647 12803 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.363977 13798 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.369443 13817 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.371623 13801 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.370522 13813 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.322062 13802 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.341238 13827 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.370241 13797 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.377383 13810 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.370478 13814 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.381078 13721 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.380721 13812 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.374284 13822 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.399899 13721 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.402328 13721 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.392429 13802 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.403429 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.403434 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.406028 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.388450 13817 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.405447 13825 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.408192 13796 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.391595 13810 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.412269 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.413214 12800 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.416632 13810 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.416905 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.417284 13810 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.417336 13796 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.417933 13810 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.410223 13802 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.419478 13796 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.413192 13826 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.420732 13817 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.420914 13824 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.420818 13826 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.422019 13822 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.427812 13721 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.428838 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.398407 13812 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.429857 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.430589 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.431334 12874 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:42.429507 12808 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.432113 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.432257 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.432933 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.433358 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.392944 13827 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.430655 12801 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.436599 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.530990 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.527894 13797 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.528355 13822 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.528625 13805 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.529595 13813 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.526643 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.545336 12808 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.531304 12800 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.526620 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.540196 12874 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.419914 13810 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.544549 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.436360 13829 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.426517 13811 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.532652 13823 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.549474 12804 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.543112 13801 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.544096 13825 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.436812 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.560401 13812 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.558736 13807 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.547621 13822 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.544080 13824 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.551573 13805 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.563899 13831 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:42.555647 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 116623us
I20260709 13:06:42.555457 13810 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.564155 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.570614 13832 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.562750 13814 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.565186 13807 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.580574 13807 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.557693 13823 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.557456 13811 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.583238 13823 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.564540 13826 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.557916 13825 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.577028 13813 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.578728 13830 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.562740 12802 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.557199 13829 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.584714 13827 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.569121 13819 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.653160 13822 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.653545 13812 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.663815 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.664206 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.664932 13829 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.655354 13802 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.653446 13832 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.671191 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.671298 13820 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.672457 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.674997 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.589252 13810 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.629242 13824 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.656942 13807 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.583230 13811 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.689849 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.688930 12727 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:42.692342 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.692752 13832 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.659382 13813 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.688568 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.694957 12874 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.589180 13831 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.681972 13819 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.698400 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.661480 13830 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.668809 13812 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.700997 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.703397 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.688668 13820 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.704560 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.699702 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.705214 12873 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.706836 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.704396 13805 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.707423 12873 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.710456 13807 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.711233 13807 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.713094 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.716626 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.714319 12873 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.719784 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.711769 13807 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.722550 13825 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:42.725544 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.716910 13819 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.724002 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.729152 12875 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.730415 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:42.727347 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.731032 12875 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.732687 12729 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:42.733915 13831 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.734707 13807 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.734386 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.735121 13810 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.736074 13813 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.736886 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.736598 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.738348 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.736160 13830 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.745620 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.746500 13823 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.746016 13797 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.747100 13823 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.747362 13797 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.749356 13823 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.749867 13823 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.745860 13801 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.750355 13823 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.750775 13801 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.752308 13826 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.752416 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.752897 13826 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.753813 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.754442 12729 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.754844 13801 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.755293 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.749387 13797 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.754860 13826 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.765898 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.769734 13823 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.770524 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.770895 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:42.771266 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:42.771737 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.771996 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:42.792259 12876 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.792362 13518 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:42.772643 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.776279 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.794014 12875 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:42.794770 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.776587 13807 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.796454 13807 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.799168 13807 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.801510 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.803385 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.774055 13521 raft_consensus.cc:1217] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:42.777253 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.804728 12732 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:42.804857 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.799867 13807 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.805810 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.805940 13807 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:42.807310 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.777909 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.779709 13835 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.808701 13835 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:42.781787 12845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.142s	user 0.000s	sys 0.026s
W20260709 13:06:42.787307 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 102570us
W20260709 13:06:42.809723 12845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.170s	user 0.000s	sys 0.026s
I20260709 13:06:42.811054 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.811288 13835 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.756578 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.811764 12880 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:42.812269 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 6) took 1126 ms. Trace:
I20260709 13:06:42.812908 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.806008 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.788475 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.814153 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.814965 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:42.815258 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.074s	user 0.017s	sys 0.019s
I20260709 13:06:42.816074 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:42.816771 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.076s	user 0.017s	sys 0.020s
I20260709 13:06:42.791198 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.821146 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.822392 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.812634 12880 rpcz_store.cc:276] 0709 13:06:41.686050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.706572 (+1020522us) service_pool.cc:224] Handling call
0709 13:06:42.810939 (+104367us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:42.812210 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354880}
I20260709 13:06:42.825387 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.808940 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.815287 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.818410 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.817245 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.830546 13721 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.831295 13721 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.833577 13721 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.834103 13721 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.834277 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.834578 13721 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.835290 13836 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.835667 13812 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.835692 13836 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.807960 12732 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.836565 13836 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.837944 13796 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.838667 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:42.838604 13796 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.841239 13796 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.789304 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:42.847047 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57819.7us
I20260709 13:06:42.853080 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.855232 13820 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.856977 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.859788 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.845173 13836 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.865554 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:42.866317 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.867250 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.868479 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.870103 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.870218 13830 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.870873 13830 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.871296 13830 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.871325 13836 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.855930 13823 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.879616 13809 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.880187 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.880319 13809 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.880956 12732 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:42.881065 13809 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.882164 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.874441 13820 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.866353 13520 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:42.889598 13820 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.890087 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.888890 13806 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.890209 13820 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.889653 13807 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:42.894506 13796 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.891536 13833 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.891553 13806 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.895637 12696 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:42.895284 13796 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:42.895340 13833 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.896586 13833 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.895177 13721 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.898316 13834 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.895854 13806 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.899518 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:42.876572 13823 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.903205 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.894476 13818 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:42.909149 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.906978 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:42.898329 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.900832 13796 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:42.934568 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.934855 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.935303 12732 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:42.935672 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.936885 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.937192 13819 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.928764 13803 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.937564 13819 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.937983 13819 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.937904 13803 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.938795 13803 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.939522 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.908269 13823 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.938832 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.934934 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:42.908155 13798 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.919708 13814 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.953675 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.954301 12880 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.954363 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:42.946851 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 201730us
I20260709 13:06:42.907814 13834 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:42.917610 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:42.956555 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.956740 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.961678 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.962356 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:42.939421 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.950706 13798 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.952715 13814 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:42.963318 12882 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.960449 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.944278 12877 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:42.955873 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.973495 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:42.958673 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.937889 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:42.962050 12876 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:42.965597 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.960682 13834 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.961061 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:42.979938 13798 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.946079 13818 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:42.981980 13814 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.965691 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 64941.8us
W20260709 13:06:43.031111 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 93332us
I20260709 13:06:42.992908 13810 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.981680 13828 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.978750 13721 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.997442 13839 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:43.032781 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70633.9us
I20260709 13:06:43.034382 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.032202 13825 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.985363 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.036511 13807 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.047541 12873 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:43.049013 13817 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.053665 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:06:43.056665 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 71385.8us
I20260709 13:06:43.058831 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.049113 13840 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.061784 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.038681 12875 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:43.067596 13821 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.068135 13821 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.070765 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.050527 13810 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.071372 12848 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.073406 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.055388 13721 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.057113 13828 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.079326 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.056949 13800 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.082275 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.062033 13802 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.049494 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.063558 13807 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:43.060705 13839 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.087050 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.071471 13831 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.074044 13821 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.080849 13833 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.092172 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.084236 13796 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.072813 13825 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.079375 13810 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.059886 13817 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.082041 13721 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.082768 13828 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.084327 13826 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.100323 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.086054 13827 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.098779 13831 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.099718 13839 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.103803 13835 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.129117 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.064491 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:43.130656 12882 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:43.098699 13800 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.110507 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61103.4us
I20260709 13:06:43.134500 13806 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.093874 13840 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.148677 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.150346 13835 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.175197 13833 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.118006 13809 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.171756 13835 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.194331 13838 ts_tablet_manager.cc:933] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:43.209897 13817 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.191884 13837 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.212675 13837 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.212939 13809 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.179809 13514 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:43.195638 13818 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.175462 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.175966 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.163403 13807 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:43.185102 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.213126 13837 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.211778 13820 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:43.242448 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.243049 13827 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.243628 13827 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:43.244745 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 144541us
I20260709 13:06:43.245554 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.250552 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.254106 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.258278 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.244187 13831 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.262982 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:43.255185 12845 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:43.267699 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.254328 13825 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.270422 13830 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.271399 13820 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.264600 13802 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.256857 13826 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.260797 13801 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.258489 13797 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.258888 13800 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.277058 13802 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.264797 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:43.291829 13802 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.273195 13825 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.280678 13826 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.280485 13801 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.285835 13797 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.318243 13825 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.335903 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.323828 13826 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.326257 13801 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.348147 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38680 (request call id 108) took 2761 ms. Trace:
I20260709 13:06:43.330096 13797 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.354025 13791 rpcz_store.cc:276] 0709 13:06:40.586644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.586831 (+   187us) service_pool.cc:224] Handling call
0709 13:06:40.588092 (+  1261us) ts_tablet_manager.cc:934] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:06:42.837310 (+2249218us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:43.131926 (+294616us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:43.132063 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:43.345072 (+213009us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:43.347572 (+  2500us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:43.347954 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:43.348029 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":339,"tablet-copy.queue_time_us":148,"thread_start_us":789735,"threads_started":1}
I20260709 13:06:43.358579 13791 tablet_copy_client.cc:806] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:43.361281 13791 tablet_copy_client.cc:670] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:43.361847 13796 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.362509 13796 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:43.325363 13810 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.369877 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.362967 13796 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.324174 13512 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:43.355341 13806 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.363574 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.402347 13840 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:43.439679 13542 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6060 after lost signal to thread 11579
W20260709 13:06:43.441591 13542 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6740 after lost signal to thread 12665
W20260709 13:06:43.449079 13542 debug-util.cc:398] Leaking SignalData structure 0x7b0800262640 after lost signal to thread 12757
I20260709 13:06:43.460997 13830 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.487686 13841 ts_tablet_manager.cc:933] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.501901 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.487900 13849 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.508302 13849 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.509168 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.510053 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.511291 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.511508 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.512424 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.512607 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.512876 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.513659 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.514779 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.514886 13849 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.515650 13849 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.516913 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.518205 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.505437 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.549683 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:43.529335 13542 debug-util.cc:398] Leaking SignalData structure 0x7b0800176240 after lost signal to thread 12832
I20260709 13:06:43.519735 13820 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:43.497545 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 321005us
I20260709 13:06:43.441540 13828 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.556200 13803 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.617s	user 0.000s	sys 0.016s
I20260709 13:06:43.556708 13839 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:43.561064 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:06:43.565026 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59688.7us
W20260709 13:06:43.559011 13834 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.011s
I20260709 13:06:43.564514 13518 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.577805 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.565178 13803 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.551239 13810 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.582873 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:43.578290 12771 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:43.585482 12873 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:43.562923 13798 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.009s
I20260709 13:06:43.553576 13820 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.597538 12878 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:43.596624 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:43.598269 12881 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.576930 13836 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.602175 13519 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.565074 13839 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.559574 13801 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.614039 12880 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:43.578706 13800 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.599727 13798 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.605810 13542 debug-util.cc:398] Leaking SignalData structure 0x7b0800319220 after lost signal to thread 12906
I20260709 13:06:43.604414 13820 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.634610 13838 tablet_copy_client.cc:323] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
W20260709 13:06:43.637427 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 374521us
I20260709 13:06:43.588714 13822 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.626466 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:43.602202 13832 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.605883 13836 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:43.669350 13836 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:43.636077 13542 debug-util.cc:398] Leaking SignalData structure 0x7b080015e9a0 after lost signal to thread 12907
I20260709 13:06:43.655649 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.576701 13834 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:43.626052 13800 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:06:43.651417 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 594166us
I20260709 13:06:43.688547 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:43.661069 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.690073 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:43.690940 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.674606 12877 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.661274 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.693931 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:43.661804 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.664374 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:43.666379 13801 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.694690 12880 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.695212 12878 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.661497 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.668268 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:43.605504 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 361144us
I20260709 13:06:43.681587 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.685108 12732 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.686654 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.716058 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.717001 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:43.687248 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.687767 13800 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.692023 13839 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.697207 12873 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:43.666878 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:43.705140 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:43.718755 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.725979 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:43.726263 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.729321 13828 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.729677 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:43.731488 12733 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:43.697710 13542 debug-util.cc:398] Leaking SignalData structure 0x7b080010a180 after lost signal to thread 13545
I20260709 13:06:43.650713 13840 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:06:43.730229 12627 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 2 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.684890 13832 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:43.748215 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.749353 12728 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.743743 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.746063 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.693408 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet cc76143509f64c4faa68973765829aec from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:06:43.755832 13803 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.760512 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.761647 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.735929 12879 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.776744 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.779611 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.740813 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.781193 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.742787 13801 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.777504 12730 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.743541 13845 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.795379 12727 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.784722 13809 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.793269 13824 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:43.825498 13814 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.007s
I20260709 13:06:43.825953 13824 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:43.825498 13835 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.009s
I20260709 13:06:43.826885 13835 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:43.777314 13818 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:43.822737 13848 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.824813 12878 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:43.779249 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet cc76143509f64c4faa68973765829aec from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-cc76143509f64c4faa68973765829aec
I20260709 13:06:43.778782 13840 consensus_queue.cc:1243] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:06:43.827198 13819 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.888s	user 0.010s	sys 0.016s
I20260709 13:06:43.827112 13824 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:43.813779 12845 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:43.834343 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:43.835326 13809 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:43.838845 13818 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:43.839321 13802 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.008s
I20260709 13:06:43.865178 13818 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:43.865316 13802 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.866055 13818 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:43.867255 13818 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.867472 13802 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:43.841253 12878 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.868983 12873 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.800138 13798 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.849908 12880 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
W20260709 13:06:43.853552 13850 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:06:43.855738 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:43.857756 13827 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.002s
I20260709 13:06:43.857635 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:43.858197 12877 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
W20260709 13:06:43.864770 13831 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.007s
I20260709 13:06:43.868218 13828 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.822819 13834 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:43.883282 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.825995 13814 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.867489 13821 consensus_meta.cc:287] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.005s
I20260709 13:06:43.874065 12880 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.890653 13802 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.924973 13802 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:43.895507 13823 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.008s
I20260709 13:06:43.900722 12742 tablet_copy_source_session.cc:215] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:43.900534 13831 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.904920 13514 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:06:43.932379 13823 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.935730 12874 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:43.935778 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.936118 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.936169 12879 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:43.937768 13835 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.938133 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:43.942313 12731 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.849754 13848 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:06:43.899746 13825 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.003s
I20260709 13:06:43.852563 13819 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.926285 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.928716 13826 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.008s
I20260709 13:06:43.951608 13826 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:43.952981 13819 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.952972 12873 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.954602 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:43.955237 13826 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:43.931363 13797 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.004s
W20260709 13:06:43.931777 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55970.6us
I20260709 13:06:43.925478 13802 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.924728 13821 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.892165 13721 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.020s
I20260709 13:06:43.932010 13834 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.944856 12806 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.945204 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:43.948873 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:43.950697 13848 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.955468 12725 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:43.957507 13831 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:43.960877 13838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc76143509f64c4faa68973765829aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.864845 13809 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.887281 13827 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:43.962462 13837 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.006s
I20260709 13:06:43.965727 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.963871 13797 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.885919 13832 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.973440 13834 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:43.974448 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1293) took 1020 ms. Trace:
I20260709 13:06:43.988978 12874 rpcz_store.cc:276] 0709 13:06:42.954049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.954154 (+   105us) service_pool.cc:224] Handling call
0709 13:06:43.974237 (+1020083us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54000c8ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:43.974386 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255351040}
I20260709 13:06:43.974465 12876 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.976850 12881 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.966571 13721 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.975620 12877 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.987964 13841 tablet_copy_client.cc:323] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:06:43.956511 13825 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:43.981575 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:43.993013 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:43.988703 13845 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.991007 13817 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:43.997049 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:43.997951 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 257624us
I20260709 13:06:43.989171 13806 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:44.002954 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:43.979738 13837 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.007633 12878 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.008797 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.015041 13834 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.015784 13815 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.016196 13815 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.017004 13815 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.019665 12882 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.020160 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.021472 13821 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.021803 13808 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:44.022342 13808 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:43.999830 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57849.6us
I20260709 13:06:44.024345 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.024714 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.026719 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.018221 13815 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.987824 13843 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:44.024634 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.030853 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.013379 13806 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:44.037940 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.040890 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.041958 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.035753 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.004627 13836 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.023234 13808 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.044955 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.046639 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.047115 12730 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.047464 13812 raft_consensus.cc:1064] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:44.048508 13817 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.048957 13817 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.049433 12730 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.049831 13817 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.039106 13810 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.061697 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:44.066519 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.069242 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.070035 12878 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.073633 12724 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.071794 13813 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:44.043599 13814 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:44.074673 13805 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:44.081229 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.069650 13821 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:44.049923 13812 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.056317 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:44.115103 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.103618 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:44.078734 13796 consensus_meta.cc:287] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.692s	user 0.003s	sys 0.012s
I20260709 13:06:44.133669 12878 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:44.080356 13813 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:44.134876 13514 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.135265 13852 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:06:44.080641 13817 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.144908 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:44.097956 13810 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:44.078070 13800 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.166824 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:44.129055 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50059.3us
I20260709 13:06:44.137157 13827 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.135926 13813 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.195083 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.195803 12874 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.077283 13811 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:06:44.144389 13852 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.158291 13797 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.159332 13854 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:44.203794 13854 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.204208 13854 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.140738 13796 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.159511 13810 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.210687 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.209738 12880 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:44.213938 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.150889 13821 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.219556 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.221143 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.199599 13852 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:44.225346 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.221330 12799 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.227092 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.228487 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.239403 12875 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.236004 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.239868 12882 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.164463 13806 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.250660 13800 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:44.246343 13852 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.235258 13791 tablet_copy_client.cc:538] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:44.235129 13811 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.256785 13854 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.270632 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.236227 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:44.263633 13849 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.008s
I20260709 13:06:44.233300 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:44.289960 12874 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:44.262770 13836 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:44.291545 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 253652us
I20260709 13:06:44.292217 12882 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.265151 13811 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:44.296484 12874 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.317231 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.317713 12881 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.318447 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.318902 12881 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.324819 12699 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.340266 12874 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.345029 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.321511 13819 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.315901 13854 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.323678 13845 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:44.315768 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 92607.6us
I20260709 13:06:44.293670 13802 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.290563 13849 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.359375 12874 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.372341 12881 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:44.381462 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.372071 13819 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.371955 13833 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.390340 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:06:44.371624 13857 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:06:44.368566 13858 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:44.353946 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 141896us
W20260709 13:06:44.374346 13818 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.004s
I20260709 13:06:44.403362 13520 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.414173 13823 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.414597 12874 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.408519 13721 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.410563 12879 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.416733 12879 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.416846 12874 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.418946 12882 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.369757 13845 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:44.425153 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.354945 12877 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.426880 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:44.384061 13796 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.429286 13721 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.425856 13845 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.430689 13825 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.432283 13840 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.378309 13802 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:44.385563 13810 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:44.437139 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.432685 13840 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.439327 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1305) took 1365 ms. Trace:
I20260709 13:06:44.440403 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.380183 13835 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:44.444090 12876 rpcz_store.cc:276] 0709 13:06:43.067700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.068738 (+  1038us) service_pool.cc:224] Handling call
0709 13:06:43.069032 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.990215 (+921183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.433215 (+443000us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400139a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:44.433472 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081923456}
I20260709 13:06:44.457832 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.369940 13848 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.440156 13823 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.460690 12771 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.509s (SENT) [suppressed 5 similar messages]
I20260709 13:06:44.369108 13811 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.480520 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.485677 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.463238 12727 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.486766 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:44.511240 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.517644 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.464545 13825 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.477207 13833 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.518821 13791 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:44.478262 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:44.477085 13721 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.523761 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.476361 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 489507us
I20260709 13:06:44.526579 13825 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.489863 13797 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.532562 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.534031 13848 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:44.490772 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120209us
I20260709 13:06:44.537606 12848 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.539038 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.494750 13828 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.542335 13721 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.519125 13826 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.595641 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53200.5us
I20260709 13:06:44.601346 13843 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:44.601925 13844 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.602793 13843 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:44.604265 13861 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:44.605823 13814 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.606354 13814 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.592646 13796 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:44.608274 13815 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.608803 13815 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.609576 13849 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:44.609895 13815 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.611495 13815 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.612546 13798 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.613022 13798 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:44.613732 13858 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.524788 13840 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.607725 13796 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.614976 13798 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.589495 12802 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:06:44.626012 13863 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:44.602826 13844 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:44.626078 13854 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:44.629540 13798 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.607645 13814 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.632373 13821 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:44.593477 13820 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.943s	user 0.009s	sys 0.007s
I20260709 13:06:44.546528 13811 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.659827 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.661048 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:44.640219 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 295293us
I20260709 13:06:44.651715 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:44.653041 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 114074us
I20260709 13:06:44.656366 12800 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:44.657251 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.665650 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.667651 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.668875 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.669107 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.670537 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.678066 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.679710 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.682027 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:44.685824 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.686436 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.692770 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.702153 12848 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.676584 13849 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.672761 13823 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.735435 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44845.2us
I20260709 13:06:44.673187 13820 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.681538 13826 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.750325 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:44.751825 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49859.9us
I20260709 13:06:44.758232 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.764222 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.684207 13821 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.739382 13827 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.681214 12817 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 562422a4dc1a44a7bca3a549839874be from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:06:44.690994 13837 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.690201 13825 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.734553 13830 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.782588 13827 consensus_queue.cc:1059] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:44.783056 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.695819 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.783720 13827 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.784103 13827 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:44.784982 13827 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:44.785888 13827 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.789354 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.793888 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.779608 13823 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:44.795360 13823 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:44.795706 13823 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:44.796626 13823 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.797618 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:44.797806 13823 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.794023 13820 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:44.801527 13822 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:44.802167 13822 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.795784 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.735285 13796 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:44.807156 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.813719 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.815081 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:44.739930 13814 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.779395 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.779709 13828 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.779558 12817 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 562422a4dc1a44a7bca3a549839874be from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-562422a4dc1a44a7bca3a549839874be
I20260709 13:06:44.779928 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.780506 12726 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.761210 13802 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.809638 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.810994 13487 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:44.690801 13843 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:06:44.677260 13840 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.816959 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.815315 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.818317 12801 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.818425 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.848428 12808 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:44.829294 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:44.779603 13859 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.188s	user 0.000s	sys 0.004s
I20260709 13:06:44.833742 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:44.834467 12879 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:44.834803 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.836985 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.796622 12729 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.844276 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:06:44.847170 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 371148us
I20260709 13:06:44.848073 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.762126 13865 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:06:44.761639 13844 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:44.859797 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.864257 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:44.863459 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 402829us
I20260709 13:06:44.850302 13849 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.870890 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:44.858053 12802 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.878374 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:44.879212 12806 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:44.875188 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.881204 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:44.882642 12847 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:44.897056 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.867038 13828 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.934007 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.896057 13827 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.879522 13817 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.007s
W20260709 13:06:44.908687 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.890089 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.893395 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:44.943197 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1071) took 1259 ms. Trace:
I20260709 13:06:44.887538 13825 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.894037 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:44.952118 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 65671.2us
I20260709 13:06:44.870626 13797 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.951355 12726 rpcz_store.cc:276] 0709 13:06:43.683403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.683527 (+   124us) service_pool.cc:224] Handling call
0709 13:06:43.683765 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.839201 (+1155436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.942862 (+103661us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540038fc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:44.943092 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514796416}
I20260709 13:06:44.896260 13845 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.952931 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62991.7us
I20260709 13:06:44.889521 12728 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.892198 13830 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.976760 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.892472 13823 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.979223 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.982947 12771 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.955583 13822 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:45.008932 12771 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.010285 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:44.951658 13815 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.894912 13843 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:06:45.014688 12802 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:45.014907 13852 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.887779 13796 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:06:45.023296 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.026322 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.029531 12801 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:45.030821 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.032292 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.033326 12801 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
W20260709 13:06:45.034709 12697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.012s	sys 0.011s
W20260709 13:06:45.035038 12697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.011s
I20260709 13:06:45.017787 13822 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.011967 13863 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:45.041091 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 63448.3us
I20260709 13:06:45.024452 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.029778 13825 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.032166 13823 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.016745 13817 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:45.031791 13798 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.040587 13815 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.035017 13843 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:45.039999 13838 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 13:06:45.061090 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:45.037040 13827 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:45.054865 13800 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.082199 13800 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:45.083163 13800 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.083986 12879 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:45.083968 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.086009 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.086829 12801 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:45.084458 13800 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.086211 13845 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:45.091642 13838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38668 (request call id 116) took 2333 ms. Trace:
I20260709 13:06:45.092110 13838 rpcz_store.cc:276] 0709 13:06:42.758289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.758457 (+   168us) service_pool.cc:224] Handling call
0709 13:06:43.194713 (+436256us) ts_tablet_manager.cc:934] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
0709 13:06:43.950280 (+755567us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:44.535069 (+584789us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:44.535195 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:45.090825 (+555630us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:45.091160 (+   335us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:45.091516 (+   356us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:45.091582 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44342,"tablet-copy.queue_time_us":288026,"thread_start_us":670997,"threads_started":2}
I20260709 13:06:45.093003 13822 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.093600 13838 tablet_copy_client.cc:806] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:45.093664 13822 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:45.094277 13838 tablet_copy_client.cc:670] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:45.094636 13822 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.065448 13843 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:45.096555 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:45.097306 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.093952 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.096331 13843 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:45.054390 12802 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.109812 12805 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
W20260709 13:06:45.103441 13866 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:06:45.103957 13842 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:45.102860 13843 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.124007 13842 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:45.105654 13812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.024s
I20260709 13:06:45.120986 13811 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:45.086975 13815 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.114598 13822 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:45.136598 13812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.017s	sys 0.025s
I20260709 13:06:45.128961 13842 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:45.102332 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.135360 13853 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.140410 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:06:45.151676 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 291966us
W20260709 13:06:45.193034 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52738.4us
I20260709 13:06:45.194092 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:45.124336 13808 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:45.195283 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:45.204209 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.205674 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.156231 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1084) took 1430 ms. Trace:
I20260709 13:06:45.206550 12728 rpcz_store.cc:276] 0709 13:06:43.725662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.750246 (+ 24584us) service_pool.cc:224] Handling call
0709 13:06:43.778489 (+ 28243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.983496 (+1205007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.155860 (+172364us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400411c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:45.156141 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554787584}
W20260709 13:06:45.214078 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.216719 12733 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:45.215113 13796 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.219465 13796 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.219928 13796 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.181164 13828 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:45.241101 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48737.8us
I20260709 13:06:45.209080 13827 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.215553 13821 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.215181 13826 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.215036 13825 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.215396 13835 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.258510 12803 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:45.224092 13853 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:45.250896 13827 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.284571 13854 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.244249 13828 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.306751 13828 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.307543 13828 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.275563 13825 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:45.309027 13825 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.261114 13820 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:45.261682 13876 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:45.291486 13827 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.319454 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:45.292621 13854 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:45.270588 13835 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.326256 13853 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.317947 13842 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:45.344378 13875 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:45.348896 13820 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.349526 13820 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:45.324013 13828 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:45.361925 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.373504 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.339943 13815 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:45.394475 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 384267us
I20260709 13:06:45.395598 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:45.397573 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 215925us
I20260709 13:06:45.400811 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.412333 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.413444 13843 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.415485 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.392930 13721 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.391414 13826 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.350636 13820 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.431604 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:45.424856 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.394744 13837 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.434991 12807 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:45.411574 13849 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:45.407503 13823 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.417927 13861 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.411733 13815 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.439836 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.440562 12802 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:06:45.455912 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.427749 13721 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:45.468591 12771 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.445037 13818 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.456509 13836 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.432135 13869 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.456808 13844 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.458678 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.433549 13843 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:45.467540 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.485661 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:45.395018 13854 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.467865 12804 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.470342 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.444402 13840 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.462204 13823 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:06:45.475921 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 257919us
I20260709 13:06:45.434458 13826 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.478876 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.479274 13888 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.481318 13796 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.487834 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:45.516474 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.523761 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.524665 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.489229 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.473119 12805 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.463805 13835 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.491768 13880 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.470867 13814 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.532550 12806 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:45.493889 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.496677 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.501171 13721 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.502527 12817 tablet_copy_source_session.cc:215] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:45.482875 13836 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.503876 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.503929 13838 tablet_copy_client.cc:538] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:45.504974 13876 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.473515 13818 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:45.509826 13830 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.464164 13837 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:45.530660 13821 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.552562 13821 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.553246 13837 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.553783 13837 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.476161 13817 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.473163 13797 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.516144 13798 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.516443 13815 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:45.519469 12803 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:45.520268 13854 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.528564 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.534721 13877 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.515769 12799 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
W20260709 13:06:45.541494 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47722.2us
I20260709 13:06:45.486709 13869 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.528228 13800 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.549868 13836 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:45.550843 13818 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.510524 13849 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.554076 13826 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.554540 13821 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.572749 12725 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:45.575680 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:45.546840 13802 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.546478 13853 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:45.589305 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60820.9us
I20260709 13:06:45.556638 13876 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:45.545506 13835 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:45.591575 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.577518 13828 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:45.560878 13797 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.601521 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:45.587958 13798 consensus_queue.cc:1243] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:45.601923 13802 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.596642 13880 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.607331 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.630393 12806 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:45.524262 13888 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:45.612437 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.617756 13869 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:45.620915 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 117148us
I20260709 13:06:45.621673 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.609782 13818 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.645305 12878 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.547468 13823 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.606428 13819 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:45.633523 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.599787 13826 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.641549 12800 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:45.606544 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.653724 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.648268 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.643203 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:45.650731 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:45.653807 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47353.7us
I20260709 13:06:45.656468 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.658353 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:45.661383 12728 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.663944 12876 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:45.640337 13808 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.675464 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.643847 13828 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.648957 13819 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:45.672731 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.677942 12873 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.685072 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.687712 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:45.662647 13815 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.662495 13798 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.682760 13823 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.651593 13833 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:45.674934 12875 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.719337 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:45.666050 13800 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.732681 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.734408 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:45.740671 12874 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.726802 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.739046 12806 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2. Re-sending same reply.
I20260709 13:06:45.733701 13796 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.743453 13796 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.743862 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:45.744279 13821 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.745319 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.743968 13796 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.745819 13821 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.748464 13821 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:45.729538 13791 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:45.667536 13826 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.762113 12806 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:45.878633 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 116659us
W20260709 13:06:45.893078 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.689777 13828 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.739275 13870 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.757426 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:45.878566 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:45.931051 13837 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:06:45.943614 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 342182us
I20260709 13:06:45.728478 13869 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.682039 13840 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:06:45.669219 13877 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:06:45.954753 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.965370 12800 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:45.949232 13849 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.946554 13791 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.032425 13817 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.033061 13817 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:46.033692 13791 tablet_bootstrap.cc:492] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:46.004328 13802 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.034905 13791 ts_tablet_manager.cc:1403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.541s	user 0.025s	sys 0.030s
I20260709 13:06:45.813372 13819 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:45.727905 13880 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
I20260709 13:06:45.972947 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:45.998914 13800 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:46.003181 13796 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.004813 13821 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:45.954850 13852 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:45.950780 13888 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:45.966920 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 291332us
I20260709 13:06:46.026262 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.049557 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.050441 12800 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:46.051695 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.019783 13869 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:46.055465 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1333) took 1233 ms. Trace:
I20260709 13:06:46.057958 13843 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.058568 13843 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:46.044922 13895 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:45.954299 13797 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:45.961467 13815 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:06:46.028883 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.029925 13828 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.007107 13833 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:45.947515 13841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562422a4dc1a44a7bca3a549839874be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.031774 13849 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.043627 13796 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:46.046571 13899 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.047014 13826 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:46.070202 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97357us
I20260709 13:06:45.923383 13876 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.067777 13840 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.073976 12800 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:46.065675 13895 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:45.996120 13870 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.071048 12804 rpcz_store.cc:276] 0709 13:06:44.822543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.097804 (+275261us) service_pool.cc:224] Handling call
0709 13:06:45.467651 (+369847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.487077 (+ 19426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.055025 (+567948us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540028c650. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:46.055375 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825687936}
W20260709 13:06:46.176725 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.078100 13810 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.066295 13880 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.063979 13869 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.072677 13798 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:46.236183 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:46.325289 12874 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:46.069698 13852 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:46.266357 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.047945 13837 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.391211 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:46.264569 13484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.036s
I20260709 13:06:46.074975 13843 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.255362 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:46.438350 12873 raft_consensus.cc:2376] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2. Re-sending same reply.
I20260709 13:06:46.280972 13810 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:46.441442 13810 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.444293 13810 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.276583 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.453856 12724 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.249140 13840 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:46.262306 13820 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:46.462775 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.383803 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:46.485190 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:46.485427 12728 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:46.451581 13827 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.114s	user 0.013s	sys 0.003s
W20260709 13:06:46.475731 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 165763us
W20260709 13:06:46.449432 13484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.011s	sys 0.050s
I20260709 13:06:46.351749 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.370589 13826 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:46.316772 13880 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:46.383857 13903 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:46.405244 13798 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:46.360244 13825 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:46.437423 12696 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 562422a4dc1a44a7bca3a549839874be. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:46.522205 12698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.017s	sys 0.020s
I20260709 13:06:46.447885 13814 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.258355 13796 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:46.249368 13849 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.504784 12729 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.400740 13901 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:46.523213 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.082s	sys 0.153s
W20260709 13:06:46.523514 12698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.017s	sys 0.020s
W20260709 13:06:46.584873 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.083s	sys 0.153s
I20260709 13:06:46.460368 13863 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:46.523300 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 86194.8us
I20260709 13:06:46.515202 13843 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.522369 12730 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.592321 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:46.522784 13870 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:46.594774 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.280917 13899 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:46.600855 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 122813us
I20260709 13:06:46.514107 13815 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:06:46.507104 13827 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.565609 13797 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.618568 13823 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.000s
I20260709 13:06:46.618495 13797 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.617568 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:46.585776 13821 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.582664 13888 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.599391 13818 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.946s	user 0.013s	sys 0.001s
W20260709 13:06:46.609885 13854 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.027s	user 0.013s	sys 0.003s
I20260709 13:06:46.588853 13828 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.570485 13814 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.619724 13823 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.521670 13826 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.533872 13825 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.639609 12808 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:46.592180 13833 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.643499 12879 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:46.628808 13904 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:06:46.647010 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.598443 13863 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.631645 13905 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.596082 13791 raft_consensus.cc:359] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:46.581725 13903 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.666317 13852 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.673852 13852 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:46.674620 13852 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.675312 13903 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.634617 13821 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.676755 13906 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.677814 13852 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.681237 13519 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:46.592686 13901 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:46.679675 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 82576.4us
I20260709 13:06:46.680608 12881 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:46.667526 13838 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:06:46.654649 13900 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.091s	sys 0.220s
I20260709 13:06:46.637193 13888 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.698525 13852 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.680251 13791 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:46.645212 13828 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.650242 13823 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:46.700928 13844 consensus_meta.cc:287] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.217s	user 0.016s	sys 0.002s
I20260709 13:06:46.722712 13521 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:46.677501 13906 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.725804 13906 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.683075 13903 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:46.726953 13903 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:46.703460 13900 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.092s	sys 0.220s
I20260709 13:06:46.678316 13821 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:46.696738 13897 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:46.663623 13833 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.648784 13798 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.708518 13797 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.742592 13821 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:46.769050 13899 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.722270 13852 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.769205 13821 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.753605 13797 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:46.731665 13909 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:46.754678 13898 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:06:46.746114 13895 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:46.642515 13880 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.752472 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:46.763031 13796 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.747357 13897 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.798841 12731 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:46.783327 13849 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.703008 13905 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.791374 13844 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.798944 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:46.817158 13826 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.804616 13812 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.835906 13914 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:06:46.807010 13814 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.842142 13901 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.792766 13797 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.748562 13791 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:46.819689 13844 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.858040 13833 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.864064 13905 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:46.871137 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.838928 13825 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.832682 13849 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:46.876021 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.879392 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.881476 13721 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.882072 13800 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.886202 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.858757 13858 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.839866 13516 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:46.889061 12727 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.888970 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1352) took 1377 ms. Trace:
I20260709 13:06:46.840477 13812 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.889379 13863 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.895116 13828 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.895144 13915 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.895244 13840 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:46.901221 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.885159 13814 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.932008 12802 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:46.932133 13814 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.907660 13800 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.905151 13861 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:46.898510 12801 rpcz_store.cc:276] 0709 13:06:45.496597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.497099 (+   502us) service_pool.cc:224] Handling call
0709 13:06:45.497349 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.872152 (+1374803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.872198 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.872251 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.872302 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.873596 (+  1294us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400030cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:46.873649 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.873813 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161298816}
I20260709 13:06:46.907282 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1361) took 1250 ms. Trace:
I20260709 13:06:46.933851 13915 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.938890 12879 rpcz_store.cc:276] 0709 13:06:45.656539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.662312 (+  5773us) service_pool.cc:224] Handling call
0709 13:06:45.691401 (+ 29089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.654724 (+963323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.907064 (+252340us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b5400209ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:46.907218 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189236480}
I20260709 13:06:46.908134 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.800524 13909 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:46.892426 13888 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:46.942193 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:46.930253 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:46.935452 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:46.897595 13858 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:46.939476 13814 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.943822 12800 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:46.949460 13800 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:46.934618 13854 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.958009 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 188447us
W20260709 13:06:46.960050 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.937980 13828 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.939733 13825 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.898262 13849 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.000725 12806 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:46.951380 13826 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:47.092201 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 132333us
I20260709 13:06:47.094312 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:46.962067 13814 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.942868 13861 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.083856 13826 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.164974 13890 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.166183 13915 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:47.146706 12807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1326) took 2428 ms (client timeout 2221 ms). Trace:
I20260709 13:06:46.961629 13854 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.197422 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1353) took 1550 ms. Trace:
I20260709 13:06:47.163779 13858 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.199631 13858 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.067134 13828 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.202529 13828 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:47.191715 12807 rpcz_store.cc:269] 0709 13:06:44.650840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.660406 (+  9566us) service_pool.cc:224] Handling call
0709 13:06:46.998669 (+2338263us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001b5154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.065682 (+ 67013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390567808}
W20260709 13:06:47.158780 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62760.7us
I20260709 13:06:47.084249 13863 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.161954 13843 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.176508 13826 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.198096 12878 rpcz_store.cc:276] 0709 13:06:45.647161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.647313 (+   152us) service_pool.cc:224] Handling call
0709 13:06:45.647628 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.659545 (+ 11917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.659593 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.659648 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.659690 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.197104 (+1537414us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54000717d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:47.197168 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.197346 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26831616}
I20260709 13:06:47.179713 13897 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.086066 13825 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:47.230978 13854 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:47.244598 13909 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.213272 13863 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.219050 13843 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.301023 12805 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:47.282825 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.285444 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1362) took 1786 ms. Trace:
W20260709 13:06:47.301033 12698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.048s	sys 0.073s
W20260709 13:06:47.371073 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 150795us
I20260709 13:06:47.330933 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:47.371724 12698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.052s	sys 0.076s
W20260709 13:06:47.368125 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.372478 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.013s	sys 0.023s
W20260709 13:06:47.372820 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.013s	sys 0.023s
I20260709 13:06:47.237042 13844 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.248566 13791 ts_tablet_manager.cc:1434] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 1.213s	user 0.020s	sys 0.009s
I20260709 13:06:47.371515 12806 rpcz_store.cc:276] 0709 13:06:45.499196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.967581 (+468385us) service_pool.cc:224] Handling call
0709 13:06:47.000254 (+1032673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.065681 (+ 65427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.285253 (+219572us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001b5150. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.285382 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302377856}
W20260709 13:06:47.272943 12729 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.000s
W20260709 13:06:47.325382 12846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.100s	sys 0.228s
I20260709 13:06:47.293819 13897 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.281795 13842 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.359368 13825 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.293982 13909 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.386838 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:47.395195 12846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.105s	sys 0.252s
I20260709 13:06:47.312387 13828 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.390379 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.369280 13922 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.273808 13849 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:47.424763 13887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.013s
I20260709 13:06:47.392601 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.333528 13921 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.312796 13888 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:47.301066 12799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1327) took 2648 ms (client timeout 2183 ms). Trace:
I20260709 13:06:47.374490 13821 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:47.401023 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:47.384245 13791 ts_tablet_manager.cc:1467] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Tablet startup took 1348ms
I20260709 13:06:47.388378 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:47.426275 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.446884 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.397575 13814 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.312655 13721 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:47.425072 13798 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.005s	sys 0.011s
I20260709 13:06:47.458145 12801 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:47.363891 13817 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.397820 13915 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.383301 13806 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.477257 13814 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.423898 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.427063 12800 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:47.468158 12803 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:47.468792 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.469079 13930 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:47.458642 13922 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.471056 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:47.450744 13828 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.392752 13890 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:06:47.459542 13484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.008s	sys 0.011s
I20260709 13:06:47.397920 13844 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:06:47.436872 13928 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.425496 13897 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.474381 13861 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:47.476392 13821 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.477283 13932 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.442248 13825 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.460673 13887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.001s	sys 0.014s
W20260709 13:06:47.548496 13484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.008s	sys 0.011s
W20260709 13:06:47.526119 13900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.030s	sys 0.042s
I20260709 13:06:47.474349 13921 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.474161 13888 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:06:47.550246 13798 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.006s	sys 0.016s
I20260709 13:06:47.506049 13721 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.516441 13806 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.449826 13909 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:47.563952 13900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.030s	sys 0.043s
W20260709 13:06:47.574257 13837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.029s	sys 0.022s
I20260709 13:06:47.554015 13928 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.518604 13915 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.576508 13843 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:47.567910 13932 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.393970 12729 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:47.641750 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.015s	sys 0.008s
I20260709 13:06:47.466645 12725 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:47.585296 13863 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.425920 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.473312 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.521605 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.516441 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.561156 13825 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.555197 13826 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.473440 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.553383 13930 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:06:47.468684 12773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.015s	sys 0.015s
I20260709 13:06:47.805917 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1353) took 2308 ms. Trace:
I20260709 13:06:47.819696 12876 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:47.814242 12881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1350) took 2171 ms (client timeout 1853 ms). Trace:
I20260709 13:06:47.822247 13519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 143) took 1205 ms. Trace:
I20260709 13:06:47.815897 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1357) took 2164 ms. Trace:
I20260709 13:06:47.822598 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1362) took 2159 ms. Trace:
W20260709 13:06:47.822464 12881 rpcz_store.cc:269] 0709 13:06:45.642565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.642890 (+   325us) service_pool.cc:224] Handling call
0709 13:06:47.813628 (+2170738us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400208ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.813905 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217819904}
I20260709 13:06:47.808347 12804 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.826432 12882 rpcz_store.cc:276] 0709 13:06:45.650922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.651050 (+   128us) service_pool.cc:224] Handling call
0709 13:06:45.651398 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.915650 (+264252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.915687 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.915733 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.915766 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.815242 (+1899476us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54004204d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:47.815333 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.815641 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607024000}
I20260709 13:06:47.829351 12804 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:47.799588 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:47.830862 12729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1093) took 1453 ms (client timeout 1651 ms). Trace:
W20260709 13:06:47.831573 12729 rpcz_store.cc:269] 0709 13:06:46.377624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.380261 (+  2637us) service_pool.cc:224] Handling call
0709 13:06:47.830535 (+1450274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45568}
I20260709 13:06:47.813673 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.699048 13798 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.833385 12806 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:06:47.789796 13858 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.012s
I20260709 13:06:47.833811 13798 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.835366 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:47.836748 13837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.035s	sys 0.027s
I20260709 13:06:47.836608 12804 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.822862 13519 rpcz_store.cc:276] 0709 13:06:46.617173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.617329 (+   156us) service_pool.cc:224] Handling call
0709 13:06:47.821719 (+1204390us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400670a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.821961 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138086656}
I20260709 13:06:47.838084 12804 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.838248 13837 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.835884 13819 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.827596 12876 rpcz_store.cc:276] 0709 13:06:45.663448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.668308 (+  4860us) service_pool.cc:224] Handling call
0709 13:06:47.818383 (+2150075us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:47.818863 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.822094 (+  3231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.822448 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11063552}
W20260709 13:06:47.460631 12799 rpcz_store.cc:269] 0709 13:06:44.651237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.660335 (+  9098us) service_pool.cc:224] Handling call
0709 13:06:44.782895 (+122560us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b5800047a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:47.287601 (+2504706us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000334d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.299969 (+ 12368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210888192}
I20260709 13:06:47.839349 13837 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.823046 12808 rpcz_store.cc:276] 0709 13:06:45.496902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.497527 (+   625us) service_pool.cc:224] Handling call
0709 13:06:45.497754 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.650542 (+1152788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.804842 (+1154300us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:47.805519 (+   677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625161088}
I20260709 13:06:47.602406 13941 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.602216 13940 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.828395 12773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.020s	sys 0.021s
I20260709 13:06:47.824205 13930 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.850836 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.859197 13826 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:47.528371 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.860526 12800 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:47.665798 12802 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:47.797192 13845 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:47.829466 13823 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.881526 12799 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:47.882773 12808 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.791230 13915 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:47.857661 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.021s	sys 0.015s
I20260709 13:06:47.864516 12732 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.747229 13909 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.643464 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.695930 13806 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.703928 13814 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.570437 13821 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.891979 13940 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:47.895212 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 950028us
I20260709 13:06:47.895028 13821 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.896687 13935 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:47.897621 12733 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.898093 13821 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.898401 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1103) took 1467 ms. Trace:
I20260709 13:06:47.827864 13843 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.898850 12733 rpcz_store.cc:276] 0709 13:06:46.431142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.450454 (+ 19312us) service_pool.cc:224] Handling call
0709 13:06:47.896459 (+1446005us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:47.897096 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.898043 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.898315 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53371136}
I20260709 13:06:47.900213 13903 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.900096 13843 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.900712 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:47.901710 12806 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:47.901942 13940 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.902776 13943 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.903291 12801 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:47.826674 13863 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.881625 13845 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.906822 13863 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.907711 13828 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.909137 13863 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:47.671643 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 340722us
I20260709 13:06:47.910429 13880 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.911552 12848 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:47.733500 13897 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.888669 13941 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.919157 13941 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.889518 13946 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.890304 13826 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:47.890615 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.903754 13943 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.909245 13852 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.728595 13861 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.505894 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.467489 13791 ts_tablet_manager.cc:1469] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Trace:
0709 13:06:40.586644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.586831 (+   187us) service_pool.cc:224] Handling call
0709 13:06:40.588092 (+  1261us) ts_tablet_manager.cc:934] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:06:42.837310 (+2249218us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:43.131926 (+294616us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:43.132063 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:43.345072 (+213009us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:43.347572 (+  2500us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:43.347954 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:43.348029 (+    75us) inbound_call.cc:177] Queueing success response
0709 13:06:44.486298 (+1138269us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:46.035461 (+1549163us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:46.065191 (+ 29730us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:46.066576 (+  1385us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":339,"mutex_wait_us":16016,"raft.queue_time_us":5900,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":18455,"tablet-copy.queue_time_us":148,"tablet-download-pool.queue_time_us":145,"tablet-download-pool.run_cpu_time_us":2668,"tablet-download-pool.run_wall_time_us":866507,"thread_start_us":789735,"threads_started":1}
I20260709 13:06:47.913736 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 69) took 4267 ms. Trace:
W20260709 13:06:47.922343 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.920529 13946 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.924074 13826 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.926381 13845 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.931732 13929 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:47.932749 13903 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.932667 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.934438 13514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 122) took 1303 ms. Trace:
I20260709 13:06:47.946154 13903 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:47.946859 13861 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:47.948423 12728 raft_consensus.cc:2393] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:47.949170 13837 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.946171 13514 rpcz_store.cc:276] 0709 13:06:46.646262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.647046 (+   784us) service_pool.cc:224] Handling call
0709 13:06:47.824229 (+1177183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.824990 (+   761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.825115 (+   125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.825206 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.825257 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.825370 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.933929 (+108559us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400670a50. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:47.934125 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625411968}
I20260709 13:06:47.949911 13903 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.950230 13861 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.948357 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:47.951963 13877 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:47.952369 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.936506 12627 rpcz_store.cc:276] 0709 13:06:43.646538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.646693 (+   155us) service_pool.cc:224] Handling call
0709 13:06:47.913340 (+4266647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.946075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:43.996483 (+ 50408us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:43.999095 (+  2612us) write_op.cc:435] Acquired schema lock
0709 13:06:44.001180 (+  2085us) tablet.cc:662] Decoding operations
0709 13:06:44.050989 (+ 49809us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.068008 (+ 17019us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.074281 (+  6273us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:44.133647 (+ 59366us) tablet.cc:701] Row locks acquired
0709 13:06:44.137418 (+  3771us) write_op.cc:260] PREPARE: finished
0709 13:06:44.164239 (+ 26821us) write_op.cc:270] Start()
0709 13:06:44.198786 (+ 34547us) write_op.cc:276] Timestamp: P: 1783602404162805 usec, L: 0
0709 13:06:44.200424 (+  1638us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.347829 (+147405us) log.cc:844] Serialized 529 byte log entry
0709 13:06:44.801779 (+453950us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:06:45.219639 (+417860us) op_driver.cc:464] REPLICATION: finished
0709 13:06:45.591447 (+371808us) write_op.cc:301] APPLY: starting
0709 13:06:46.849788 (+1258341us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5400355da8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f47faf9e1 00007f0f47fae64c 00007f0f4563ee10 00007f0f4562a97c 00007f0f4562ed61 00007f0f4562ed19 00007f0f4562eca9 00007f0f4562ec71 00007f0f4562de9d 000000000038f354 000000000038f199
0709 13:06:46.849940 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.850059 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.850079 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.850364 (+   285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.850562 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:46.850605 (+    43us) write_op.cc:312] APPLY: finished
0709 13:06:46.850881 (+   276us) log.cc:844] Serialized 22 byte log entry
0709 13:06:47.568637 (+717756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.575775 (+  7138us) write_op.cc:454] Released schema lock
0709 13:06:47.578780 (+  3005us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:47.789232 (+210452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.789343 (+   111us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":21248,"child_traces":[["op",{"apply.queue_time_us":319423,"apply.run_cpu_time_us":33657,"apply.run_wall_time_us":2156521,"num_ops":1,"prepare.queue_time_us":170211,"prepare.run_cpu_time_us":50751,"prepare.run_wall_time_us":855929,"raft.queue_time_us":211009,"raft.run_cpu_time_us":24969,"raft.run_wall_time_us":214426,"replication_time_us":1018967,"spinlock_wait_cycles":17418112,"thread_start_us":1625551,"threads_started":5,"wal-append.queue_time_us":1258547,"wal-append.run_cpu_time_us":21425,"wal-append.run_wall_time_us":1268996}]]}
I20260709 13:06:47.951439 13932 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.943359 13943 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.902796 13843 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.952821 13877 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.955776 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:47.956530 13863 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.987694 13860 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:47.939993 13939 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.961185 13815 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.945518 13915 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.962854 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.965737 13827 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.969195 13519 raft_consensus.cc:1217] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:47.937750 13825 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.958271 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:47.982470 13888 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.975872 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1104) took 1544 ms. Trace:
I20260709 13:06:48.017302 13863 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:48.018546 13842 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.018s
I20260709 13:06:48.018723 13943 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.019656 13854 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.020579 13854 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.010231 13939 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.021517 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.022253 13841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38680 (request call id 109) took 5101 ms. Trace:
I20260709 13:06:48.022526 13513 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:48.023175 13854 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.023249 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 43) took 1259 ms. Trace:
I20260709 13:06:48.023694 13939 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.974694 13906 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:47.976770 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:47.969477 13946 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:47.976342 13826 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:47.946264 13942 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.008463 13798 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.010102 13941 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.015995 13944 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.010396 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.010499 13837 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.011631 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.019439 13943 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:47.980921 13928 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:48.026889 13521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 41) took 1502 ms (client timeout 1545 ms). Trace:
I20260709 13:06:48.017771 12724 rpcz_store.cc:276] 0709 13:06:46.431566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.454963 (+ 23397us) service_pool.cc:224] Handling call
0709 13:06:47.974503 (+1519540us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:47.975001 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.975385 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.975415 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.975461 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.975492 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.975552 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.975685 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14737792}
I20260709 13:06:48.024369 13818 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.097404 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 103599us
I20260709 13:06:48.028806 13838 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.102865 13900 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.103148 13928 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.103690 13928 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.103859 13943 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.025734 13797 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:48.015736 13877 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.104347 13798 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.111413 13838 tablet_bootstrap.cc:492] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:48.111177 13798 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:48.118549 13798 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.023991 13854 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.119630 13854 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.122432 13854 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.119077 13941 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.125065 13815 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.127415 13941 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.129864 13817 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.133358 13721 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.134320 13800 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:48.135051 13800 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.136056 13921 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.136579 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.137161 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.137629 12875 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:48.137692 13800 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:48.137894 12878 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:48.139240 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.139596 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.140252 12879 raft_consensus.cc:2393] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:48.140347 12881 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:48.141746 13798 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.141901 12877 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.142531 13798 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.140027 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1358) took 2641 ms. Trace:
I20260709 13:06:48.107090 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.112483 13838 ts_tablet_manager.cc:1403] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.467s	user 0.022s	sys 0.025s
I20260709 13:06:48.093451 13837 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.023936 13513 rpcz_store.cc:276] 0709 13:06:46.764372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.770913 (+  6541us) service_pool.cc:224] Handling call
0709 13:06:48.021132 (+1250219us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:48.023172 (+  2040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5109632}
I20260709 13:06:48.026230 13906 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.106140 13818 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.134402 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.144616 12805 rpcz_store.cc:276] 0709 13:06:45.498085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.644837 (+146752us) service_pool.cc:224] Handling call
0709 13:06:47.294093 (+1649256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.369022 (+ 74929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.139600 (+770578us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54000334d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:48.139814 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3792373120}
I20260709 13:06:48.019701 13915 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:48.225440 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 50171us
I20260709 13:06:48.226565 13915 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.227113 12696 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:48.228415 13876 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.228828 13876 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:48.229171 13876 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.229228 13818 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.233296 13869 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.234055 13869 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.026304 13812 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.032537 13810 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.089337 13514 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
W20260709 13:06:48.096120 13521 rpcz_store.cc:269] 0709 13:06:46.524442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.524594 (+   152us) service_pool.cc:224] Handling call
0709 13:06:48.026440 (+1501846us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003390d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:48.026672 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296247040}
I20260709 13:06:48.148056 13827 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.147660 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:48.162950 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 55154.6us
I20260709 13:06:48.104148 13928 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.101123 13944 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.099232 13860 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.028869 13942 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:48.257369 13942 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.160744 13837 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.178629 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62883.8us
I20260709 13:06:48.180825 13840 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.127861 13815 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.191231 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.181991 13922 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:48.182448 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 227962us
I20260709 13:06:48.192975 13798 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:48.196875 12731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 328) took 3455 ms (client timeout 1533 ms). Trace:
I20260709 13:06:48.197623 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.200801 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 142) took 1583 ms. Trace:
W20260709 13:06:48.314010 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.146690 13863 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.209878 13932 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.329571 13932 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.331135 13863 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.211238 12873 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.212335 12877 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.212471 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.214150 12879 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.217446 12876 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:48.219271 13906 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:48.238817 13827 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.235262 13810 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:48.239589 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 92053.3us
I20260709 13:06:48.240339 13921 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.241513 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:48.326778 13869 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.202842 13838 raft_consensus.cc:359] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:48.297102 12804 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:48.326617 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 99776.4us
W20260709 13:06:48.297117 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.328722 13520 rpcz_store.cc:276] 0709 13:06:46.616778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.620629 (+  3851us) service_pool.cc:224] Handling call
0709 13:06:48.098504 (+1477875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.110844 (+ 12340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.110881 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.110976 (+    95us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.111020 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.111116 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.200367 (+ 89251us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003390d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:48.200572 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238904704}
W20260709 13:06:48.326239 12731 rpcz_store.cc:269] 0709 13:06:44.741660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.741853 (+   193us) service_pool.cc:224] Handling call
0709 13:06:48.196324 (+3454471us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54003b1854. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:48.196565 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4538988416}
I20260709 13:06:48.347815 12881 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:48.350510 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.337895 13827 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.356150 12808 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 1.
I20260709 13:06:48.351691 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.342253 13921 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.357669 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.360941 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1365) took 2706 ms. Trace:
W20260709 13:06:48.357820 13822 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:48.372399 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.372967 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.373265 12876 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:48.374040 13906 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.374136 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.374737 13906 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.375206 13906 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.363288 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.363824 12804 rpcz_store.cc:276] 0709 13:06:45.647572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.386921 (+739349us) service_pool.cc:224] Handling call
0709 13:06:46.447063 (+ 60142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.807869 (+1360806us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540019c420. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b6adc0 00007f0f41bf51c0 00007f0f41bf6231 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c
0709 13:06:48.344900 (+537031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.353840 (+  8940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27976448}
I20260709 13:06:48.374432 12876 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.322562 13876 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.358510 12873 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:48.344695 13838 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:48.339407 13860 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.363340 13921 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.377935 13721 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.379285 12879 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:48.378790 12877 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:48.380306 13932 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.385051 13519 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.359364 12771 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:48.394146 13721 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.401875 13721 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.395247 12881 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:48.406457 13810 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.407513 12873 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.409320 13798 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.409978 13818 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.390570 13877 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.410791 13818 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.411281 13877 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.413609 13877 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.416621 12845 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.418205 13941 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.418741 13941 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.419231 13941 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.420822 13800 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.421639 13800 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.425400 13800 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.022804 13841 rpcz_store.cc:276] 0709 13:06:42.948091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.953228 (+  5137us) service_pool.cc:224] Handling call
0709 13:06:43.505906 (+552678us) ts_tablet_manager.cc:934] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:06:45.606540 (+2100634us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:46.891919 (+1285379us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.893637 (+  1718us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:47.375163 (+481526us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:47.397759 (+ 22596us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:48.021800 (+624041us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:48.021978 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":21602,"tablet-copy.queue_time_us":527425,"thread_start_us":835684,"threads_started":2}
I20260709 13:06:48.406535 13876 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:48.429808 13841 tablet_copy_client.cc:806] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:48.430567 13841 tablet_copy_client.cc:670] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:48.434792 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.437115 13831 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.437968 12876 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.437143 13812 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:48.437239 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.442682 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:06:48.443759 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44542.1us
I20260709 13:06:48.409878 13798 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.445106 13922 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.445542 13922 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.445950 13922 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.444630 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:48.398066 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.446987 13721 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.399681 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.452780 13941 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.457392 13721 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.450809 12882 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
W20260709 13:06:48.463089 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 125937us
W20260709 13:06:48.464217 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.451164 13827 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.471127 13800 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.497816 13800 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.498576 13800 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.456555 12627 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 2, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.501109 12878 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.462704 13869 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:48.479786 13826 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.480208 13519 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:48.517274 13826 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:48.517926 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.480621 13838 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:48.462280 13944 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:48.516649 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.467099 13837 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:48.532783 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.534983 13519 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:48.437238 13876 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:06:48.517961 13826 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.540915 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.560420 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:48.562896 13946 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.563441 12880 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.565565 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:48.566490 13516 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.571233 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:48.572470 13900 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.572954 13900 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.573410 13900 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.442745 13928 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:48.581998 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 153726us
I20260709 13:06:48.585286 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:48.602391 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:48.605551 13817 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:48.605895 13902 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.606201 13484 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:48.606731 13944 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.606961 13487 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:06:48.608098 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69551.1us
W20260709 13:06:48.609180 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 92896.4us
W20260709 13:06:48.609304 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.607426 13944 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.621560 12875 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.604940 13946 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:48.611594 13941 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:48.626617 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:48.630761 13870 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.631328 13797 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.632815 12845 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.635416 13810 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.637494 13513 raft_consensus.cc:1217] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:48.637359 13924 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.626843 13514 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:48.617941 13902 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.637344 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.642645 13946 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:48.607658 13484 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:48.608280 13906 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.644634 13837 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.650229 13520 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.672335 12847 leader_election.cc:336] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.533s (SENT)
I20260709 13:06:48.672781 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.673625 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.674491 12817 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-21f97de57a4f4bf7a4ac5fde6b3bc613 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:48.651160 13902 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.694770 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:48.648972 13943 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.679425 12848 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.680310 13838 ts_tablet_manager.cc:1434] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.532s	user 0.009s	sys 0.004s
I20260709 13:06:48.680930 13944 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.681862 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:48.682343 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.683851 13946 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:48.684172 13721 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.645874 13812 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:48.645921 13798 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.686049 13800 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.686762 13900 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.687481 13876 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:48.687384 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.693602 13826 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.675144 13870 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.656749 13941 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.699252 13902 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.712736 13797 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.715371 13870 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.716094 13941 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.716583 13941 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.716643 13928 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.717617 12728 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.719202 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:48.709728 13876 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:48.720914 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:48.721288 13876 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.722931 13876 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.688822 13921 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.681145 13818 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.705279 12817 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-21f97de57a4f4bf7a4ac5fde6b3bc613 on tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:48.705564 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.705760 12731 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:06:48.700912 13838 ts_tablet_manager.cc:1467] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Tablet startup took 552ms
I20260709 13:06:48.707001 12808 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:48.707952 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 78416.9us
I20260709 13:06:48.702621 13721 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.706426 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.729125 12730 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.732412 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:48.745107 13721 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.732406 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.733245 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.702291 13943 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.737002 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.737823 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.738091 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.738112 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.738970 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.738627 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.740228 13870 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.761094 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.761435 13870 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.762609 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.763428 12725 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:48.740459 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.765378 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.765764 13943 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.766660 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.767318 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:48.761097 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.768294 13797 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.768680 13797 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:48.769071 13797 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.769148 13928 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.769698 13921 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.742323 13900 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.743314 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.743990 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:48.749622 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.748006 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.710391 13827 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.751495 12803 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:48.756608 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.753913 13822 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.784963 12732 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.757274 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:48.744387 13838 ts_tablet_manager.cc:1469] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Trace:
0709 13:06:42.758289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.758457 (+   168us) service_pool.cc:224] Handling call
0709 13:06:43.194713 (+436256us) ts_tablet_manager.cc:934] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
0709 13:06:43.950280 (+755567us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:44.535069 (+584789us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:44.535195 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:45.090825 (+555630us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:45.091160 (+   335us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:45.091516 (+   356us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:45.091582 (+    66us) inbound_call.cc:177] Queueing success response
0709 13:06:45.335708 (+244126us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b18000a0480. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3e9aaed8 00007f0f3eb05de2 00007f0f46b6ad23 00007f0f46b6a55d 00007f0f46c063d8 00007f0f46c37f4e 00007f0f46c1cfdd
0709 13:06:46.636941 (+1301233us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:48.148774 (+1511833us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:48.188841 (+ 40067us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:48.199606 (+ 10765us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":44342,"mutex_wait_us":4487,"raft.queue_time_us":205,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":4639,"spinlock_wait_cycles":20567424,"tablet-copy.queue_time_us":288026,"tablet-download-pool.queue_time_us":6504,"tablet-download-pool.run_cpu_time_us":3566,"tablet-download-pool.run_wall_time_us":397485,"thread_start_us":670997,"threads_started":2}
I20260709 13:06:48.758808 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:48.759441 12729 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:48.772653 13721 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.774287 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.751305 13837 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.781402 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.781603 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.789844 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.786921 13822 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.791185 12725 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:48.786664 12728 raft_consensus.cc:2376] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2. Re-sending same reply.
I20260709 13:06:48.797698 13721 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:48.799431 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.777442 13870 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:48.804436 12807 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:48.805783 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.788872 13837 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:48.786125 13520 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:48.819759 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:48.820349 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.803516 13827 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.831597 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.844558 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:48.808048 12727 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:48.822935 13837 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.847908 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:48.857292 12803 raft_consensus.cc:2376] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2. Re-sending same reply.
I20260709 13:06:48.876272 12878 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.876402 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.876495 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.880198 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:48.848471 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 367) took 1449 ms. Trace:
I20260709 13:06:48.888417 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.879231 12876 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:48.880962 12800 raft_consensus.cc:2376] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2. Re-sending same reply.
I20260709 13:06:48.892222 12882 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:48.902582 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.921168 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.923152 13721 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:48.925156 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.908113 12733 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:48.933884 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:48.938207 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.845587 13827 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:48.934902 12732 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
W20260709 13:06:48.889907 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 254020us
I20260709 13:06:48.951179 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.951543 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.923938 13721 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:48.967692 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:48.969367 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 200591us
I20260709 13:06:48.974829 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.976377 12733 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:48.981652 13840 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.983048 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:48.987433 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.992722 13840 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.992785 12881 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:48.998986 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.999396 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.999733 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:48.998561 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.001657 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.002096 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.002473 12732 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:49.008745 12726 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:48.929620 13929 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.889629 13922 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:48.954474 13906 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.040316 12803 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:49.045234 12728 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:49.044488 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.089629 12879 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.009114 13800 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:49.096554 12880 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.052663 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.085915 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.130748 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.084618 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.082202 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.082455 12874 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:49.148234 12801 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.009337 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.160933 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.161443 12730 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:49.161872 12801 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.089958 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.156493 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.084453 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.041697 13516 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:49.088227 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.082980 13721 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.040964 13822 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:49.050613 13954 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:06:49.164273 12724 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:06:49.166993 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.172917 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.173105 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.168705 12873 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.089128 12802 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.894598 12807 rpcz_store.cc:276] 0709 13:06:47.384145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.385166 (+  1021us) service_pool.cc:224] Handling call
0709 13:06:48.813935 (+1428769us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001c1bd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:48.833304 (+ 19369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929995008}
I20260709 13:06:49.172369 13519 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.089618 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.183189 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.172312 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.177027 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.184393 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.173895 12801 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:49.048570 13826 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:49.177965 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 206919us
I20260709 13:06:49.178225 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:49.050498 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 439396us
I20260709 13:06:49.086354 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.206004 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.088937 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:49.191555 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.194823 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.174207 13818 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.213657 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.197440 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.200152 12845 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:49.203068 12806 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:49.201447 12876 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:49.203804 12882 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.204224 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.181183 13903 raft_consensus.cc:2764] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:49.195549 12800 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:49.088317 13902 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.214757 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.258883 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.259476 12801 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.259761 12879 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.261569 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.262153 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-cc76143509f64c4faa68973765829aec received from {username='slave'} at 127.0.0.1:52082
I20260709 13:06:49.262279 12725 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.263047 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-cc76143509f64c4faa68973765829aec on tablet cc76143509f64c4faa68973765829aec with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:06:49.255137 12724 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.265323 12874 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.273097 12873 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:49.276332 12878 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.270697 12808 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:49.278448 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.204900 12877 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
W20260709 13:06:49.285820 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 85810.7us
W20260709 13:06:49.251490 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46360us
I20260709 13:06:49.310708 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.312454 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.271718 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:49.311208 12875 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:49.360981 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.721385 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.302153 13921 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.300138 12729 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.485953 12879 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 3. Ops: []
W20260709 13:06:49.507400 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.627272 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.732613 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.733677 12878 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.286301 13906 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.670603 13837 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.002s
I20260709 13:06:49.738730 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:49.427821 13941 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.003s
I20260709 13:06:49.735303 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:49.731348 12771 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.075s (SENT) [suppressed 18 similar messages]
W20260709 13:06:49.428865 13968 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:06:49.750571 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1379) took 1032 ms. Trace:
I20260709 13:06:49.353153 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:49.733956 13928 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:49.740420 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.752796 13513 raft_consensus.cc:2393] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:06:49.330327 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.752939 13800 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.758811 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:06:49.347770 13970 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:06:49.475749 13827 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:49.350255 13876 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.003s
W20260709 13:06:49.502207 13797 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.004s
I20260709 13:06:49.767307 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:49.361135 13965 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:49.667457 13822 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:49.347193 13840 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:49.760334 12880 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.752260 13903 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.773533 12731 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:49.751720 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 500895us
I20260709 13:06:49.303306 13818 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.738168 13922 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.784219 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.764582 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.766530 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.784842 12803 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 1.
I20260709 13:06:49.785022 12808 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.765084 12730 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:49.768425 12881 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.768721 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.779517 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:49.769369 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.753417 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:49.791009 12882 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.791144 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.791863 12877 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.744917 13921 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:49.794154 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.794896 12730 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:49.795692 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.795936 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.796633 12725 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:49.797808 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.798604 12730 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:49.799784 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.804003 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.804500 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.805635 12877 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.805967 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:49.806444 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.755748 13906 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.807339 12873 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.808007 13962 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.808528 13962 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:49.808920 13962 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.809136 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 39) took 1159 ms. Trace:
I20260709 13:06:49.809824 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1127) took 1070 ms. Trace:
I20260709 13:06:49.810406 12731 rpcz_store.cc:276] 0709 13:06:48.739301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.766413 (+ 27112us) service_pool.cc:224] Handling call
0709 13:06:49.809634 (+1043221us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400029754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:49.809756 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314063232}
I20260709 13:06:49.809749 12804 rpcz_store.cc:276] 0709 13:06:48.649513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.657033 (+  7520us) service_pool.cc:224] Handling call
0709 13:06:48.665391 (+  8358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.680291 (+ 14900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.680319 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.680811 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.863165 (+182354us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.863207 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.863275 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.808845 (+945570us) raft_consensus.cc:1685] finished
0709 13:06:49.808876 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.809061 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4740,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":181985,"threads_started":1,"wal-append.queue_time_us":484284}
I20260709 13:06:49.812742 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.813817 12874 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:49.819514 13518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 131) took 1189 ms. Trace:
I20260709 13:06:49.821125 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.822016 12727 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.772898 13797 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.825961 13797 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.774839 13903 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:49.765223 13800 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.835295 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.835582 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.776446 13840 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.837965 13903 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.837683 13840 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.762290 13928 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.842402 13928 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.750976 12805 rpcz_store.cc:276] 0709 13:06:48.718445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.731031 (+ 12586us) service_pool.cc:224] Handling call
0709 13:06:48.743461 (+ 12430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.743918 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.743948 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.788333 (+ 44385us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.010065 (+221732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:49.010115 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.010193 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.750321 (+740128us) raft_consensus.cc:1685] finished
0709 13:06:49.750344 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.750485 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7312,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3696,"thread_start_us":163532,"threads_started":1,"wal-append.queue_time_us":383798}
I20260709 13:06:49.844653 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.844893 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:49.845491 13929 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 13:06:49.845940 13929 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.845990 12879 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.783568 13822 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.848686 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.849687 13516 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:49.837214 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.851635 13840 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:49.853425 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.820207 13518 rpcz_store.cc:276] 0709 13:06:48.648341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.658700 (+ 10359us) service_pool.cc:224] Handling call
0709 13:06:48.667189 (+  8489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.921742 (+254553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.951207 (+ 29465us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.961276 (+ 10069us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.170242 (+208966us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.176023 (+  5781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.184389 (+  8366us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.819068 (+634679us) raft_consensus.cc:1685] finished
0709 13:06:49.819107 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.819274 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183274,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":16775,"spinlock_wait_cycles":213248,"thread_start_us":418255,"threads_started":2,"wal-append.queue_time_us":232071}
I20260709 13:06:49.852246 12729 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:49.856369 12879 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:49.789026 12880 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:49.789232 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.789918 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:49.859931 12806 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.793628 13921 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.775833 13902 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.758087 13837 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.864221 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.764444 13519 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.867416 12881 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.759770 13941 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.776319 13876 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:49.830255 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.871819 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:49.872375 12733 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:06:49.834522 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.873056 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.866911 13837 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:49.875174 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.875772 12877 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.877313 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.878032 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:49.873795 12874 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:49.837041 13800 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:49.867763 13840 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.878638 12882 raft_consensus.cc:2376] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3. Re-sending same reply.
I20260709 13:06:49.882721 12876 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.884227 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:49.885893 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.886026 12805 raft_consensus.cc:2393] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:49.888252 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:49.888495 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.888643 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:49.891459 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.891875 13941 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:49.895782 12882 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:49.894915 13800 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.904471 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.899616 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.899622 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.888135 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.908360 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:49.877661 13876 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:49.930632 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:49.938100 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.933511 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.888331 13840 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:49.945663 12875 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:49.946403 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1387) took 1091 ms. Trace:
I20260709 13:06:49.944378 13906 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:49.946996 13840 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:49.947985 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:49.948551 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73966.6us
I20260709 13:06:49.949975 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:49.951613 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.953395 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.949985 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.969200 12880 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.969879 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:49.985713 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 50015.3us
W20260709 13:06:49.989943 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 182350us
I20260709 13:06:49.993366 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.997320 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.994385 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:49.997453 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.011307 12873 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.947909 13840 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.014647 13840 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.015074 13840 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.020437 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.021508 12881 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.022483 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:49.999495 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.024561 12879 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:49.999734 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.026165 12877 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.001744 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:50.027520 12733 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:49.997956 12880 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.001085 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.003482 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:50.004133 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:50.034166 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.009080 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.034672 12882 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.004390 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:50.036028 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 215678us
I20260709 13:06:50.004709 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:50.003767 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:50.022927 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.039726 12732 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:50.023077 12881 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.023484 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.040827 12873 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
W20260709 13:06:50.041141 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.042559 12880 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:49.940733 12727 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:06:49.999893 13972 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:50.049116 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.049599 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.054899 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.055473 12845 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.057130 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.057971 12881 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.000854 13818 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.004467 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:50.003254 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:49.946740 12875 rpcz_store.cc:276] 0709 13:06:48.854766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.858641 (+  3875us) service_pool.cc:224] Handling call
0709 13:06:49.310795 (+452154us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:49.311045 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.946093 (+635048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.946312 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21801216}
I20260709 13:06:50.060993 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.061437 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.061889 12879 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.064142 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:50.067497 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:50.067490 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 204382us
I20260709 13:06:49.998277 13903 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.056231 13921 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.005486 13800 consensus_queue.cc:1059] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:06:50.079476 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 70511.8us
I20260709 13:06:50.087971 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.087965 12773 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.089464 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.068312 13818 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.075387 13841 tablet_copy_client.cc:538] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:50.090682 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.042481 13962 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.085600 13985 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.087195 13941 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.075901 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:50.095116 13800 raft_consensus.cc:3055] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.090132 12881 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:50.074008 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:50.099730 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.074469 13906 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.117869 13921 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:50.124780 13906 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.125080 13921 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:50.125247 13906 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.126200 13921 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.126864 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.092532 13797 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.109706 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.127903 12875 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:50.128443 13519 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.128890 13941 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.120165 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:50.122447 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.095713 13818 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.129699 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.130702 13903 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.130831 13962 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.172232 13518 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:50.172420 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:50.172935 13943 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.173347 13943 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.172050 13837 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.173709 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:50.174039 13837 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:50.174487 13837 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.113770 13822 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.100970 13985 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.175011 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 188) took 1966 ms. Trace:
I20260709 13:06:50.175127 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.132301 13876 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:50.117237 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.175370 13985 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:50.136397 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.077328 13840 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.135406 13906 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.139345 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.118498 13800 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:50.188123 12880 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:50.187780 13800 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.188915 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.189313 13800 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.189559 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.192231 13837 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.194731 13837 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.177522 13513 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.173759 13943 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.199158 12875 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.141371 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.142867 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.143589 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.144364 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.145051 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.145699 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.148532 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.213222 12882 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.163926 13818 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.150400 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.129096 13987 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.155265 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.224979 12881 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.162252 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.163201 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.226559 12878 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.155701 13941 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:50.227391 13941 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.171034 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.176247 12876 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.175148 13822 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.242300 13822 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.242245 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.243062 12807 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:50.244249 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.244918 12807 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.200831 12805 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:50.142131 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.149497 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:50.220019 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.175485 12627 rpcz_store.cc:276] 0709 13:06:48.208717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.328207 (+119490us) service_pool.cc:224] Handling call
0709 13:06:50.174919 (+1846712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:48.814990 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.162883 (+347893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.173839 (+ 10956us) write_op.cc:435] Acquired schema lock
0709 13:06:49.177706 (+  3867us) tablet.cc:662] Decoding operations
0709 13:06:49.200919 (+ 23213us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.263485 (+ 62566us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.271012 (+  7527us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:49.396294 (+125282us) tablet.cc:701] Row locks acquired
0709 13:06:49.423505 (+ 27211us) write_op.cc:260] PREPARE: finished
0709 13:06:49.497225 (+ 73720us) write_op.cc:270] Start()
0709 13:06:49.541133 (+ 43908us) write_op.cc:276] Timestamp: P: 1783602409475217 usec, L: 0
0709 13:06:49.541186 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.542040 (+   854us) log.cc:844] Serialized 529 byte log entry
0709 13:06:49.943692 (+401652us) op_driver.cc:464] REPLICATION: finished
0709 13:06:50.117050 (+173358us) write_op.cc:301] APPLY: starting
0709 13:06:50.117165 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:50.117283 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:50.117439 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:50.117749 (+   310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:50.117980 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:50.118022 (+    42us) write_op.cc:312] APPLY: finished
0709 13:06:50.124784 (+  6762us) log.cc:844] Serialized 22 byte log entry
0709 13:06:50.124965 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.125045 (+    80us) write_op.cc:454] Released schema lock
0709 13:06:50.125120 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:50.125475 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.125505 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":173041,"apply.run_cpu_time_us":2186,"apply.run_wall_time_us":8422,"num_ops":1,"prepare.queue_time_us":266503,"prepare.run_cpu_time_us":147300,"prepare.run_wall_time_us":1100401,"raft.queue_time_us":49024,"raft.run_cpu_time_us":10248,"raft.run_wall_time_us":120443,"replication_time_us":402307,"thread_start_us":679287,"threads_started":4,"wal-append.queue_time_us":350164}]]}
I20260709 13:06:50.246881 12877 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.228406 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.248184 12800 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.249372 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.250108 12800 raft_consensus.cc:2376] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2. Re-sending same reply.
I20260709 13:06:50.251113 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:50.234457 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63504.3us
I20260709 13:06:50.212196 12630 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.235936 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.252561 12803 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.236392 13837 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.241557 12808 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.241852 13906 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:50.229490 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.256140 12806 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.253051 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.255383 12630 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.253954 12800 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.259001 12801 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:50.260733 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.260370 12630 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 3, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 3 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:50.261951 12630 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.264010 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.264616 12805 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.266629 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.224799 13987 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.268992 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.267251 12808 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.273802 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.268689 12630 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.280110 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:50.285931 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 165909us
I20260709 13:06:50.281412 12630 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.279469 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:50.289970 13513 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.289603 12630 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.272827 13797 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.291785 12630 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.293349 13840 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.295509 13841 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:06:50.297623 13985 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.300259 12804 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.273336 13987 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.272639 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.304178 12847 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.280611 13837 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.306030 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:50.306735 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 86467.8us
I20260709 13:06:50.307781 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.308614 12771 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.311082 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.312376 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.312860 12803 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.313930 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.320307 12803 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.321697 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.322654 12803 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:50.324136 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.325799 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.326541 12803 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.335413 12803 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:50.336548 13521 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:50.336951 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.337771 12803 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.338189 13921 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:50.342556 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.345575 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.344444 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.347493 12803 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.348152 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.307623 12630 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.349079 12881 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:50.355450 12630 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.358188 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.361207 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.308568 13837 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.362542 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.363094 12874 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:50.362234 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.368490 12878 raft_consensus.cc:2410] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:50.346488 13797 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.309681 13818 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.369082 12876 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.369206 13797 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:50.369491 13995 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.369778 13797 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.370157 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.370795 13818 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.373625 12801 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.377772 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.354763 13921 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.379813 13921 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.380213 13921 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.349169 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.391484 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.392498 12804 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.396621 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:50.397955 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 84116.2us
I20260709 13:06:50.399284 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.400180 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.400514 12848 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.400839 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.406579 12805 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.408282 12803 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.406697 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.383317 13994 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.402824 13513 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:06:50.361817 13998 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.373598 13837 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:50.405978 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62225.4us
W20260709 13:06:50.406934 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 131543us
I20260709 13:06:50.387964 13928 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.415707 13975 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:50.415848 13928 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.416253 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.416733 13928 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.404560 13906 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.406283 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.409021 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.351475 13943 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.430106 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.409219 13922 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.433542 12845 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.409804 13985 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.442898 12804 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.410966 13994 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.446372 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.448817 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.412755 12807 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:50.422878 13906 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.466287 13996 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:50.470525 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54349.2us
I20260709 13:06:50.474247 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.474923 12807 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:50.473428 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.436445 13922 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:50.477425 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.460726 12803 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:50.455196 13998 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:50.487967 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 54509.9us
I20260709 13:06:50.448097 13994 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.477018 13906 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.437222 13941 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.483712 13922 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.518209 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:50.464803 13985 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:50.529568 13995 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.494087 13998 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.480669 14004 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.504767 12802 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:50.479553 13997 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 13:06:50.542758 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 94034.8us
W20260709 13:06:50.532852 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 61353.8us
I20260709 13:06:50.526679 14005 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:50.535439 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52821.8us
I20260709 13:06:50.523138 13989 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.497960 14001 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.543462 12804 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.537812 13998 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.523624 12873 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:50.547318 13487 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.547019 12800 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.544932 13995 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.548398 14005 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.556404 12699 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.548012 13989 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:50.555047 14004 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.570770 14008 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:50.587126 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 157142us
I20260709 13:06:50.588196 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.559609 14002 raft_consensus.cc:2764] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:50.593343 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.560223 13903 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.574623 14005 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.596017 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.595968 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.603981 12805 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:50.605178 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.606045 12805 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:50.607460 12805 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:50.576057 13997 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.608803 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.609117 13997 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:50.610450 13997 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.612015 13997 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.620661 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.624169 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.578274 14004 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.599514 13943 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.635496 14011 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.640724 14011 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.650058 14011 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.650184 13989 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.630319 14004 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.634038 14008 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.647320 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:50.686342 13941 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.688175 14008 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:50.693744 13941 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.694317 13941 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.694700 13941 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.694751 14008 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:50.688500 14018 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.696563 14018 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.696957 14018 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.684744 13977 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.753892 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.675311 13928 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.687551 14014 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:50.762427 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 138742us
I20260709 13:06:50.764441 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.680927 14005 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.693063 12802 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:50.770383 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:50.687031 13922 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:50.768103 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 143211us
W20260709 13:06:50.773725 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 337246us
W20260709 13:06:50.757956 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 284633us
I20260709 13:06:50.768201 14021 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.781872 14024 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:50.781519 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.784428 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.756698 14019 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.797859 13797 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:50.783947 14021 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.786823 13840 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.759986 13977 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:50.772184 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 365988us
I20260709 13:06:50.794008 14019 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:50.803437 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.772423 14020 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.818666 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.821441 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.791405 14028 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.807392 14021 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.819031 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.773882 14014 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.810637 13840 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.802492 13876 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:50.835180 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:50.826203 14026 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:06:50.896548 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61495.7us
I20260709 13:06:50.822122 13818 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.819419 14020 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.828091 14028 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.816689 14019 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:50.897537 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 72877.5us
I20260709 13:06:50.904484 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:50.911229 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 79283.8us
I20260709 13:06:50.914007 14035 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.914518 14035 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:50.914920 14035 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.915105 13974 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.837177 13840 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.916716 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:50.917593 13974 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.919540 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.920424 13974 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.920833 13974 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:50.921201 13974 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:50.836850 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66578.6us
I20260709 13:06:50.830272 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:50.833779 13797 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.818707 14009 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:06:50.932454 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:50.912060 14020 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.937556 13837 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.940837 13922 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:50.943224 13822 consensus_meta.cc:287] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.003s
W20260709 13:06:50.943529 13921 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.003s
I20260709 13:06:50.924248 13988 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:50.943985 13995 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:50.946182 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:50.947655 14032 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.948547 14017 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.806049 14022 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
W20260709 13:06:50.984189 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.838769 13928 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.952003 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:50.984510 13822 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.986922 13822 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.987656 12808 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:50.895256 14015 consensus_queue.cc:1059] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:50.989168 14015 raft_consensus.cc:3055] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.989696 14015 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:50.969626 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 148269us
I20260709 13:06:50.934531 14027 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.903358 14029 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.923955 14024 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:50.950428 13977 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.976949 13921 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.978513 13837 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.979941 13840 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:50.991815 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59449.9us
I20260709 13:06:50.925300 14028 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.995641 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:50.962211 14013 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:06:50.939803 13998 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.962531 14031 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.017117 14031 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.017690 14031 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:51.002144 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50228.9us
I20260709 13:06:51.020779 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.013890 13988 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.024710 13988 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.025210 13988 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.025240 14011 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.007786 13928 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.029668 13928 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:51.030098 13928 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.003981 14034 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.032816 14034 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.033196 14034 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.037696 13876 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.038357 13876 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.042855 13921 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:51.002574 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56480.8us
I20260709 13:06:50.961715 14014 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:50.993323 12802 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.009999 14024 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:50.953140 14035 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.010280 14017 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:50.996589 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81955us
I20260709 13:06:50.994529 14027 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.996358 13822 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.002139 14005 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:50.963688 14004 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.051294 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:51.072278 12800 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:06:51.050501 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.053072 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.010295 12799 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:51.009274 12771 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:51.076282 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 67050.1us
I20260709 13:06:51.076941 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.066843 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:51.067721 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 72152.2us
I20260709 13:06:51.037736 14011 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.075014 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.054948 13837 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.013080 13906 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.077958 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:50.990972 14015 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.074777 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.080821 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.081647 13837 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.082039 13818 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.082446 13800 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.108368 13800 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.108568 13974 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.109054 13800 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.110941 14019 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:51.078896 14022 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.112339 14022 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.112921 14022 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.113323 14019 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.113557 14020 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:51.058835 14017 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.039546 13876 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.087178 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.087491 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:51.087960 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.088310 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.066056 14027 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.068884 13822 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:51.090970 13840 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.079128 14014 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.082829 14004 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.093802 13941 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.096843 13922 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.097430 13797 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.097875 13995 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.099000 14015 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.100095 13841 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:51.107175 14028 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:51.114703 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54665.5us
W20260709 13:06:51.079888 13987 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.007s
I20260709 13:06:51.119660 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.120774 14005 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.125574 14037 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.167714 14037 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.167781 13922 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.168792 14037 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.169064 13922 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.125910 13991 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.114879 13818 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.089227 13837 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.125630 14038 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.132184 13921 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:51.121132 13994 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.004s
I20260709 13:06:51.110945 13974 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:51.119855 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45169.1us
I20260709 13:06:51.153015 13995 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:51.156304 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.127187 13822 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.157333 13840 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.157503 14017 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.159621 13998 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.126574 13929 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.161515 14035 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:51.161732 14028 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.163465 13797 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.163590 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:51.164817 13987 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.130021 14021 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.163581 12696 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:51.173669 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49644us
W20260709 13:06:51.156697 14041 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:06:51.184417 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 96524us
I20260709 13:06:51.172186 13991 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.177138 13818 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.181610 14018 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.219147 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:51.182806 13994 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.221779 13994 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.221850 13906 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:51.224334 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.196084 13929 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.225489 13929 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.226576 13800 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.226955 13988 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.178917 13876 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.237746 12802 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:51.239243 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.239959 12806 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:51.241241 14020 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.241878 13977 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:51.242527 13977 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:51.243346 14021 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.244998 13941 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.245766 14017 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.247208 14025 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.247690 14025 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.199757 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.183766 13995 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.190220 14002 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.210825 12848 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.215826 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:51.216015 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52518.7us
I20260709 13:06:51.216355 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.216747 14009 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.196094 13943 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.216117 12873 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.224709 14034 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:51.256646 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45942.8us
I20260709 13:06:51.185568 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.230679 13928 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.178526 14038 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:51.205334 13841 tablet_bootstrap.cc:492] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:06:51.261407 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:51.261876 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 76397.5us
I20260709 13:06:51.262498 12699 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.243060 13818 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.181402 13989 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.252883 12876 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.253139 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 397) took 1058 ms. Trace:
W20260709 13:06:51.253202 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55093.7us
I20260709 13:06:51.252374 12882 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.230890 13800 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.233186 13991 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.270984 14007 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:51.271967 14032 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:51.272735 14033 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:51.273124 14011 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:51.272528 13975 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:51.273783 14040 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:51.272850 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.255604 14005 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.275483 14025 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.275806 13962 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:51.320721 13962 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.321146 13962 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:51.322080 13962 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.323601 13962 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.324556 14025 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.260509 14038 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.278079 13928 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.278990 13841 ts_tablet_manager.cc:1403] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.984s	user 0.037s	sys 0.048s
I20260709 13:06:51.254802 14009 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:51.243682 13977 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.259322 13943 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.280068 14031 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.282984 14018 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.263046 13941 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.284418 13996 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.284864 14020 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.284905 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.349642 13818 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:51.349689 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 64882.7us
I20260709 13:06:51.350741 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.286981 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:51.352888 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66032.2us
I20260709 13:06:51.353945 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.289026 13997 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.290418 13987 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.294178 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.293706 12806 rpcz_store.cc:276] 0709 13:06:50.194866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.292423 (+ 97557us) service_pool.cc:224] Handling call
0709 13:06:51.252920 (+960497us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001b5654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:51.253075 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138165504}
W20260709 13:06:51.358368 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 64277.7us
I20260709 13:06:51.243711 13988 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.287765 14029 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.313308 12882 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
W20260709 13:06:51.316599 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.318738 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:51.334645 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61887.9us
I20260709 13:06:51.317762 13876 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.348742 13996 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.354984 12699 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:51.344391 14033 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.302481 13837 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.343636 14009 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.356631 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.393098 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.344177 13943 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.316762 13822 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.350829 14018 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.380182 13996 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.381702 13987 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:51.359612 13928 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.362509 13818 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.382758 13800 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:51.312681 14022 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.386763 13841 raft_consensus.cc:359] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:51.387918 13988 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:51.423560 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.389324 13902 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.378309 13876 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.357617 13997 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.405464 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.437819 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.364178 14020 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.382100 14034 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.412386 13818 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:51.380482 14033 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.397650 13975 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:51.388651 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74779.6us
I20260709 13:06:51.400166 14018 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.450773 13818 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.458920 14018 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.417243 14007 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:51.412400 13987 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.407719 14015 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:51.469050 12847 leader_election.cc:336] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.518s (SENT)
I20260709 13:06:51.469362 14015 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.469617 12847 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.469799 14015 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.470471 13929 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.405157 13996 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:51.438174 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58649.7us
I20260709 13:06:51.406519 14036 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.440789 12848 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.473448 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.421557 13841 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:06:51.454469 14027 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.446373 13928 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.455470 13975 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.440783 13837 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.399366 14014 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.458704 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:51.460558 14020 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.459517 14031 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.462242 13902 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:51.441562 13997 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.471504 14034 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.413010 14024 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:51.451716 13513 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:51.450057 13922 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.480724 14007 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.458688 14032 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.505234 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.504747 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.496949 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.504894 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.505074 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:51.501250 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.498996 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.513223 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.516080 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.516880 14027 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.517457 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.439076 13876 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:51.571372 12804 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.520553 13902 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.492129 14044 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:51.531494 14007 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.480657 13841 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:51.576515 12806 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.583472 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.576685 12805 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:51.578613 12807 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:06:51.577575 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 73049us
I20260709 13:06:51.585492 12808 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:51.492717 13975 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.572746 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.599056 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:51.486774 13929 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.581770 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.489970 13822 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:51.594381 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 93212.9us
I20260709 13:06:51.603689 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:51.607100 12879 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.607483 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.501055 13928 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.493386 13906 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:51.597774 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.612686 12878 raft_consensus.cc:2368] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:51.615592 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:51.617306 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.618075 12724 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.618990 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.619673 12733 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.599318 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.621263 12873 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.599819 12876 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:51.488643 14002 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.578742 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.531723 14032 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.570351 13962 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:51.603803 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:51.637050 12882 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.604876 12877 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.578539 13800 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.637844 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.608637 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.608937 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:51.508996 14014 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:51.605422 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:51.517851 14036 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.599100 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.485626 14019 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:06:51.595054 14034 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.648013 12874 raft_consensus.cc:2368] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:51.624287 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:51.623601 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:51.628441 12847 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.564s (SENT)
I20260709 13:06:51.648785 12726 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.629467 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:51.592403 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 129573us
I20260709 13:06:51.652253 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.653106 12876 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.493858 14008 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:06:51.644814 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.498243 13995 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.647444 12803 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:51.647502 12799 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.603780 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:51.604712 14044 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.576026 14015 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.651518 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.490367 14033 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.655496 12731 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.622694 13902 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:51.651290 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.657480 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:51.658016 12847 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.618s (SENT)
I20260709 13:06:51.636420 14029 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.636628 13876 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.660152 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.641075 14017 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.644343 14014 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.716858 12804 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:51.662755 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.642604 14031 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.663678 12878 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.654381 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.718281 12882 raft_consensus.cc:2368] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:51.646847 13943 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.665810 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.727550 12801 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.665529 14036 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.650946 13822 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.655366 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:51.650647 13962 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:06:51.682966 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 164476us
I20260709 13:06:51.661517 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:51.691433 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.663508 13921 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.663911 14022 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.706005 12877 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.695571 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.686641 14021 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.644151 13922 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:51.716320 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.734131 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.892494 12873 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.737453 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.771624 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.773100 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.776335 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.828593 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:51.893445 12800 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:51.894735 12879 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.691336 13977 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:51.725817 14017 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.729739 14005 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.680783 14020 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.924619 13962 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.927456 14017 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.693245 14019 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.856612 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 116482us
I20260709 13:06:51.863404 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:51.855746 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.894322 12808 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.894091 12878 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.892951 12806 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:06:51.845868 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:51.898648 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 203115us
I20260709 13:06:51.864327 14021 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:51.900488 13977 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:51.665756 14044 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:51.907585 13989 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.002s
I20260709 13:06:51.697746 14032 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.859086 13921 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:51.913009 14038 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.569s	user 0.000s	sys 0.009s
I20260709 13:06:51.913429 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.925467 13943 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:51.893867 12882 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:51.929528 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 326153us
I20260709 13:06:51.948382 12877 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:51.948560 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.937230 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:51.960165 14060 log.cc:927] Time spent T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.273s	user 0.000s	sys 0.006s
I20260709 13:06:51.951165 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.983088 12806 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:06:51.952633 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.920450 12801 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:51.959372 14033 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:51.958245 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.923437 14018 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.897518 13797 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.971426 12879 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:51.729036 13906 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:51.974757 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:51.946136 12724 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:06:51.976271 12847 leader_election.cc:336] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.636s (SENT)
W20260709 13:06:52.026069 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49843.4us
W20260709 13:06:52.026923 12847 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.639s (SENT)
I20260709 13:06:51.981832 12808 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:52.028297 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.029028 12808 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.933121 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:51.985432 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:52.032778 12801 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:51.973476 13921 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.989436 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:52.033771 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59093.1us
I20260709 13:06:52.034140 12806 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.980679 14038 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.991110 12882 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.992316 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:51.959029 14019 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:51.994114 12726 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:51.980894 14034 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.996129 12727 raft_consensus.cc:2376] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3. Re-sending same reply.
I20260709 13:06:51.997239 12873 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:51.994817 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:51.998121 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:06:52.046440 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48493us
W20260709 13:06:51.998528 13996 consensus_meta.cc:287] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:06:51.824661 13928 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.000273 12878 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:52.035230 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:51.972509 14015 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.037007 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.037843 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.056854 12733 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.038120 12804 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:51.993225 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.041086 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:52.044828 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.070478 12726 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:06:52.070776 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.049733 12808 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:52.047364 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:52.039497 14069 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.076018 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.076059 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.078611 12724 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.078107 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:52.076078 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:52.065471 14025 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.000s
I20260709 13:06:52.083513 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.087623 12724 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.054859 14068 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.070482 14040 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.115252 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:52.088346 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.116297 12804 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:52.116835 12802 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.114208 12771 leader_election.cc:400] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.080248 13943 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.112908 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.118866 12726 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.042860 14021 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.114841 14037 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:52.120450 14063 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:52.120235 14037 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.120550 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:52.122361 14061 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:06:52.092845 13841 ts_tablet_manager.cc:1434] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.750s	user 0.004s	sys 0.016s
W20260709 13:06:52.125332 13841 ts_tablet_manager.cc:1467] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Tablet startup took 791ms
I20260709 13:06:52.125631 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.126811 12882 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.128397 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:52.083602 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.129858 12696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.019s	sys 0.028s
W20260709 13:06:52.130203 12696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.019s	sys 0.028s
W20260709 13:06:52.130429 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 726915us
I20260709 13:06:52.134205 14004 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:52.134461 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.134765 14004 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.136355 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:06:52.138964 14009 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 13:06:52.139361 14009 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.140296 12731 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:52.140522 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.141244 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.141557 14009 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.070113 13996 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.142524 13906 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.143700 13996 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.144193 14018 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.144618 13943 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.145550 14019 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.145396 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.146077 12732 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:52.149049 13991 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.008s
I20260709 13:06:52.173434 12726 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:52.150019 13977 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.150501 13902 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:52.150601 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.091336 14034 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.141579 12800 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:52.122989 13800 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.152093 12731 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.112375 12806 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:52.152710 12771 leader_election.cc:403] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.181738 12724 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:52.156605 12733 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:52.159981 13797 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:52.149050 13818 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.004s
I20260709 13:06:52.161010 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.197677 12804 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:52.075511 13995 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:52.173415 12808 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:52.173946 13991 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.080021 14067 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.175839 12847 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.164800 14068 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:52.208499 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.112255 14040 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:52.181417 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.211267 12800 raft_consensus.cc:2368] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3.
I20260709 13:06:52.135746 14004 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.153143 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.160296 14038 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:52.212705 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59678us
I20260709 13:06:52.181510 14020 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.182830 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:52.186342 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 95988.6us
I20260709 13:06:52.214148 12806 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:52.214947 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:52.215941 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.205792 12729 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.216974 12800 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:52.185668 13941 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.199721 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.201613 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.174853 13902 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:52.217613 12725 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.204576 12882 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:52.205559 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:52.205755 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.255088 12806 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.255317 12733 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.092501 14029 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:06:52.258564 12806 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.246389 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:52.254446 13902 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:52.254103 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 206808us
I20260709 13:06:52.254267 12724 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.204407 12802 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:52.259827 12800 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.197486 14034 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.219167 14017 raft_consensus.cc:2764] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:52.269491 14068 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.206908 13818 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.260891 13800 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:52.272540 13800 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:52.273209 13800 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.273978 13818 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.274250 13943 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.274685 13818 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:52.274598 14040 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.265722 14020 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.275966 14040 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.262872 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.265126 12808 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:52.263026 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47392us
I20260709 13:06:52.210388 13922 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.277716 12808 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.267510 12724 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.268539 12800 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:52.277774 12806 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:52.278909 12808 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.266187 12731 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.208249 14005 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.280356 12733 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.266877 14004 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.282737 13943 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:52.283140 13943 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:52.283565 12801 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.283680 13991 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.260954 13995 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:52.283915 13943 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.284684 13995 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.285151 12805 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:52.285722 12801 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:52.286916 13995 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.252890 14067 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.254391 13941 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.288415 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:52.291662 12800 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.309013 12804 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:52.208822 13797 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.305685 13922 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.316087 13922 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:52.317188 13797 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:52.318261 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57581us
I20260709 13:06:52.313180 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:52.319494 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.323382 12771 leader_election.cc:400] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.324079 12771 leader_election.cc:403] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.287505 14020 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.326144 12771 leader_election.cc:400] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.325963 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.326766 12771 leader_election.cc:403] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.288170 13876 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:52.325920 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.330706 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:52.332609 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:52.336812 12731 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:52.338308 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 49978.2us
I20260709 13:06:52.341666 14069 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.342603 14027 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.343079 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:52.343780 14027 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.345590 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.345186 14027 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.347227 13797 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:52.348723 14036 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.307857 14017 raft_consensus.cc:2764] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:06:52.342578 14069 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.374855 12726 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.376361 12731 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:52.380231 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.328963 13995 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.350175 14056 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.351516 14024 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.365391 14067 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.396322 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.393927 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:52.374456 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60521us
I20260709 13:06:52.399353 13995 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:52.408614 14069 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:52.125749 13841 ts_tablet_manager.cc:1469] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Trace:
0709 13:06:42.948091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.953228 (+  5137us) service_pool.cc:224] Handling call
0709 13:06:43.505906 (+552678us) ts_tablet_manager.cc:934] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:06:45.606540 (+2100634us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:46.891919 (+1285379us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.893637 (+  1718us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:47.375163 (+481526us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:47.397759 (+ 22596us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:48.021800 (+624041us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:48.021978 (+   178us) inbound_call.cc:177] Queueing success response
0709 13:06:50.295034 (+2273056us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:51.343556 (+1048522us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:51.384284 (+ 40728us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:51.384929 (+   645us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":21602,"raft.queue_time_us":35325,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10764,"tablet-copy.queue_time_us":527425,"tablet-download-pool.queue_time_us":482,"tablet-download-pool.run_cpu_time_us":1578,"tablet-download-pool.run_wall_time_us":1635062,"thread_start_us":951606,"threads_started":3}
I20260709 13:06:52.391987 14034 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.415318 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-562422a4dc1a44a7bca3a549839874be received from {username='slave'} at 127.0.0.1:60724
I20260709 13:06:52.416280 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-562422a4dc1a44a7bca3a549839874be on tablet 562422a4dc1a44a7bca3a549839874be with peer a865487bf1854df8a5619d42465bb36c
W20260709 13:06:52.416332 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.386911 14056 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:52.419486 14056 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.420787 14056 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.422125 12732 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:06:52.427753 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 84812.9us
I20260709 13:06:52.431531 13941 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:52.431790 14080 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:06:52.434450 12799 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
I20260709 13:06:52.434882 12799 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:52.429577 13921 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.440680 14005 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
W20260709 13:06:52.443985 13975 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.831s	user 0.007s	sys 0.005s
I20260709 13:06:52.444798 13975 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.435686 13800 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.398943 14024 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.447561 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.452268 12733 raft_consensus.cc:2368] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:52.453578 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.454653 12733 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:06:52.470800 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.473126 12731 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:52.473681 14002 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:52.474346 14002 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:52.474583 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.476006 12731 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.476560 14002 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.477295 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.385891 14075 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:52.465199 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:52.480209 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 143956us
I20260709 13:06:52.482141 12805 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.400457 14081 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
W20260709 13:06:52.514832 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.459846 13921 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:52.571364 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:52.447386 14067 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:52.546639 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.574585 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.486080 12731 raft_consensus.cc:2368] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
W20260709 13:06:52.575145 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.576403 12733 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:52.523180 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.572649 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:52.581972 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:52.484566 13997 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.913s	user 0.008s	sys 0.004s
I20260709 13:06:52.583745 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:52.480942 13902 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.591986 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:52.485755 14029 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.569818 14002 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:52.582043 14014 consensus_meta.cc:287] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.848s	user 0.007s	sys 0.004s
I20260709 13:06:52.612619 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.618717 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:52.612224 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.619968 12877 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.602542 12874 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.592012 13902 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:52.650751 14017 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.690048 14015 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.700220 12879 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.698292 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.700610 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:52.691648 14081 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.695518 14038 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.595652 13997 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.718871 14069 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:52.720806 14078 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 13:06:52.722715 13800 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:52.725068 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.735721 12806 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
W20260709 13:06:52.773435 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.601130 12881 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:52.751636 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.716595 13975 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:52.759107 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 177231us
I20260709 13:06:52.766136 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:52.696027 14093 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.691133 14014 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:52.767967 14033 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.006s
I20260709 13:06:52.783576 12728 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:52.695672 14024 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.784499 12878 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:52.793879 12731 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:52.774864 13513 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.756843 14017 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.774390 14075 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.773221 14098 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.759418 14015 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.811146 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.784339 13902 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.814854 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.819274 12882 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:52.815542 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.819978 12881 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.769903 14038 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.794855 14093 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:52.818444 12696 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:52.817041 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.827266 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.828362 12878 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:52.833664 13516 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.774294 14069 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.839010 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.835423 13975 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.866930 14015 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:52.840672 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.842866 13987 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.823773 13902 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:52.845280 13800 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.847611 14036 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.848419 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.849766 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 424) took 1234 ms. Trace:
I20260709 13:06:52.836711 14098 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:06:52.853168 14099 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.064s	user 0.002s	sys 0.001s
I20260709 13:06:52.878744 14005 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.900714 13943 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.901718 13902 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.902284 13902 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:52.905555 12732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 431) took 1288 ms (client timeout 1676 ms). Trace:
W20260709 13:06:52.905936 12732 rpcz_store.cc:269] 0709 13:06:51.617046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.988939 (+371893us) service_pool.cc:224] Handling call
0709 13:06:52.905367 (+916428us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400430dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:52.905504 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230060800}
I20260709 13:06:52.906409 12881 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:52.907109 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.840981 14091 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.849821 14093 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.908408 14091 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:06:52.856909 14095 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:06:52.862629 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.870920 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:52.875290 14017 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:52.878790 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.819217 14075 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.884954 12878 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:52.884812 12725 rpcz_store.cc:276] 0709 13:06:51.615227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.618566 (+  3339us) service_pool.cc:224] Handling call
0709 13:06:51.644452 (+ 25886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.256114 (+611662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.849448 (+593334us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400410d54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:52.849696 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317676288}
I20260709 13:06:52.853645 14014 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:52.893363 14007 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.932073 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:52.933323 12732 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.886103 14081 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:52.884480 14036 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:52.947187 14081 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.947997 14036 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:52.949111 14018 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.949205 14036 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.896891 14077 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:52.899125 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.878147 13975 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.907647 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.953385 12881 raft_consensus.cc:2368] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3.
W20260709 13:06:52.921294 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50466.5us
I20260709 13:06:52.954818 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:52.923149 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:52.924118 14015 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.929771 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:52.958876 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81510.5us
I20260709 13:06:52.895411 14037 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:52.970377 12725 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:52.920198 14022 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.935958 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.937930 14098 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:52.940744 14096 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:06:52.941810 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63139us
I20260709 13:06:52.912730 13997 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:52.981870 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.945573 14069 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:52.951575 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.955945 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:52.967573 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.970754 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.971407 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.972695 14015 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:52.973790 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:52.957943 14040 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.005s
I20260709 13:06:52.968492 14005 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.968454 14017 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.991541 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:52.994328 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.985759 12881 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.995889 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:52.980136 14007 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.999756 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:52.984079 14091 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.028558 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:52.980726 14029 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:52.993438 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 114887us
I20260709 13:06:53.033836 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.042958 12696 leader_election.cc:400] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3.
I20260709 13:06:53.043391 12696 leader_election.cc:403] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.031795 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:53.038208 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:53.004745 14056 consensus_meta.cc:287] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.009s
I20260709 13:06:53.027150 13988 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.048480 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:53.028232 14017 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.051520 12881 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:52.982439 14022 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:53.052237 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.039155 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83315us
I20260709 13:06:53.035036 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.029289 13975 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:53.026881 14018 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:53.055590 12881 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.054669 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.053939 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:53.031795 13997 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:53.055974 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:53.053514 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.060329 12878 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:53.061930 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.071640 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.052896 14017 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.052255 14056 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.077328 14103 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.053880 14038 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.086223 12699 leader_election.cc:400] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3.
I20260709 13:06:53.089381 12878 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.078003 14059 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.091509 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.077766 13975 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3.
I20260709 13:06:53.082959 13988 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.105942 12878 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.100703 14038 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.106619 14018 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.107169 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 421) took 1492 ms. Trace:
I20260709 13:06:53.087639 14103 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.091537 14035 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:06:53.110886 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.111287 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 433) took 1493 ms. Trace:
I20260709 13:06:53.101329 14056 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.133942 12729 rpcz_store.cc:276] 0709 13:06:51.617525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.120248 (+502723us) service_pool.cc:224] Handling call
0709 13:06:53.111021 (+990773us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400064354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:53.111207 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95011584}
I20260709 13:06:53.134859 12874 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.135407 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.122634 14059 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.125468 14108 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:06:53.126185 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.149097 12731 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.126473 14107 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:06:53.112957 13988 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.131910 14075 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.054035 14015 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.115260 12878 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.136577 12732 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.137261 12699 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:53.130597 12728 rpcz_store.cc:276] 0709 13:06:51.614424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.614564 (+   140us) service_pool.cc:224] Handling call
0709 13:06:51.614986 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.789253 (+1174267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.106845 (+317592us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540038ed54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:53.107092 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683390848}
I20260709 13:06:53.140164 12879 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.143831 12874 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.161922 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:53.150504 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 107725us
I20260709 13:06:53.154135 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.163486 12731 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.128171 14038 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.142182 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.164925 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.174178 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.175527 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.177315 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.178156 12729 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.178522 14022 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.178949 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.179158 14022 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.179683 12729 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:53.180426 14110 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.180573 13822 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.181133 13822 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:53.181504 14018 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:53.181977 13822 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.182355 14018 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:53.183028 13822 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.183420 14056 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.184222 14075 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.183772 14056 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.184569 12879 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.185184 14056 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.185880 12879 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.186321 14056 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.184572 14075 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.187747 14017 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.188380 13988 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.189025 14075 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.190505 14017 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.190218 13988 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.191756 12729 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.216249 12729 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:53.217163 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 238880us
I20260709 13:06:53.217520 12729 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.192728 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1436) took 1232 ms. Trace:
I20260709 13:06:53.218283 12808 rpcz_store.cc:276] 0709 13:06:51.960359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.279420 (+319061us) service_pool.cc:224] Handling call
0709 13:06:52.279617 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.287137 (+  7520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.287170 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.287210 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:52.287236 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.192450 (+905214us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b540028cb54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:53.192512 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.192659 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16899840}
I20260709 13:06:53.219894 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:53.196329 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 202242us
I20260709 13:06:53.220754 14118 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:53.187959 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.222164 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.221416 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:53.223308 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:53.195274 14105 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:06:53.141554 14035 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.201120 12805 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.201457 12807 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.202329 12806 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.203177 12801 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.194298 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.212860 12800 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:53.191128 14059 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:53.179625 14022 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:53.191788 14087 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.797s	user 0.004s	sys 0.000s
I20260709 13:06:53.226444 12729 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.194041 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.236478 12728 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.221344 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:53.237087 12729 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.237262 12808 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.222249 14011 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.177315 14117 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.162820 14114 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.213636 14036 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.243055 12729 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.236112 12727 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.241789 12731 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:53.227869 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.232355 14118 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:53.248728 12799 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.249114 12729 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:53.249519 12729 pending_rounds.cc:85] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:06:53.249771 12729 pending_rounds.cc:107] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:53.250065 12729 raft_consensus.cc:2889] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.251549 12729 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:53.251801 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.239499 14011 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.263893 14107 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.241189 13818 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.264562 13818 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:53.264638 14107 raft_consensus.cc:697] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:53.260151 14022 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.236733 14103 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.264171 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.265730 14107 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.265570 13818 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.270264 12875 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.272351 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.271014 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1187) took 1688 ms. Trace:
I20260709 13:06:53.272981 12730 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.273129 12875 rpcz_store.cc:276] 0709 13:06:51.582544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.596279 (+ 13735us) service_pool.cc:224] Handling call
0709 13:06:53.269881 (+1673602us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:53.270073 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.270715 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.270954 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304384}
I20260709 13:06:53.269240 13818 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.278811 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.281605 13521 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:53.239010 14038 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.289211 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.277897 14040 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.301729 13521 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.280772 14103 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.247722 14036 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:53.304809 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.312645 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89160.6us
I20260709 13:06:53.288117 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.315197 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.314610 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.326223 14123 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:53.326973 14123 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.332177 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:53.334110 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.336210 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.338326 12874 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.341990 14126 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.343645 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.343958 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:53.344347 14117 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:53.345147 12875 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.334053 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.348215 13922 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.348426 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.309026 12727 raft_consensus.cc:2376] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2. Re-sending same reply.
I20260709 13:06:53.356137 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.358228 12877 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:53.284578 14011 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:53.190263 13997 consensus_queue.cc:1175] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "83d2731c4bc049b3929d6c39670f5fd8" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:53.311818 14040 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.332305 13797 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.348373 14123 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.348807 13922 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.377907 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.379024 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.417976 12725 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:53.383378 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.385876 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:53.395574 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.395581 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.412212 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.335106 14035 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.380307 14128 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.420464 12729 raft_consensus.cc:2368] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:53.345161 14117 consensus_queue.cc:1243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:53.422205 12879 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.422205 12731 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.414613 13797 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.424922 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.427009 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.429699 12725 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.430318 12877 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:53.423709 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.431686 13521 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.312820 14103 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.438386 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.442970 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:06:53.444394 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.429169 14035 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.446426 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.450750 12725 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.447060 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.451455 12879 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:06:53.428452 14011 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.425894 14128 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.435926 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.422068 14059 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.459335 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.460479 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.464387 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:53.465601 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.466387 12725 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.467106 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.468060 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.469012 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.469614 12725 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.440389 12875 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
W20260709 13:06:53.485240 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.483309 12881 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:53.483237 12879 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.488775 12879 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:53.492828 14103 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:53.504838 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.504715 14128 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.507246 14036 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.505343 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.512470 12727 raft_consensus.cc:2368] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
W20260709 13:06:53.512445 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 197327us
I20260709 13:06:53.482818 13822 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.511555 12725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:06:53.521426 12725 raft_consensus.cc:606] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:06:53.521804 12725 raft_consensus.cc:614] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.454988 14035 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:53.523780 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 175465us
I20260709 13:06:53.479674 14107 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.525763 13521 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:53.522321 13822 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.530462 14110 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.531029 14110 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:53.531244 13822 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.527544 13521 pending_rounds.cc:85] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Aborting all ops after (but not including) 2
W20260709 13:06:53.535849 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.536867 13521 pending_rounds.cc:107] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:53.537238 13521 raft_consensus.cc:2917] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:53.537627 13521 raft_consensus.cc:2889] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.538308 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.539697 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:53.522552 14067 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.546779 12806 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:53.549002 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.541309 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.527335 14107 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.559469 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:53.560442 12806 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:53.546897 14067 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.566242 14067 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:53.568248 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:53.569051 12799 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:53.569792 14035 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:53.542563 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.543363 14110 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.571372 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.571776 14110 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.557363 14011 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:53.575278 14131 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:06:53.576644 14130 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.578524 14017 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.579815 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.580206 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:53.581753 14114 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.582167 14114 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.582608 14117 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.583355 14117 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.582958 14114 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.583746 14117 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.584841 14059 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:53.586071 14007 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.586500 14007 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.583987 14021 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.590054 14040 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.593202 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.593924 12731 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:53.584375 14114 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.594832 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.561163 14107 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.586086 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.601671 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1157) took 1222 ms. Trace:
I20260709 13:06:53.602255 12732 rpcz_store.cc:276] 0709 13:06:52.379368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.080976 (+701608us) service_pool.cc:224] Handling call
0709 13:06:53.601370 (+520394us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54002d55d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:53.601578 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83379456}
I20260709 13:06:53.603065 14038 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.580956 12727 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.585039 14011 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.555476 14053 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.604386 14011 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.604661 14053 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.605453 14115 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.542842 13991 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.605556 14011 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.603598 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.606070 14115 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.579879 14017 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:53.608803 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:53.609517 12804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1449) took 1425 ms (client timeout 1535 ms). Trace:
W20260709 13:06:53.609886 12804 rpcz_store.cc:269] 0709 13:06:52.183749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.205295 (+ 21546us) service_pool.cc:224] Handling call
0709 13:06:53.609340 (+1404045us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54001d3dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:53.609466 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122745728}
I20260709 13:06:53.610239 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:53.595422 12731 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:53.613260 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:53.614214 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.616293 12732 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.620820 12731 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.623090 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.605898 13922 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:53.631708 14103 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.613371 13818 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.616219 13822 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.638480 12732 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:53.645924 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.624418 14011 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.647732 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.619797 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.605906 14053 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.626111 14098 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.656611 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:53.661913 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.636281 14136 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:53.646461 13822 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:53.670360 14040 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.671074 14040 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.657817 14103 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.648581 13943 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:06:53.678644 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.684171 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 102832us
I20260709 13:06:53.680362 12732 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.686555 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.663956 14015 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.653569 13922 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:53.672501 13822 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.648881 14115 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.693015 14115 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.698766 13902 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.708077 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.708818 12725 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3. Re-sending same reply.
I20260709 13:06:53.703269 13902 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.709939 12725 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.713260 14056 raft_consensus.cc:1064] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:53.719834 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.720877 13513 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:53.724524 13943 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.720153 12732 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:53.748132 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61680us
I20260709 13:06:53.749658 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:53.750108 12808 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:53.725150 13943 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.670320 14114 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.754884 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:53.747710 14068 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:53.751770 14123 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:53.756490 14123 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.751449 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:53.759090 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.760502 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.761406 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 151) took 3746 ms. Trace:
I20260709 13:06:53.757030 12628 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 2 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.768196 13943 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.757086 14007 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.770125 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.772751 12732 raft_consensus.cc:2368] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:53.773530 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.774044 12732 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:06:53.777132 14094 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.988s	user 0.006s	sys 0.000s
I20260709 13:06:53.754570 13818 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.779589 14032 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.782078 14128 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.782338 14123 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:53.786176 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.788131 14117 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.789590 12727 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.792091 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.792773 12724 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:53.793602 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.793711 12725 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:53.794144 12724 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:53.796171 14117 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:53.797586 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46322.3us
I20260709 13:06:53.761772 12630 rpcz_store.cc:276] 0709 13:06:50.007656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.007929 (+   273us) service_pool.cc:224] Handling call
0709 13:06:50.093782 (+ 85853us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:53.753583 (+3659801us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.554936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.561648 (+  6712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.561690 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:06:50.561710 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:50.750793 (+189083us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.756018 (+  5225us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.758682 (+  2664us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:06:50.913374 (+154692us) tablet.cc:701] Row locks acquired
0709 13:06:50.925615 (+ 12241us) write_op.cc:260] PREPARE: finished
0709 13:06:50.952431 (+ 26816us) write_op.cc:270] Start()
0709 13:06:50.973491 (+ 21060us) write_op.cc:276] Timestamp: P: 1783602410952368 usec, L: 0
0709 13:06:50.993014 (+ 19523us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.028644 (+ 35630us) log.cc:844] Serialized 4024 byte log entry
0709 13:06:51.200680 (+172036us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.363470 (+162790us) write_op.cc:301] APPLY: starting
0709 13:06:51.378022 (+ 14552us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.444148 (+ 66126us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.447976 (+  3828us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.453835 (+  5859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.454116 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:06:51.454183 (+    67us) write_op.cc:312] APPLY: finished
0709 13:06:51.454510 (+   327us) log.cc:844] Serialized 76 byte log entry
0709 13:06:51.482618 (+ 28108us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.520431 (+ 37813us) write_op.cc:454] Released schema lock
0709 13:06:51.571797 (+ 51366us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.612513 (+ 40716us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.623601 (+ 11088us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":155,"reported_tablets":13,"spinlock_wait_cycles":120377088,"child_traces":[["op",{"apply.queue_time_us":155255,"apply.run_cpu_time_us":5254,"apply.run_wall_time_us":230739,"num_ops":10,"prepare.queue_time_us":133003,"prepare.run_cpu_time_us":10502,"prepare.run_wall_time_us":483185,"replication_time_us":190353,"spinlock_wait_cycles":3840,"thread_start_us":125942,"threads_started":2}]]}
I20260709 13:06:53.822321 12773 leader_election.cc:400] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:53.799177 12724 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:53.800701 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:53.769590 13997 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.826854 12875 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:53.827345 12875 pending_rounds.cc:85] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:06:53.827235 13822 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:53.809516 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.824508 12724 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:53.857722 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.755124 14114 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.806327 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:53.827844 12875 pending_rounds.cc:107] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:53.754216 14098 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:53.828969 12880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1198) took 2239 ms (client timeout 1625 ms). Trace:
I20260709 13:06:53.811218 14033 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.811671 13943 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.864557 13943 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.864295 12880 rpcz_store.cc:269] 0709 13:06:51.592805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.608327 (+ 15522us) service_pool.cc:224] Handling call
0709 13:06:53.828756 (+2220429us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540006ccd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:53.828901 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4947980672}
I20260709 13:06:53.832677 14040 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.839175 13975 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.839735 14144 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:53.840757 13921 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:53.841708 13922 consensus_queue.cc:1243] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:53.842743 14020 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.842929 13906 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.856345 14044 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:53.843863 14135 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:53.844201 14035 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:53.843902 14037 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.845398 13941 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:53.846064 14029 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:53.846531 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:53.848783 14118 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:53.845446 14104 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.792s	user 0.004s	sys 0.000s
I20260709 13:06:53.849622 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1428) took 1033 ms. Trace:
I20260709 13:06:53.850646 14103 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.855122 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.855228 13928 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:53.794649 13818 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.883555 14045 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.884414 14045 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:53.884573 13818 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:53.857007 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.860067 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:53.860019 12732 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:53.861688 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:53.862564 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:53.863384 12875 raft_consensus.cc:2889] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.987406 13516 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.987733 12724 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:53.863626 13837 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:53.883615 14132 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 13:06:53.988961 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:06:53.868207 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:53.853511 13902 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:53.864230 14018 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.843083 12845 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:53.865072 13943 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.878124 12881 rpcz_store.cc:276] 0709 13:06:52.816477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.059095 (+242618us) service_pool.cc:224] Handling call
0709 13:06:53.059387 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.488004 (+428617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.849346 (+361342us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400220454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:53.849560 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974378880}
I20260709 13:06:53.871464 13975 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.882229 13922 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.882854 14069 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.869217 14033 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.979525 13521 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.988341 14040 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:53.982035 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 135601us
I20260709 13:06:54.015763 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:53.985030 14148 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.986191 14151 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:53.885154 13818 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:53.987663 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 125209us
I20260709 13:06:53.865681 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:53.874198 13906 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.855821 14056 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:53.874020 14014 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:06:53.879655 14103 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:53.880072 14118 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:53.885423 13822 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:53.883831 13518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 154) took 1068 ms. Trace:
I20260709 13:06:53.874287 14020 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.873354 14144 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.979043 12879 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.077332 12879 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.010502 14037 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.017171 12733 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:54.019354 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:54.081319 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:53.885413 14045 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.878852 14114 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.014863 14069 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.881523 14029 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:53.991995 12727 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
W20260709 13:06:54.042213 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.044114 13521 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:53.994416 14036 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.061951 12808 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.062799 12801 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:54.063993 12804 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.111328 12801 pending_rounds.cc:85] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:06:54.065421 12800 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.111688 12801 pending_rounds.cc:107] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:54.066735 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.112500 12805 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.113008 14155 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.113775 12805 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:54.068665 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.069648 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.115304 12806 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.016798 13941 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.063536 14151 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.018414 14135 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.116856 14135 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.117278 14135 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.118414 14151 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.119084 14151 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.119731 14151 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.014613 14040 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.070886 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 227904us
I20260709 13:06:54.040959 14035 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.039789 14143 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.004207 14018 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:54.085642 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66382.1us
I20260709 13:06:54.149351 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.150084 12802 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.011868 13922 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.103634 14147 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.116282 13941 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.157423 13941 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.158336 14032 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:54.159147 14032 consensus_queue.cc:1243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:54.072741 12807 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.156829 13486 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.121026 14033 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.121184 12804 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.161798 14108 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.080789 14037 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.163050 14037 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.164292 14037 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.164788 14038 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.012s
I20260709 13:06:54.165964 13797 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.070391 14107 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:54.167423 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.168443 14107 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:54.121944 12733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1148) took 1751 ms (client timeout 1838 ms). Trace:
W20260709 13:06:54.169163 12733 rpcz_store.cc:269] 0709 13:06:52.370340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.583508 (+213168us) service_pool.cc:224] Handling call
0709 13:06:54.121766 (+1538258us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000b5ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:54.121885 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292167552}
I20260709 13:06:54.169910 14007 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.122303 12730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 416) took 2592 ms (client timeout 1564 ms). Trace:
W20260709 13:06:54.171988 12730 rpcz_store.cc:269] 0709 13:06:51.586895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.595361 (+  8466us) service_pool.cc:224] Handling call
0709 13:06:54.122048 (+2526687us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001ef854. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:54.122230 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3689764608}
I20260709 13:06:54.123080 14029 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.123930 14069 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.124250 14114 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.173708 14118 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.128409 13818 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.175186 13975 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:54.179172 14149 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:54.125610 12731 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:54.180214 12731 pending_rounds.cc:85] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:06:54.180653 12731 pending_rounds.cc:107] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:54.180965 12731 raft_consensus.cc:2889] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.181808 14018 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:54.175921 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.183905 14075 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.126294 14144 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.111995 12801 raft_consensus.cc:2917] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:54.184921 12801 raft_consensus.cc:2889] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:54.072479 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 204339us
W20260709 13:06:54.140302 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.188948 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:54.129593 12808 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.087325 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.090760 13837 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.196622 12799 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
W20260709 13:06:54.199222 14011 consensus_meta.cc:287] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.012s
I20260709 13:06:54.201148 13906 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.149791 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:53.991487 14098 raft_consensus.cc:697] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:54.151103 13997 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.202637 13997 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.202708 14098 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.205466 13997 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.199450 14137 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:54.147652 14045 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.157444 14147 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.222553 13943 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:54.223279 14147 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:54.189674 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.190421 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:54.192709 14034 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.236905 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.192466 14143 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:54.239162 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.199642 12724 raft_consensus.cc:606] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.240272 12724 raft_consensus.cc:614] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.242045 12726 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:54.200058 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.244964 12730 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:54.213016 14137 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.247013 14137 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:06:54.207290 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57673.1us
I20260709 13:06:54.139883 12806 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.153432 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:06:54.216562 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.251533 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 98209.9us
W20260709 13:06:54.251765 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.156817 13922 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.108289 13822 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:54.257200 12728 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:54.257647 12728 pending_rounds.cc:85] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:06:54.257879 12728 pending_rounds.cc:107] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:54.258116 12728 raft_consensus.cc:2889] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.123974 14020 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:54.261271 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 70936.4us
I20260709 13:06:54.219755 12729 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:54.082778 14148 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 13:06:54.151865 14040 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.275665 12879 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:54.276201 12879 pending_rounds.cc:85] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 4
I20260709 13:06:54.276506 12879 pending_rounds.cc:107] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:54.276818 12879 raft_consensus.cc:2889] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.074101 13518 rpcz_store.cc:276] 0709 13:06:52.815239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.822257 (+  7018us) service_pool.cc:224] Handling call
0709 13:06:52.842995 (+ 20738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.843543 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.843573 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.844244 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.976316 (+132072us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:53.031497 (+ 55181us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.240395 (+208898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.245160 (+  4765us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.844829 (+599669us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:06:53.883235 (+ 38406us) raft_consensus.cc:1685] finished
0709 13:06:53.883488 (+   253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.883760 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11222,"prepare.queue_time_us":101713,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2382,"raft.queue_time_us":139439,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"spinlock_wait_cycles":2832256,"thread_start_us":331385,"threads_started":3,"wal-append.queue_time_us":183643}
I20260709 13:06:54.150836 14151 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.282032 14151 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.262893 13941 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.250676 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:54.254871 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1150) took 1884 ms (client timeout 1702 ms). Trace:
I20260709 13:06:54.273082 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:54.265210 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 450) took 1680 ms. Trace:
I20260709 13:06:54.282536 12727 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:54.284937 12726 rpcz_store.cc:269] 0709 13:06:52.370892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.375980 (+  5088us) service_pool.cc:224] Handling call
0709 13:06:54.254610 (+1878630us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400063e54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:54.254793 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4230876032}
I20260709 13:06:54.285565 12728 rpcz_store.cc:276] 0709 13:06:52.584432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.242986 (+658554us) service_pool.cc:224] Handling call
0709 13:06:54.254765 (+1011779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.258569 (+  3804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.264898 (+  6329us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400063e50. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:54.265121 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326209408}
W20260709 13:06:54.273694 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 408054us
I20260709 13:06:54.290601 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:06:54.291826 12728 raft_consensus.cc:606] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.292402 12728 raft_consensus.cc:614] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.293047 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.227411 14135 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.297111 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:54.289701 14067 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:06:54.299777 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49198.4us
I20260709 13:06:54.283958 14068 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:54.289348 14014 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.307968 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:54.291127 14137 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.113806 14155 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.300582 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:54.261088 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:54.283501 14037 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.308884 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.293269 13922 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:54.309902 13921 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.298740 14151 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.310094 14044 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:54.307382 13837 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:54.262954 13822 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.318080 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:54.346338 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:54.344054 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43531.9us
I20260709 13:06:54.297415 14118 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.353706 14155 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.353508 14103 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.355315 13797 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.355918 14044 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.356245 13921 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.358008 13822 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.358686 13943 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.319031 14068 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.263662 14114 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.314554 14147 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.313479 14014 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.361558 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 142110us
I20260709 13:06:54.355273 14103 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.363356 14040 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.364413 14123 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.365057 14035 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.342204 13906 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:54.368175 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.391891 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.394555 12724 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.368928 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:06:54.370904 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 62107.3us
I20260709 13:06:54.344921 14034 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.314800 14020 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:54.388533 12728 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.396823 12773 leader_election.cc:400] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:54.401517 12729 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:54.401940 12729 pending_rounds.cc:85] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:06:54.402509 12773 leader_election.cc:400] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:54.380319 14151 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.403083 12729 pending_rounds.cc:107] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:54.406297 12729 raft_consensus.cc:2889] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:54.401876 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.375289 14037 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.376471 13921 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.409063 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.412321 12728 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.383671 14014 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.388814 14114 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:06:54.419683 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50843.4us
I20260709 13:06:54.403882 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:54.392642 14123 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:54.422483 14147 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.431188 14147 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:54.431737 14147 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.431748 13902 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:54.411540 14143 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.421816 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:54.383795 14036 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:54.423906 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.424054 14068 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.424577 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.442029 12724 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:54.425637 14069 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.428220 13906 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.393518 12727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:06:54.381613 13922 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:54.437435 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.422646 13921 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.444831 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.400266 14033 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:54.439908 12729 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:54.436895 14123 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.456480 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.457032 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.457376 12806 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:54.441059 14151 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.435529 14034 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:54.453440 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:54.463642 12804 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.459529 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.452778 13921 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.446148 13941 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.455457 14068 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:54.463128 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.460063 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.460369 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.446123 14155 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.473719 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.465198 12808 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:54.468086 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.481882 12806 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:54.455267 14144 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.471765 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:54.482481 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.483182 12879 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:54.455174 14148 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:54.441636 13943 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:54.453423 12727 raft_consensus.cc:606] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:54.494396 12882 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.474529 12800 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:54.487361 12878 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.445196 13822 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:54.496142 12806 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.488286 12874 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.490005 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:54.459981 14152 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.453078 14158 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.492225 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.504850 12877 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.506562 12881 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:54.455492 13818 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.444204 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:54.466236 14069 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.509469 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.505028 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.512161 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.496935 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.513652 14147 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:54.517405 14160 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:54.463696 14151 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:54.493376 14020 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.495385 14114 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.493489 13928 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:06:54.523952 12877 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:06:54.462297 13837 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:06:54.542150 14035 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:54.474064 14044 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:54.493801 13797 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:06:54.549098 14152 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.527822 14135 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:54.523993 14037 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.528908 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.618211 12873 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:54.531764 14053 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:06:54.529670 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.621891 12802 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
W20260709 13:06:54.530928 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.539240 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:54.623756 13521 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:54.562875 12881 raft_consensus.cc:2368] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3.
I20260709 13:06:54.568722 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.574249 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:54.531896 12799 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:54.627019 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.627116 14152 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.627880 12799 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:54.628443 14135 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.629277 14135 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.584998 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.590374 12808 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.632915 14135 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.586585 14068 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.528254 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:54.539443 13818 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.602293 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.536418 14158 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:54.568184 14123 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.608111 14044 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.610633 13518 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:54.583675 14151 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.538096 14148 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:54.530355 14024 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
W20260709 13:06:54.583250 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 147504us
I20260709 13:06:54.568089 14069 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.593518 14029 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.536696 14144 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.529397 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:54.625509 12806 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:54.502934 12727 raft_consensus.cc:614] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.560297 14033 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.638470 12805 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:54.593823 14075 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:54.530148 14034 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.531687 13906 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:54.634579 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60602.6us
I20260709 13:06:54.698962 13521 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.956854 13521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 73) took 1263 ms. Trace:
I20260709 13:06:55.957273 13521 rpcz_store.cc:276] 0709 13:06:54.693639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.698274 (+  4635us) service_pool.cc:224] Handling call
0709 13:06:54.698695 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.956570 (+1257875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.956778 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.722124 14123 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.690284 14044 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:54.639377 14068 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.726140 14148 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.718979 14014 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.646122 14056 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.658620 14152 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.645725 13975 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.717010 14147 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.732226 13818 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.717366 14029 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:54.718353 14033 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:54.631784 12799 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.221585 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1475) took 1596 ms. Trace:
I20260709 13:06:56.222123 12799 rpcz_store.cc:276] 0709 13:06:54.624797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.630911 (+  6114us) service_pool.cc:224] Handling call
0709 13:06:54.631300 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.221119 (+1589819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.221475 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.223531 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.646137 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:54.655782 12801 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.740938 12803 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:06:56.264204 12803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 447) took 3060 ms (client timeout 2825 ms). Trace:
I20260709 13:06:56.264524 12808 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:56.264701 12803 rpcz_store.cc:269] 0709 13:06:53.203460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.234091 (+ 30631us) service_pool.cc:224] Handling call
0709 13:06:54.175750 (+941659us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800047a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:56.263908 (+2088158us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400398ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.264095 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285600896}
I20260709 13:06:56.266172 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1476) took 1631 ms. Trace:
I20260709 13:06:56.266208 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.266637 12808 rpcz_store.cc:276] 0709 13:06:54.634430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.634614 (+   184us) service_pool.cc:224] Handling call
0709 13:06:56.264100 (+1629486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.265058 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.265952 (+   894us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400398ad0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.266117 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3746917632}
I20260709 13:06:56.267066 12803 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:54.649361 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:54.714787 12880 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:54.716775 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 218080us
W20260709 13:06:55.684459 14174 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:06:56.275745 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1466) took 1789 ms. Trace:
I20260709 13:06:55.695729 14176 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:56.276124 12880 rpcz_store.cc:276] 0709 13:06:54.485969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.486595 (+   626us) service_pool.cc:224] Handling call
0709 13:06:54.528551 (+ 41956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.271732 (+1743181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.275548 (+  3816us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003ef8d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.275693 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427422080}
I20260709 13:06:56.276489 14176 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.277172 12630 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:06:56.278074 13906 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.278895 14044 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.279345 14176 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:55.710681 14177 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.279866 12630 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.280279 14177 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.281440 12630 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.282549 14177 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:55.734297 12876 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.000s	sys 0.036s
I20260709 13:06:56.282552 12630 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:56.284188 12876 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.000s	sys 0.038s
I20260709 13:06:56.284190 12630 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:06:55.746201 14169 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.025s	user 0.011s	sys 0.001s
I20260709 13:06:55.755945 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 480) took 1363 ms. Trace:
I20260709 13:06:55.761111 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:55.774601 14180 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.776546 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:56.287156 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 510738us
I20260709 13:06:56.286758 14180 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:56.279382 14044 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:55.793149 14182 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.288671 14182 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.289515 14180 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.289786 14044 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:55.805356 14184 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.815099 14185 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.817457 14183 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:55.836340 14186 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.847124 12731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.013s	sys 0.028s
I20260709 13:06:55.849881 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1461) took 1383 ms. Trace:
W20260709 13:06:56.293695 12731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.015s	sys 0.029s
I20260709 13:06:56.293915 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:56.294581 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 476) took 1904 ms. Trace:
I20260709 13:06:56.293771 12804 rpcz_store.cc:276] 0709 13:06:54.466267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.467679 (+  1412us) service_pool.cc:224] Handling call
0709 13:06:54.467990 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.727389 (+259399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.727437 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.727500 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:54.727546 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.849550 (+1122004us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001761d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:55.849606 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.849809 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595924736}
I20260709 13:06:55.850149 12806 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:55.864264 14188 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.680996 12725 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:55.904920 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:55.911896 12807 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:55.931013 12726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.010s	sys 0.023s
W20260709 13:06:55.951117 12771 connection.cc:256] RPC call timeout handler was delayed by -1.5280575230000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:06:56.015106 14191 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.016911 14187 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.017472 14190 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:06:56.028151 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.292373 14044 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.328132 14044 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.328559 14044 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:56.044263 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 87223us
I20260709 13:06:56.056114 14196 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.332680 14196 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:56.334399 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.335798 14196 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.336603 14196 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:56.337198 14196 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.312721 13906 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:56.339570 13906 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:55.584625 13902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.021s	sys 0.049s
I20260709 13:06:55.830368 14018 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.352968 14018 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.353915 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.355172 14018 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.354545 14044 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.042153 14014 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:55.681612 13484 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.543s (SENT) [suppressed 46 similar messages]
I20260709 13:06:55.455638 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 70) took 1212 ms. Trace:
I20260709 13:06:56.024261 13818 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:56.365437 13818 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.018901 13975 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.362738 13513 rpcz_store.cc:276] 0709 13:06:54.241147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.263806 (+ 22659us) service_pool.cc:224] Handling call
0709 13:06:54.301074 (+ 37268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.348535 (+ 47461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.372515 (+ 23980us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.416890 (+ 44375us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.730885 (+313995us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:54.737053 (+  6168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.741345 (+  4292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.404208 (+662863us) raft_consensus.cc:1685] finished
0709 13:06:55.404231 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.453597 (+ 49366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10296,"raft.queue_time_us":5182,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"thread_start_us":274272,"threads_started":1,"wal-append.queue_time_us":316689,"wal-append.run_cpu_time_us":2405,"wal-append.run_wall_time_us":1076825}
I20260709 13:06:56.369798 14018 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:56.370592 13975 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.040380 14029 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:55.776391 14034 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.012493 14056 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.375195 14056 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.961665 14068 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.490435 14069 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.036528 14033 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:54.741835 14108 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:06:55.015159 14118 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:06:56.389777 14223 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.390363 14223 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:55.960979 14123 raft_consensus.cc:670] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:55.572896 14144 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.023362 14147 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.399017 14069 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.715842 14151 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.995s	user 0.009s	sys 0.002s
I20260709 13:06:54.692811 14158 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:55.802047 14157 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.405740 14157 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:56.406780 14157 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.076484 14200 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.091287 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.091317 14202 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.409011 14223 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.409345 14202 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:56.410008 14223 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.410665 14157 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.142555 14203 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.148819 14195 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:56.163329 14204 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.163419 14024 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.411986 14202 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.413265 14024 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.413659 14024 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:56.412361 14203 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.414561 14024 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.415832 14203 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.415891 14024 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.412774 14195 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.173019 14207 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.417909 14207 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.170876 14206 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.419237 14195 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.182309 14040 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.184149 14208 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.420624 14208 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.422901 14208 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.185714 14209 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.423635 14209 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.410660 14223 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.426007 14209 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.186957 14210 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.426822 14210 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.427771 14223 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.199424 14214 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.428552 14214 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.430910 14214 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.200436 14215 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:56.202610 14216 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.432323 14216 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.433518 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.434818 14216 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.225037 14181 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.248150 12724 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.248189 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58468 (request call id 3) took 1865 ms. Trace:
I20260709 13:06:56.435690 14181 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.253671 14148 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.437127 14148 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:06:56.437646 12724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1207) took 1986 ms (client timeout 1698 ms). Trace:
W20260709 13:06:56.438124 12724 rpcz_store.cc:269] 0709 13:06:54.450919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.529105 (+ 78186us) service_pool.cc:224] Handling call
0709 13:06:56.437470 (+1908365us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540040ef54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.437581 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160130816}
I20260709 13:06:56.439380 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.257652 12800 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:56.440258 12724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1208) took 1989 ms (client timeout 1990 ms). Trace:
W20260709 13:06:56.440620 12724 rpcz_store.cc:269] 0709 13:06:54.451127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.439079 (+1987952us) service_pool.cc:224] Handling call
0709 13:06:56.440204 (+  1125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.441463 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.267879 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.444671 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 69) took 1720 ms. Trace:
I20260709 13:06:56.445077 12808 rpcz_store.cc:276] 0709 13:06:54.724109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.267618 (+1543509us) service_pool.cc:224] Handling call
0709 13:06:56.444589 (+176971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.446111 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.269377 12801 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
W20260709 13:06:56.447718 12801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1459) took 1985 ms (client timeout 2018 ms). Trace:
W20260709 13:06:56.448117 12801 rpcz_store.cc:269] 0709 13:06:54.462499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.462799 (+   300us) service_pool.cc:224] Handling call
0709 13:06:56.447522 (+1984723us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54001b6a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.447662 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427509632}
I20260709 13:06:56.449216 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.449856 12801 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:06:56.450819 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.271365 12628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 70) took 6504 ms. Trace:
I20260709 13:06:56.452220 12628 rpcz_store.cc:276] 0709 13:06:49.767534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.774563 (+  7029us) service_pool.cc:224] Handling call
0709 13:06:50.025579 (+251016us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.271288 (+6245709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:54.014326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:54.020821 (+  6495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:54.020860 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:54.020878 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:54.021230 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:54.021312 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:54.021342 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:54.021534 (+   192us) tablet.cc:701] Row locks acquired
0709 13:06:54.021555 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:54.021720 (+   165us) write_op.cc:270] Start()
0709 13:06:54.021850 (+   130us) write_op.cc:276] Timestamp: P: 1783602414021671 usec, L: 0
0709 13:06:54.021879 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:54.124709 (+102830us) log.cc:844] Serialized 529 byte log entry
0709 13:06:54.598531 (+473822us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:06:55.922788 (+1324257us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b180028e400. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41b70190 00007f0f41b69ae7 00007f0f41b68dd9 00007f0f41b73930
0709 13:06:56.036209 (+113421us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.072798 (+ 36589us) write_op.cc:301] APPLY: starting
0709 13:06:56.072879 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:56.072967 (+    88us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:56.072985 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:56.073289 (+   304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:56.073421 (+   132us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:56.073453 (+    32us) write_op.cc:312] APPLY: finished
0709 13:06:56.073637 (+   184us) log.cc:844] Serialized 22 byte log entry
0709 13:06:56.073826 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.073929 (+   103us) write_op.cc:454] Released schema lock
0709 13:06:56.073970 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:56.074769 (+   799us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.074800 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":669811,"reported_tablets":6,"spinlock_wait_cycles":234603392,"child_traces":[["op",{"apply.queue_time_us":35937,"apply.run_cpu_time_us":1585,"apply.run_wall_time_us":1872,"num_ops":1,"prepare.queue_time_us":211823,"prepare.run_cpu_time_us":57755,"prepare.run_wall_time_us":600593,"raft.queue_time_us":1421319,"raft.run_cpu_time_us":30459,"raft.run_wall_time_us":34558,"replication_time_us":2014168,"spinlock_wait_cycles":106076800,"thread_start_us":425305,"threads_started":4,"wal-append.queue_time_us":280523}]]}
W20260709 13:06:56.306396 12726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.837s	user 0.012s	sys 0.027s
W20260709 13:06:56.306945 12771 connection.cc:256] RPC call timeout handler was delayed by -1.4861148659999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:06:56.468813 12771 connection.cc:256] RPC call timeout handler was delayed by -1.324270892999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:06:56.469225 12771 connection.cc:256] RPC call timeout handler was delayed by -1.3092356490000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:06:56.469522 12771 connection.cc:256] RPC call timeout handler was delayed by -1.3089708929999233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:06:56.470044 12771 connection.cc:256] RPC call timeout handler was delayed by -1.2243708930000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 13:06:56.470417 12771 connection.cc:256] RPC call timeout handler was delayed by -1.0563749090000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 13:06:56.471387 14144 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.471899 14144 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.473263 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.474061 13521 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.474288 14144 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.474848 14144 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.305166 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:56.303704 14221 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:56.295311 12731 rpcz_store.cc:276] 0709 13:06:54.390656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.390772 (+   116us) service_pool.cc:224] Handling call
0709 13:06:54.414663 (+ 23891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.420683 (+  6020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.420716 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.421247 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.745728 (+1324481us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b2400035798. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3e98c9c4 00007f0f3e98aacb 00007f0f3eb45dc9 00007f0f3eb45a55 00007f0f3eb4509d 00007f0f4177710e 00007f0f4178e88c 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221
0709 13:06:56.039114 (+293386us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:06:56.294238 (+255124us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:56.294279 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.294345 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.294385 (+    40us) raft_consensus.cc:1685] finished
0709 13:06:56.294396 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.294530 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9575,"raft.run_cpu_time_us":15295,"raft.run_wall_time_us":1614755,"spinlock_wait_cycles":30888960,"thread_start_us":1828103,"threads_started":1,"wal-append.queue_time_us":273813}
I20260709 13:06:56.475807 14195 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.476580 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.476852 14195 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.477133 14221 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.477661 14221 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:56.478116 14221 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.478880 14195 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.286491 12630 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 2 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:06:56.309628 14188 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.481202 14188 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.310356 12725 pending_rounds.cc:85] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:06:56.481778 12725 pending_rounds.cc:107] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:56.481858 14014 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:56.482102 12725 raft_consensus.cc:2889] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:56.482321 14014 raft_consensus.cc:1068] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:06:56.482965 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 177948us
I20260709 13:06:56.307823 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1462) took 1839 ms. Trace:
I20260709 13:06:56.484233 12807 rpcz_store.cc:276] 0709 13:06:54.468556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.468704 (+   148us) service_pool.cc:224] Handling call
0709 13:06:54.479165 (+ 10461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.911645 (+1432480us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b5400213ca0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b6adc0 00007f0f41bf51c0 00007f0f41bf6231 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c
0709 13:06:56.307511 (+395866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.307749 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165673856}
I20260709 13:06:56.485327 14158 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.485836 14198 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.486187 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.486397 14198 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.486977 13521 raft_consensus.cc:2368] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4.
I20260709 13:06:56.306798 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:56.286247 12728 rpcz_store.cc:276] 0709 13:06:54.392789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.413257 (+ 20468us) service_pool.cc:224] Handling call
0709 13:06:54.413737 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.414765 (+  1028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.414804 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.439922 (+ 25118us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.636779 (+196857us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:54.636819 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.636890 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.755567 (+1118677us) raft_consensus.cc:1685] finished
0709 13:06:55.755597 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.755852 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6761,"raft.queue_time_us":624,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":11683,"thread_start_us":174900,"threads_started":1,"wal-append.queue_time_us":227151,"wal-append.run_cpu_time_us":1819,"wal-append.run_wall_time_us":1001875}
I20260709 13:06:56.488866 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.489501 12728 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:06:56.489943 12728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1212) took 2037 ms (client timeout 2311 ms). Trace:
W20260709 13:06:56.490300 12728 rpcz_store.cc:269] 0709 13:06:54.452020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.488611 (+2036591us) service_pool.cc:224] Handling call
0709 13:06:56.489887 (+  1276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.491204 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.491766 12728 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.501978 14221 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.322405 14220 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.293530 14004 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:56.292428 14183 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.505574 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 70) took 1781 ms. Trace:
I20260709 13:06:56.505858 14183 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.312808 14186 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.312362 14184 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.508148 14184 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.292402 14185 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.508477 14186 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.510221 14185 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.314530 14191 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.512355 14191 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.325470 14180 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.513298 14180 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.515264 14180 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.325989 14190 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.517881 14190 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.315042 14187 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.520120 14187 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.327533 14193 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.520864 14193 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.523183 14193 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.293542 14182 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.069825 14199 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.523605 14221 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.524161 14199 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.526594 14199 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.339735 14196 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.343628 14037 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:56.527601 14037 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.344075 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 45) took 1819 ms. Trace:
I20260709 13:06:56.348217 14217 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.529343 14217 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.530472 13518 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:56.355453 12733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1210) took 1903 ms (client timeout 1788 ms). Trace:
I20260709 13:06:56.530949 14196 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.357851 14044 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:56.358342 13902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.537s	user 0.023s	sys 0.052s
W20260709 13:06:56.364396 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 70566.3us
I20260709 13:06:56.531669 14196 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:56.531116 12733 rpcz_store.cc:269] 0709 13:06:54.451595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.760670 (+1309075us) service_pool.cc:224] Handling call
0709 13:06:56.355267 (+594597us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b54002d46d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.355380 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154905856}
I20260709 13:06:56.533726 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:56.534265 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.367794 13818 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.534566 14044 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.535107 14044 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.534621 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:56.535751 14044 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.537537 14190 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.538013 14190 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.538348 14190 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.391098 14056 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.203971 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:06:56.388018 14068 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.543450 12733 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.398797 14147 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.547605 14147 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.392019 12732 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:56.399678 14069 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.548302 12808 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.549404 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1209) took 2098 ms. Trace:
I20260709 13:06:56.408471 14200 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.557649 12733 rpcz_store.cc:276] 0709 13:06:54.451362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.533973 (+2082611us) service_pool.cc:224] Handling call
0709 13:06:56.549335 (+ 15362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.412837 14204 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.559026 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.559845 12733 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:56.560174 14204 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.560364 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 485) took 2026 ms. Trace:
I20260709 13:06:56.560855 12724 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:56.561947 12724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1206) took 2111 ms (client timeout 2003 ms). Trace:
W20260709 13:06:56.562304 12724 rpcz_store.cc:269] 0709 13:06:54.450705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.441208 (+1990503us) service_pool.cc:224] Handling call
0709 13:06:56.561781 (+120573us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400245254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.561879 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273237760}
I20260709 13:06:56.563499 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.418995 14206 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:56.196395 14212 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.565384 14212 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.560719 12733 rpcz_store.cc:276] 0709 13:06:54.534489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.558702 (+2024213us) service_pool.cc:224] Handling call
0709 13:06:56.560300 (+  1598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.198141 14213 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.567355 14213 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.435766 12727 rpcz_store.cc:276] 0709 13:06:54.382435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.383590 (+  1155us) service_pool.cc:224] Handling call
0709 13:06:56.248032 (+1864442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.568590 12731 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:56.568713 14204 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.569775 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:56.570439 12731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1213) took 2118 ms (client timeout 2242 ms). Trace:
W20260709 13:06:56.570753 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.436550 14211 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.570863 12731 rpcz_store.cc:269] 0709 13:06:54.452266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.476308 (+2024042us) service_pool.cc:224] Handling call
0709 13:06:56.570169 (+ 93861us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b5400410d54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.570376 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209309568}
I20260709 13:06:56.267571 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 72) took 1542 ms. Trace:
W20260709 13:06:55.727720 12730 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.006s	sys 0.028s
I20260709 13:06:56.571987 14157 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.572101 14024 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.572510 14220 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.431660 14215 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.458287 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:56.572647 14157 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:06:56.572808 14024 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.573462 12627 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.572239 12803 rpcz_store.cc:276] 0709 13:06:54.725397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.265920 (+1540523us) service_pool.cc:224] Handling call
0709 13:06:56.267519 (+  1599us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:56.573427 12730 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.901s	user 0.010s	sys 0.028s
I20260709 13:06:56.575167 14157 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.575328 14024 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.463302 14210 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.463754 14207 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.439652 14148 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:06:56.308941 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1478) took 1653 ms. Trace:
I20260709 13:06:56.576453 13902 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.483726 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:56.577126 13902 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.577574 13902 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.567390 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.492354 12802 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.576500 12806 rpcz_store.cc:276] 0709 13:06:54.655793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.713269 (+ 57476us) service_pool.cc:224] Handling call
0709 13:06:55.849752 (+1136483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.308013 (+458261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.308744 (+   731us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001761d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.308869 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613158656}
I20260709 13:06:56.575513 12627 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 3, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.485867 14158 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.579017 14024 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.571602 14221 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.579309 12627 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.580008 14221 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.580317 14220 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:56.579057 12802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1472) took 1973 ms (client timeout 1662 ms). Trace:
W20260709 13:06:56.581470 12802 rpcz_store.cc:269] 0709 13:06:54.605825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.622526 (+ 16701us) service_pool.cc:224] Handling call
0709 13:06:56.578850 (+1956324us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400175cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:56.578979 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513818368}
I20260709 13:06:56.582037 14221 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.498317 14198 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.498957 12800 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.500622 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:56.530905 14037 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.582706 14220 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:56.582815 12800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1477) took 1937 ms (client timeout 1953 ms). Trace:
I20260709 13:06:56.500988 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:56.583266 12800 rpcz_store.cc:269] 0709 13:06:54.645271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.645889 (+   618us) service_pool.cc:224] Handling call
0709 13:06:56.582743 (+1936854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.571530 14211 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:56.583856 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 82959.4us
I20260709 13:06:56.585330 12733 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.586333 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.321501 12729 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:56.587177 12729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1204) took 2137 ms (client timeout 1822 ms). Trace:
W20260709 13:06:56.583494 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54539us
I20260709 13:06:56.345534 13906 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:56.380234 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 698624us
I20260709 13:06:56.588681 13906 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.590732 14200 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.591677 13484 leader_election.cc:400] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3.
I20260709 13:06:56.545405 14068 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.019197 14152 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.549832 14069 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.400887 14151 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.550041 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 48) took 2719 ms. Trace:
I20260709 13:06:56.603996 12732 rpcz_store.cc:276] 0709 13:06:53.830553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.000939 (+170386us) service_pool.cc:224] Handling call
0709 13:06:54.001444 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.548325 (+2546881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.549709 (+  1384us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54002d41d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.549955 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5497222528}
I20260709 13:06:56.587440 14211 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:56.552825 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 348927us
I20260709 13:06:56.553516 13513 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.553838 14199 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.555234 14004 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.569626 14204 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.461894 14181 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:56.577787 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 94142us
I20260709 13:06:56.034891 14192 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.491328 14144 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.580754 14158 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:56.494593 12771 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.625s (SENT)
I20260709 13:06:56.495182 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1200) took 2740 ms. Trace:
W20260709 13:06:56.587531 12729 rpcz_store.cc:269] 0709 13:06:54.450215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.904507 (+1454292us) service_pool.cc:224] Handling call
0709 13:06:56.587109 (+682602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.368294 12799 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.505970 12804 rpcz_store.cc:276] 0709 13:06:54.724514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.487985 (+1763471us) service_pool.cc:224] Handling call
0709 13:06:56.502135 (+ 14150us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800047a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:56.502376 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.504602 (+  2226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.504634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.504695 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.504727 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.505334 (+   607us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b54002b2ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.505377 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.505500 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34647040}
I20260709 13:06:56.591696 14056 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.587555 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.592506 12724 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.592469 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:56.576181 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 117975us
I20260709 13:06:56.592841 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 189) took 2564 ms. Trace:
I20260709 13:06:56.663933 12731 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.595227 14215 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.592317 14148 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.571182 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.548115 12728 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:56.601964 14217 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.605754 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.680951 12732 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.681005 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 73) took 1955 ms. Trace:
I20260709 13:06:56.607312 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:56.607599 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:56.529143 12876 rpcz_store.cc:276] 0709 13:06:54.525890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.565602 (+ 39712us) service_pool.cc:224] Handling call
0709 13:06:54.593255 (+ 27653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.593481 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:56.284887 (+1691406us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.343290 (+ 58403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.343367 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.343428 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.343784 (+   356us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.343966 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":916506,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":2918,"raft.queue_time_us":14825,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":1735319,"threads_started":2,"wal-append.queue_time_us":73977}
W20260709 13:06:56.682107 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74903us
I20260709 13:06:56.682678 12881 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:56.604943 14213 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.685271 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.686160 12876 raft_consensus.cc:2410] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:56.622668 14196 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.599035 13484 leader_election.cc:403] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.681608 12808 rpcz_store.cc:276] 0709 13:06:54.725737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.551449 (+1825712us) service_pool.cc:224] Handling call
0709 13:06:56.551880 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.552296 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.552329 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.552850 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.648770 (+ 95920us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.648831 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.648932 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.680770 (+ 31838us) raft_consensus.cc:1685] finished
0709 13:06:56.680791 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.680944 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2234,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":95460,"threads_started":1,"wal-append.queue_time_us":78513}
I20260709 13:06:56.638564 12805 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.638628 14212 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.639681 14151 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.640686 14152 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.593878 14024 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:06:56.649030 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:06:56.698697 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49791.9us
I20260709 13:06:56.698884 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.699136 12880 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:56.648113 14068 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:56.657415 12725 rpcz_store.cc:276] 0709 13:06:53.755194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.819500 (+ 64306us) service_pool.cc:224] Handling call
0709 13:06:53.822287 (+  2787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.482617 (+2660330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.494912 (+ 12295us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540040d654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.495092 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962747264}
I20260709 13:06:56.706700 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.662873 12733 raft_consensus.cc:2376] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2. Re-sending same reply.
I20260709 13:06:56.677139 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.707649 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:56.707979 12729 raft_consensus.cc:2368] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3.
I20260709 13:06:56.708314 12882 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.708020 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.656345 14004 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.685876 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:56.619885 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:56.685876 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.648123 14190 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.664343 12630 rpcz_store.cc:276] 0709 13:06:54.013783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.025304 (+ 11521us) service_pool.cc:224] Handling call
0709 13:06:55.916730 (+1891426us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.578027 (+661297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.519157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.519842 (+   685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.519884 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:06:56.519905 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:56.522762 (+  2857us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.522851 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.522884 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:56.523449 (+   565us) tablet.cc:701] Row locks acquired
0709 13:06:56.524777 (+  1328us) write_op.cc:260] PREPARE: finished
0709 13:06:56.525191 (+   414us) write_op.cc:270] Start()
0709 13:06:56.525329 (+   138us) write_op.cc:276] Timestamp: P: 1783602416524896 usec, L: 0
0709 13:06:56.525362 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.526116 (+   754us) log.cc:844] Serialized 2440 byte log entry
0709 13:06:56.528466 (+  2350us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.529033 (+   567us) write_op.cc:301] APPLY: starting
0709 13:06:56.529115 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:56.529304 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:56.529438 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:56.530242 (+   804us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:56.530430 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:56.530476 (+    46us) write_op.cc:312] APPLY: finished
0709 13:06:56.530717 (+   241us) log.cc:844] Serialized 52 byte log entry
0709 13:06:56.530903 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.531008 (+   105us) write_op.cc:454] Released schema lock
0709 13:06:56.531055 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:56.531425 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.531453 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":513659648,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":2347,"apply.run_wall_time_us":2346,"num_ops":6,"prepare.queue_time_us":36886,"prepare.run_cpu_time_us":3996,"prepare.run_wall_time_us":9728,"replication_time_us":2960,"spinlock_wait_cycles":23808,"thread_start_us":36495,"threads_started":1}]]}
I20260709 13:06:56.652495 14144 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.688735 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 475) took 2298 ms. Trace:
I20260709 13:06:56.635663 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 160) took 6321 ms. Trace:
I20260709 13:06:56.649763 14206 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.693060 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.689776 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 477) took 2298 ms. Trace:
I20260709 13:06:56.666999 14148 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.696352 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.684556 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:56.697453 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.656257 14211 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:56.701486 12732 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.701671 12874 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:56.656649 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:56.792691 12882 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:56.815551 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 320986us
I20260709 13:06:56.815778 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.816393 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.816542 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.817200 12882 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:56.817116 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:56.702803 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 67) took 2034 ms. Trace:
W20260709 13:06:56.714668 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 94945.8us
I20260709 13:06:56.709444 12733 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:56.709380 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.807704 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.797677 12726 rpcz_store.cc:276] 0709 13:06:54.389996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.390130 (+   134us) service_pool.cc:224] Handling call
0709 13:06:54.415473 (+ 25343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.429825 (+ 14352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.429856 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.441485 (+ 11629us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.467651 (+2026166us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.544646 (+ 76995us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.688310 (+143664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.688485 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.688532 (+    47us) raft_consensus.cc:1685] finished
0709 13:06:56.688546 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.688669 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28718,"prepare.queue_time_us":77012,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":35418,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":10140,"spinlock_wait_cycles":14819200,"thread_start_us":2202519,"threads_started":3,"wal-append.queue_time_us":381574,"wal-append.run_cpu_time_us":2122,"wal-append.run_wall_time_us":1002532}
I20260709 13:06:56.819177 12731 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.707288 12725 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:06:56.680066 12728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1211) took 2228 ms (client timeout 2399 ms). Trace:
W20260709 13:06:56.820592 12728 rpcz_store.cc:269] 0709 13:06:54.451811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.490946 (+2039135us) service_pool.cc:224] Handling call
0709 13:06:56.679943 (+188997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.688091 14158 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.656761 14044 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.795867 14204 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.822288 14148 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.823369 14044 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.689913 14201 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:56.824189 14201 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.690156 13997 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:56.819896 12627 rpcz_store.cc:276] 0709 13:06:50.313983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.314185 (+   202us) service_pool.cc:224] Handling call
0709 13:06:56.635573 (+6321388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.619527 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.620303 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.620355 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:56.620383 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:56.621123 (+   740us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.621184 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.621208 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:56.621551 (+   343us) tablet.cc:701] Row locks acquired
0709 13:06:56.621577 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:56.621817 (+   240us) write_op.cc:270] Start()
0709 13:06:56.621960 (+   143us) write_op.cc:276] Timestamp: P: 1783602416621747 usec, L: 0
0709 13:06:56.621979 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.623132 (+  1153us) log.cc:844] Serialized 1288 byte log entry
0709 13:06:56.626179 (+  3047us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.626798 (+   619us) write_op.cc:301] APPLY: starting
0709 13:06:56.626908 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:56.627115 (+   207us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:56.627240 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:56.627859 (+   619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:56.628126 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:56.628194 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:56.628498 (+   304us) log.cc:844] Serialized 34 byte log entry
0709 13:06:56.628728 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.628859 (+   131us) write_op.cc:454] Released schema lock
0709 13:06:56.628914 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:56.630454 (+  1540us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.630499 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32290,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":366,"apply.run_cpu_time_us":2479,"apply.run_wall_time_us":2479,"num_ops":3,"prepare.queue_time_us":11783,"prepare.run_cpu_time_us":4646,"prepare.run_wall_time_us":23968,"replication_time_us":4052}]]}
I20260709 13:06:56.825505 13997 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:56.650867 14192 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.678588 14200 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:06:56.821717 14158 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.828800 14158 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.828869 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.829527 12876 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:56.785823 14037 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:56.784749 13486 leader_election.cc:400] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3.
I20260709 13:06:56.830612 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:56.831120 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46572.2us
I20260709 13:06:56.818606 12805 rpcz_store.cc:276] 0709 13:06:54.668942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.715898 (+ 46956us) service_pool.cc:224] Handling call
0709 13:06:54.716272 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.690277 (+1974005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.702546 (+ 12269us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54001752d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.702739 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4420627840}
I20260709 13:06:56.831872 12876 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:56.820923 12724 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.705250 12879 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.832728 14192 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.833413 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.833806 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.834044 12879 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.835238 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.835412 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.835533 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.836530 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.837776 12879 raft_consensus.cc:2410] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.838810 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.839627 12874 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.841104 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:56.841599 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.751765 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.839685 12729 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.842768 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:56.838861 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.842371 12874 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:56.844623 12879 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:56.844558 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:56.845808 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.846930 12771 leader_election.cc:400] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4.
I20260709 13:06:56.847286 12771 leader_election.cc:403] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.848425 12882 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.849748 14181 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.850154 14181 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.850533 14181 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.852413 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 167913us
I20260709 13:06:56.853410 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:56.854244 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:56.855273 14201 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.855521 14147 raft_consensus.cc:2764] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:56.857577 14147 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.858202 14193 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.861527 14190 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.864919 13902 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:56.866639 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.867164 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.866859 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.858430 14147 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.868566 14147 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.869254 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.870165 12726 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.704399 14024 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.871469 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.855350 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:56.857544 14182 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.710029 14220 raft_consensus.cc:2764] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:56.842947 12880 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:56.881829 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 489) took 2346 ms. Trace:
I20260709 13:06:56.900919 12726 rpcz_store.cc:276] 0709 13:06:54.535487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.871091 (+2335604us) service_pool.cc:224] Handling call
0709 13:06:56.881717 (+ 10626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.876364 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.704653 14213 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.705300 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 113829us
I20260709 13:06:56.951725 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.952478 12732 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.873926 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.954507 12733 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.955404 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.874225 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:56.956782 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 82618us
I20260709 13:06:56.958247 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:56.820572 12877 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:56.959419 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.960021 12877 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:06:56.960152 12729 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:06:56.960893 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.960991 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:56.961575 12729 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.884676 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.962086 12882 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.892004 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:56.962706 12879 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.872179 14192 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:56.794941 14212 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.906417 13902 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:56.882544 14182 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.846551 14152 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.709525 14191 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.820096 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.929189 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.929638 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.994469 12881 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:56.994585 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:56.930855 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 75583.6us
I20260709 13:06:56.942587 14158 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.944516 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.944430 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.945238 14180 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:57.001003 12726 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.945680 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.920819 14004 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:56.929802 13818 consensus_queue.cc:1059] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:56.948364 12799 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:06:56.949571 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.031790 12725 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:56.950249 13997 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:56.950507 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.036929 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.037205 12724 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.037874 12731 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:56.951172 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:56.877568 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.039948 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:56.965073 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.041436 12728 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:06:56.945703 12848 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37676 dropped due to backpressure: service queue is full with 50 items
I20260709 13:06:56.966171 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:56.973235 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.977068 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:56.983769 12729 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
W20260709 13:06:56.830590 14037 raft_consensus.cc:1068] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:56.893158 14201 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.985512 14183 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.995569 12880 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:57.033115 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:56.977981 14184 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.988392 14182 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.986351 14193 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.992650 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 68) took 2295 ms. Trace:
I20260709 13:06:57.036104 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:56.916124 13906 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.911906 14148 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.968209 14213 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.996217 14196 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:57.496181 12879 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.003s
I20260709 13:06:57.139745 14217 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:57.387391 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 429210us
I20260709 13:06:57.040375 14151 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4.
I20260709 13:06:57.387637 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.390733 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.368080 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.152482 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 112657us
I20260709 13:06:57.063871 14192 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.528684 12696 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:57.088222 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800131d80 after lost signal to thread 11579
I20260709 13:06:57.534879 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.535188 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.398311 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.536553 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:57.489943 12801 rpcz_store.cc:276] 0709 13:06:54.697736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.451816 (+1754080us) service_pool.cc:224] Handling call
0709 13:06:56.496853 (+ 45037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.652842 (+155989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.652869 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.653316 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.687113 (+ 33797us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.687154 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.878874 (+191720us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001c1bd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:56.878926 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.878969 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:56.878982 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.992534 (+113552us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1036,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":357966208,"thread_start_us":33401,"threads_started":1,"wal-append.queue_time_us":132727}
I20260709 13:06:57.537554 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.538393 12882 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:57.000974 14206 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.497s
I20260709 13:06:57.387351 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.489447 12875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.024s	sys 0.069s
I20260709 13:06:57.049829 12848 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37676 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 49)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 48)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 51)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 47)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1509)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1208)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 46)
I20260709 13:06:57.506261 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:57.388252 12732 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.497211 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.544147 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:57.548342 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9ee0 after lost signal to thread 12665
I20260709 13:06:57.549027 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.549860 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800154340 after lost signal to thread 12757
I20260709 13:06:57.550318 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.551123 12876 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:57.551249 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08000baf40 after lost signal to thread 12832
I20260709 13:06:57.487735 14201 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.326439 14152 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.561930 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.562964 12882 raft_consensus.cc:2368] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:57.088411 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:57.501363 14184 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:57.511543 14217 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:57.504206 14193 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:56.820271 12730 rpcz_store.cc:276] 0709 13:06:54.391021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.393225 (+  2204us) service_pool.cc:224] Handling call
0709 13:06:54.432398 (+ 39173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.443520 (+ 11122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.443564 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.459880 (+ 16316us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.645595 (+185715us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:54.670911 (+ 25316us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:06:55.806276 (+1135365us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800340360. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:06:56.575463 (+769187us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.668124 (+ 92661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.680970 (+ 12846us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.685992 (+  5022us) raft_consensus.cc:1685] finished
0709 13:06:56.687626 (+  1634us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.689711 (+  2085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2306,"prepare.queue_time_us":927144,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":8025,"raft.queue_time_us":12394,"raft.run_cpu_time_us":4135,"raft.run_wall_time_us":240543,"spinlock_wait_cycles":8551424,"thread_start_us":2140148,"threads_started":3,"wal-append.queue_time_us":417879,"wal-append.run_cpu_time_us":2445,"wal-append.run_wall_time_us":1010116}
I20260709 13:06:57.033532 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:57.516531 14213 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:57.530172 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.325153 14198 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:57.541657 14056 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:06:57.533695 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.536078 12874 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:57.064980 12727 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:57.086563 14180 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:57.499913 14196 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:57.490880 13906 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:57.542229 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.595671 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:57.597206 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.543936 12877 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:57.548151 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.504801 12879 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:57.601778 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.602892 12879 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.547305 12726 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.552004 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.604965 12876 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:06:57.553316 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:57.605567 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.544348 13518 raft_consensus.cc:2393] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:06:57.530445 14192 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.546170 12875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.025s	sys 0.070s
I20260709 13:06:57.542128 14211 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.489078 14183 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:57.614054 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.569794 12873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.012s
I20260709 13:06:57.553164 14212 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.559294 14187 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.535293 14200 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:06:57.582191 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:57.626318 12801 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:57.538987 13997 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:57.583004 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:57.581619 12724 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.563827 14201 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.363128 14185 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.588805 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.495244 12725 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:57.608403 14211 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.599751 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.612136 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.641153 12877 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:57.641321 12874 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.642174 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.608016 14192 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.616634 12873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.006s	sys 0.012s
I20260709 13:06:57.618093 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.583096 14210 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:57.601563 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800237e40 after lost signal to thread 12906
I20260709 13:06:57.620378 14187 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.621255 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.658402 12876 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.624842 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.567811 14152 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:57.600950 14181 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
I20260709 13:06:57.630134 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 56) took 1536 ms. Trace:
I20260709 13:06:57.659813 12880 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:57.660575 12726 rpcz_store.cc:276] 0709 13:06:56.093422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.604416 (+1510994us) service_pool.cc:224] Handling call
0709 13:06:57.629435 (+ 25019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.629698 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.629738 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.629803 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.629850 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.629921 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.630063 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:57.633576 12878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.018s
I20260709 13:06:57.633752 12724 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:57.640298 14056 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:57.581391 14147 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.712s	user 0.004s	sys 0.006s
I20260709 13:06:57.610085 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1220) took 1259 ms. Trace:
I20260709 13:06:57.618886 14212 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.675509 13818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.037s	sys 0.075s
I20260709 13:06:57.649012 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.716670 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.656901 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.718127 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.678012 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 58) took 1584 ms. Trace:
I20260709 13:06:57.718793 12882 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.718926 12724 rpcz_store.cc:276] 0709 13:06:56.094008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.629273 (+1535265us) service_pool.cc:224] Handling call
0709 13:06:57.629674 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.677584 (+ 47910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.677927 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.719269 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.721014 12874 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:57.603899 14196 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.678709 12878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.010s	sys 0.018s
I20260709 13:06:57.721061 12724 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:57.615798 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.729604 12879 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:06:57.683523 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.648895 14211 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.666065 14158 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:57.648015 14185 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:57.689291 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.751788 12880 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.650038 12881 raft_consensus.cc:2368] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4.
I20260709 13:06:57.753883 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.754674 12881 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.665791 14187 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.686170 14056 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.720324 14148 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:57.663915 12903 debug-util.cc:398] Leaking SignalData structure 0x7b080029c360 after lost signal to thread 12907
W20260709 13:06:57.785320 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 232086us
I20260709 13:06:57.786119 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:57.697819 14147 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:57.787684 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:57.789234 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:57.790179 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:57.790992 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:57.731247 12876 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:57.744009 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.713029 14212 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.638302 14217 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:57.727658 13818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.038s	sys 0.075s
I20260709 13:06:57.712088 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:57.737602 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1221) took 1372 ms. Trace:
I20260709 13:06:57.830633 12724 rpcz_store.cc:276] 0709 13:06:56.351170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.720367 (+1369197us) service_pool.cc:224] Handling call
0709 13:06:57.720815 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.723734 (+  2919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.723971 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.820767 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.672405 14181 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:57.775763 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.735584 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.834225 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.835014 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.835606 12881 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.761490 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.819504 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.836910 12874 raft_consensus.cc:2376] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4. Re-sending same reply.
I20260709 13:06:57.838184 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.838414 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.769918 14056 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.691936 12727 rpcz_store.cc:276] 0709 13:06:56.350886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.818941 (+468055us) service_pool.cc:224] Handling call
0709 13:06:56.944319 (+125378us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eacef8c 00007f0f3eaceef6 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:57.604510 (+660191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86913920}
W20260709 13:06:57.805063 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 246289us
I20260709 13:06:57.833413 12880 raft_consensus.cc:2376] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2. Re-sending same reply.
W20260709 13:06:57.820645 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08003104e0 after lost signal to thread 13545
W20260709 13:06:57.806296 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 300157us
I20260709 13:06:57.798734 14210 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.710636 14180 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:57.796550 14148 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.814252 12877 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
W20260709 13:06:57.796314 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 808820us
I20260709 13:06:57.824126 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:57.815243 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 237299us
I20260709 13:06:57.882139 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.863193 12805 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:06:57.827003 14024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.003s	sys 0.002s
I20260709 13:06:57.839118 12874 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:57.809341 14240 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:57.817185 14236 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.207s	user 0.000s	sys 0.002s
I20260709 13:06:57.832329 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:57.842787 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.930727 12881 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:57.931672 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.932336 12881 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.932065 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.846592 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:57.879534 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89426.9us
I20260709 13:06:57.933645 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1488) took 1295 ms. Trace:
I20260709 13:06:57.880573 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:57.861876 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:57.817090 14243 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.811434 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:57.936151 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:57.882905 12877 raft_consensus.cc:2393] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:06:57.869077 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.844230 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.934329 12724 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:57.934020 12882 rpcz_store.cc:276] 0709 13:06:56.648083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.846204 (+1198121us) service_pool.cc:224] Handling call
0709 13:06:57.933586 (+ 87382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.937676 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1487) took 1303 ms. Trace:
I20260709 13:06:57.938030 12880 rpcz_store.cc:276] 0709 13:06:56.633987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.847881 (+1213894us) service_pool.cc:224] Handling call
0709 13:06:57.937592 (+ 89711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.938292 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:57.938335 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.939375 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.939702 12874 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:57.853320 14238 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:57.823132 14246 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:57.941028 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60570.1us
I20260709 13:06:57.941067 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.948848 12881 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.942394 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:57.942569 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.949954 12874 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:57.853256 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:57.943944 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.861611 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 168) took 1196 ms. Trace:
I20260709 13:06:57.845585 14158 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.947525 12699 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:06:57.944489 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 133151us
I20260709 13:06:57.959625 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:57.961434 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 79576.3us
I20260709 13:06:57.956260 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.962504 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.963187 12881 raft_consensus.cc:2376] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2. Re-sending same reply.
I20260709 13:06:57.964563 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.962237 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:57.966048 12880 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.942997 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1493) took 1236 ms. Trace:
I20260709 13:06:57.879675 14148 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:57.883616 14210 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.886761 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:57.884166 14193 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:57.939579 14240 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.982668 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.983312 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1492) took 1294 ms. Trace:
I20260709 13:06:57.976315 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.987164 12882 rpcz_store.cc:276] 0709 13:06:56.689349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.938033 (+1248684us) service_pool.cc:224] Handling call
0709 13:06:57.983220 (+ 45187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.944082 14152 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:57.994326 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.953438 14200 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.997140 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1510) took 1089 ms. Trace:
I20260709 13:06:57.969447 12879 rpcz_store.cc:276] 0709 13:06:56.706504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.939115 (+1232611us) service_pool.cc:224] Handling call
0709 13:06:57.942933 (+  3818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.955327 14158 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.000545 12881 rpcz_store.cc:276] 0709 13:06:56.907559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.982325 (+1074766us) service_pool.cc:224] Handling call
0709 13:06:57.997039 (+ 14714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.008064 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.951663 14247 raft_consensus.cc:2764] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:58.002494 14200 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.981046 14148 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.978564 14185 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.010546 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1226) took 1093 ms. Trace:
I20260709 13:06:58.022302 12874 rpcz_store.cc:276] 0709 13:06:56.916903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.007728 (+1090825us) service_pool.cc:224] Handling call
0709 13:06:58.010472 (+  2744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.962373 13997 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:06:57.982405 14210 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.027766 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:57.944664 14243 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.002617 14193 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.995645 14240 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:58.033665 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57412.1us
I20260709 13:06:58.034124 12874 raft_consensus.cc:2368] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:06:58.015353 14158 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.018428 14147 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:57.956153 13513 rpcz_store.cc:276] 0709 13:06:56.665538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.682899 (+ 17361us) service_pool.cc:224] Handling call
0709 13:06:57.692212 (+1009313us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:06:57.861501 (+169289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15786240}
I20260709 13:06:58.022955 14200 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.035696 14193 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.025619 14259 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:57.994180 12727 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.040448 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:58.170207 12799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 71) took 3445 ms (client timeout 1517 ms). Trace:
W20260709 13:06:58.140662 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.170998 12799 rpcz_store.cc:269] 0709 13:06:54.725002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.223181 (+1498179us) service_pool.cc:224] Handling call
0709 13:06:58.169518 (+1946337us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001d51d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:58.169855 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331225984}
W20260709 13:06:58.143249 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 195622us
I20260709 13:06:58.026592 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1476) took 1420 ms. Trace:
I20260709 13:06:58.144523 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1214) took 1795 ms. Trace:
I20260709 13:06:58.176330 12876 raft_consensus.cc:2376] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4. Re-sending same reply.
I20260709 13:06:57.986642 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:58.173447 12875 rpcz_store.cc:276] 0709 13:06:56.605785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.607802 (+  2017us) service_pool.cc:224] Handling call
0709 13:06:56.846547 (+238745us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:56.849443 (+  2896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.850144 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.850212 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.850950 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.608024 (+757074us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.608130 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.608258 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.998940 (+390682us) raft_consensus.cc:1685] finished
0709 13:06:57.998961 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.023989 (+ 25028us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6450,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":160,"spinlock_wait_cycles":24226048,"thread_start_us":756636,"threads_started":1,"wal-append.queue_time_us":719703}
W20260709 13:06:58.168434 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.167593 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 231406us
I20260709 13:06:58.187284 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.187491 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:06:58.192494 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 234572us
I20260709 13:06:58.193409 12875 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:58.193989 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.194916 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.189695 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:58.196400 12881 raft_consensus.cc:2376] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4. Re-sending same reply.
I20260709 13:06:58.196517 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1478) took 1587 ms. Trace:
I20260709 13:06:58.197574 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.198248 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:58.188607 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:58.171029 12874 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:58.194962 12877 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 1.
I20260709 13:06:58.192095 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.073113 14148 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.199471 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:58.227156 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:58.211655 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:58.229032 13519 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:06:58.228782 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.209961 13521 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:58.230979 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.232422 13902 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.214238 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.212610 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.220937 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:58.222456 12879 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:58.224603 13997 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:58.225070 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:58.227794 14144 raft_consensus.cc:3055] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:58.231396 14004 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:06:58.158474 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 490) took 3620 ms. Trace:
I20260709 13:06:58.228848 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:58.175359 12725 rpcz_store.cc:276] 0709 13:06:56.349198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.637194 (+1287996us) service_pool.cc:224] Handling call
0709 13:06:57.637644 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.638070 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.638111 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.649676 (+ 11565us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.811694 (+162018us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.811745 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.811823 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.143579 (+331756us) raft_consensus.cc:1685] finished
0709 13:06:58.143634 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.144167 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11322,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":17559,"thread_start_us":102340,"threads_started":1,"wal-append.queue_time_us":250207}
I20260709 13:06:58.232669 12805 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.199419 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:58.196907 12873 rpcz_store.cc:276] 0709 13:06:56.608630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.608780 (+   150us) service_pool.cc:224] Handling call
0709 13:06:56.731885 (+123105us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eacef8c 00007f0f3eaceef6 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:56.732152 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.930696 (+198544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.930745 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.931394 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.643450 (+712056us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.643499 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.195725 (+552226us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000c80d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:58.195814 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.195907 (+    93us) raft_consensus.cc:1685] finished
0709 13:06:58.195922 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.196260 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1105,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":34508,"spinlock_wait_cycles":476006912,"thread_start_us":600243,"threads_started":1,"wal-append.queue_time_us":679284}
I20260709 13:06:58.292829 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.293387 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.294348 12873 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:58.294436 12875 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:58.295339 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1509) took 1388 ms. Trace:
W20260709 13:06:58.101223 14241 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:06:58.288228 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57671.2us
I20260709 13:06:58.297446 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:58.299222 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.097401 14210 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.301106 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.302150 12876 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:58.250629 14144 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:06:58.281144 14004 raft_consensus.cc:1068] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:58.056782 14193 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.305989 14261 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:58.307196 14261 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:06:58.087137 14250 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:06:58.251700 12730 rpcz_store.cc:276] 0709 13:06:54.537426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.573268 (+3035842us) service_pool.cc:224] Handling call
0709 13:06:57.600375 (+ 27107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.821112 (+220737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.821141 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.841637 (+ 20496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.995455 (+153818us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.995498 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.995571 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.152369 (+156798us) raft_consensus.cc:1685] finished
0709 13:06:58.152415 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.157457 (+  5042us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b540020e250. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:58.158190 (+   733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10553,"raft.queue_time_us":25610,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":7272,"spinlock_wait_cycles":10862848,"thread_start_us":329881,"threads_started":2,"wal-append.queue_time_us":189942}
I20260709 13:06:58.309824 12874 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:58.310696 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1208) took 1610 ms. Trace:
I20260709 13:06:58.310600 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.042862 14242 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.196602 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:58.311264 12874 rpcz_store.cc:276] 0709 13:06:56.700200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.308683 (+1608483us) service_pool.cc:224] Handling call
0709 13:06:58.309305 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.310350 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.310595 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.326146 12876 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:58.087670 14182 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.580s	user 0.014s	sys 0.000s
I20260709 13:06:58.366243 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1485) took 1732 ms. Trace:
W20260709 13:06:58.363368 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 134949us
I20260709 13:06:58.352713 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.305356 12877 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:58.325610 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:06:58.355594 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.066092 14248 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:06:58.312283 14242 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.385439 14242 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.316282 12727 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:58.363889 13997 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.387557 13997 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:58.311142 14144 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.320647 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.389050 13997 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.314025 12881 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:58.389902 12799 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:58.321532 14198 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 13:06:58.312983 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88134us
I20260709 13:06:58.366729 12876 rpcz_store.cc:276] 0709 13:06:56.633374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.303320 (+1669946us) service_pool.cc:224] Handling call
0709 13:06:58.319758 (+ 16438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.365864 (+ 46106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.366147 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.313725 14255 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.391429 12881 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:58.386332 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:58.295885 12875 rpcz_store.cc:276] 0709 13:06:56.907294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.292988 (+1385694us) service_pool.cc:224] Handling call
0709 13:06:58.295261 (+  2273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.389533 14144 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.320976 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 482) took 3924 ms. Trace:
I20260709 13:06:58.323586 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.311596 12879 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:58.366988 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1211) took 1666 ms. Trace:
I20260709 13:06:58.405607 12874 rpcz_store.cc:276] 0709 13:06:56.700886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.365658 (+1664772us) service_pool.cc:224] Handling call
0709 13:06:58.366150 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.366611 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.366646 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.366726 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.366762 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.366820 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.366926 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.361451 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 484) took 3963 ms. Trace:
I20260709 13:06:58.405699 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1217) took 1696 ms. Trace:
I20260709 13:06:58.103116 14217 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.408360 12881 rpcz_store.cc:276] 0709 13:06:56.702386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.390529 (+1688143us) service_pool.cc:224] Handling call
0709 13:06:58.391068 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.398956 (+  7888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.399196 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.070406 14191 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.039s	user 0.014s	sys 0.004s
I20260709 13:06:58.322211 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.321508 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:58.096815 14256 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 13:06:58.303694 14210 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:58.055008 14253 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:58.048434 14237 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:06:58.054004 14244 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:06:58.342623 14261 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:58.355190 14148 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:58.356181 14151 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.067195 14246 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:58.093227 14213 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.398146 14255 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:58.457577 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:58.404086 12731 rpcz_store.cc:276] 0709 13:06:54.396385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.074690 (+2678305us) service_pool.cc:224] Handling call
0709 13:06:57.075257 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.409540 (+334283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.409592 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.503760 (+ 94168us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.770531 (+266771us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.770588 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.770877 (+   289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.100613 (+329736us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:06:58.320355 (+219742us) raft_consensus.cc:1685] finished
0709 13:06:58.320406 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.320704 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285133,"raft.queue_time_us":333572,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":21089,"spinlock_wait_cycles":9050752,"thread_start_us":259125,"threads_started":1,"wal-append.queue_time_us":340075}
I20260709 13:06:58.073675 14184 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.091434 14243 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:58.366765 14182 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.471050 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:58.473418 12880 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:06:58.474359 12799 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:58.079077 14211 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.475976 14183 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.103552 14201 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.477886 14211 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.478986 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 488) took 3932 ms. Trace:
I20260709 13:06:58.479390 14257 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:58.076260 14181 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:58.460110 14151 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.474786 14246 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.486500 12879 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.507522 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1219) took 1804 ms. Trace:
I20260709 13:06:58.507822 14240 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:06:58.482628 12873 raft_consensus.cc:2410] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:58.485347 13513 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:06:58.511816 14240 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.514025 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:06:58.485177 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 99151.6us
I20260709 13:06:58.475793 12880 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.516333 14193 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.486889 14266 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:58.517916 14266 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:58.518442 14254 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.519055 14254 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.519441 14254 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.480376 14257 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.472111 12808 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:58.493013 12882 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:58.498347 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:58.504659 12807 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:58.499948 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1499) took 1713 ms. Trace:
I20260709 13:06:58.479054 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1480) took 1857 ms. Trace:
I20260709 13:06:58.520141 12804 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:58.493570 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 487) took 3958 ms. Trace:
I20260709 13:06:58.486783 12805 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:58.334229 14056 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.507951 12879 rpcz_store.cc:276] 0709 13:06:56.702855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.435121 (+1732266us) service_pool.cc:224] Handling call
0709 13:06:58.485574 (+ 50453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.507078 (+ 21504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.507420 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.497651 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:06:58.519078 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 486) took 3984 ms. Trace:
I20260709 13:06:58.466179 13902 raft_consensus.cc:697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:58.332907 14212 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:58.601084 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.680881 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:58.500164 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:58.407775 12728 rpcz_store.cc:276] 0709 13:06:54.397742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.066554 (+2668812us) service_pool.cc:224] Handling call
0709 13:06:57.585985 (+519431us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:57.586253 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.591417 (+  5164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.591446 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.591900 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.796067 (+204167us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.796136 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.796250 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.086440 (+290190us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:06:58.360768 (+274328us) raft_consensus.cc:1685] finished
0709 13:06:58.360824 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.361201 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4706,"raft.queue_time_us":5777,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":13349,"spinlock_wait_cycles":52305536,"thread_start_us":156509,"threads_started":1,"wal-append.queue_time_us":217790}
I20260709 13:06:58.466163 14255 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.479594 12732 rpcz_store.cc:276] 0709 13:06:54.535252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.557206 (+3021954us) service_pool.cc:224] Handling call
0709 13:06:57.557645 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.557910 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.557935 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.569960 (+ 12025us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.804343 (+234383us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.804386 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.804499 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.433330 (+628831us) raft_consensus.cc:1685] finished
0709 13:06:58.441374 (+  8044us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.467590 (+ 26216us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":190162,"threads_started":1,"wal-append.queue_time_us":238320}
I20260709 13:06:58.636529 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1212) took 1898 ms. Trace:
I20260709 13:06:58.663215 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.728192 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:58.592330 12726 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:58.597288 12876 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.849220 12882 rpcz_store.cc:276] 0709 13:06:56.701110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.370649 (+1669539us) service_pool.cc:224] Handling call
0709 13:06:58.492105 (+121456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.599574 (+107469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.599966 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.693750 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.700026 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:58.632196 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:58.662104 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 146063us
W20260709 13:06:58.597469 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 273622us
I20260709 13:06:58.526268 12877 rpcz_store.cc:276] 0709 13:06:56.786110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.406099 (+1619989us) service_pool.cc:224] Handling call
0709 13:06:58.498879 (+ 92780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.499356 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.499383 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.499596 (+   213us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:58.499629 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.499704 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.499843 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.863025 12804 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.479977 14201 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:58.864648 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1218) took 2151 ms. Trace:
W20260709 13:06:58.702466 14158 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.004s
W20260709 13:06:58.698278 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 561226us
W20260709 13:06:58.747917 14269 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
W20260709 13:06:58.698103 14187 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.927s	user 0.008s	sys 0.012s
I20260709 13:06:58.519534 14193 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.726728 14056 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:58.880296 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 432263us
W20260709 13:06:58.494709 14192 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.007s
I20260709 13:06:58.698285 14266 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.496105 14151 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:58.699338 14200 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.651s	user 0.001s	sys 0.015s
W20260709 13:06:58.490365 14196 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.002s
I20260709 13:06:58.800704 14247 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.495604 14182 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.482859 14263 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.881785 12730 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:58.596931 14259 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.698768 14265 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.726455 14268 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:58.847940 12729 rpcz_store.cc:276] 0709 13:06:54.534776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.085468 (+2550692us) service_pool.cc:224] Handling call
0709 13:06:57.771381 (+685913us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eacee9c 00007f0f3eacea5b 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:57.771662 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.772184 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.772225 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.772880 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.849514 (+ 76634us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.849571 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.849671 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.096176 (+246505us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:06:58.501515 (+405339us) raft_consensus.cc:1685] finished
0709 13:06:58.518689 (+ 17174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.518909 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2569,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10730,"spinlock_wait_cycles":976588416,"thread_start_us":45140,"threads_started":1,"wal-append.queue_time_us":81370}
I20260709 13:06:58.526683 12878 rpcz_store.cc:276] 0709 13:06:56.621405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.622012 (+   607us) service_pool.cc:224] Handling call
0709 13:06:56.697976 (+ 75964us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:56.698140 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.701305 (+  3165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.701337 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.710186 (+  8849us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.919733 (+209547us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18003b2d80. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:06:57.722540 (+802807us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.722580 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.722644 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.478464 (+755820us) raft_consensus.cc:1685] finished
0709 13:06:58.478510 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.478838 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2759,"raft.queue_time_us":6690,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":42182,"spinlock_wait_cycles":51034752,"thread_start_us":802563,"threads_started":1,"wal-append.queue_time_us":1010874}
I20260709 13:06:58.696224 14213 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:58.869311 12876 rpcz_store.cc:276] 0709 13:06:56.702612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.403528 (+1700916us) service_pool.cc:224] Handling call
0709 13:06:58.520482 (+116954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.853957 (+333475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.854420 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.527315 12733 rpcz_store.cc:276] 0709 13:06:54.535015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.133864 (+2598849us) service_pool.cc:224] Handling call
0709 13:06:57.530955 (+397091us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:06:57.531231 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.539584 (+  8353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.539621 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.542830 (+  3209us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.671543 (+128713us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.671597 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.671686 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.493045 (+821359us) raft_consensus.cc:1685] finished
0709 13:06:58.493085 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.493391 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7869,"raft.queue_time_us":8608,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7202,"spinlock_wait_cycles":18647296,"thread_start_us":106803,"threads_started":1,"wal-append.queue_time_us":239572}
I20260709 13:06:58.896947 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 62) took 1968 ms. Trace:
I20260709 13:06:58.910866 12731 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:06:58.850997 14257 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:58.906961 14196 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.914355 12725 rpcz_store.cc:276] 0709 13:06:56.928543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.292931 (+1364388us) service_pool.cc:224] Handling call
0709 13:06:58.293644 (+   713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.364277 (+ 70633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.364328 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.365040 (+   712us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.461803 (+ 96763us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.890978 (+429175us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.896095 (+  5117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.896350 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.896447 (+    97us) raft_consensus.cc:1685] finished
0709 13:06:58.896489 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.896825 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69796,"raft.queue_time_us":79500,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":10113,"thread_start_us":348976,"threads_started":2,"wal-append.queue_time_us":314355}
I20260709 13:06:58.907064 14200 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.906987 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.703943 14267 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.224s
W20260709 13:06:58.892472 12771 leader_election.cc:336] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.573s (SENT)
I20260709 13:06:58.491901 14191 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3.
I20260709 13:06:58.887547 14240 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:58.879412 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 582272us
I20260709 13:06:58.885211 12807 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:58.889338 14148 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.726141 14211 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.191s
I20260709 13:06:58.919648 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1215) took 2570 ms. Trace:
W20260709 13:06:58.899441 14245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.013s	sys 0.006s
I20260709 13:06:58.914012 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:58.907215 14180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.007s	sys 0.014s
I20260709 13:06:58.923180 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1246) took 1126 ms. Trace:
W20260709 13:06:58.925788 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.903184 14263 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.891040 14187 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.904373 14265 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:58.924003 12801 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:58.905316 14259 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:06:58.882262 14158 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.932243 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:58.935228 12730 rpcz_store.cc:276] 0709 13:06:57.797065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.309658 (+512593us) service_pool.cc:224] Handling call
0709 13:06:58.310259 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.900903 (+590644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.922920 (+ 22017us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540040d654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:58.923127 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301131008}
I20260709 13:06:58.930174 12726 rpcz_store.cc:276] 0709 13:06:56.349482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.696909 (+1347427us) service_pool.cc:224] Handling call
0709 13:06:57.752684 (+ 55775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.866473 (+1113789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.919227 (+ 52754us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b540020b2d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:58.919567 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721938304}
I20260709 13:06:58.913092 14268 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:58.936784 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:58.941623 14259 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:58.942669 14245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.015s	sys 0.006s
I20260709 13:06:58.945081 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.928174 14240 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.899958 14192 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:58.939517 14180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.007s	sys 0.015s
W20260709 13:06:58.971064 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 85856.1us
W20260709 13:06:58.947407 14242 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.561s	user 0.015s	sys 0.000s
I20260709 13:06:58.936825 14263 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.943552 14265 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.975672 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:58.973973 14242 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.978025 12805 raft_consensus.cc:2393] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:58.979341 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.979982 12800 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.981783 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1516) took 1154 ms. Trace:
W20260709 13:06:58.985620 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43501.3us
I20260709 13:06:58.981721 12808 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.988415 14180 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.989127 14180 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.989611 14180 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.931447 14213 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.991741 12805 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:58.992208 14148 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:58.992830 14213 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.993232 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.994185 12805 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:58.979475 14242 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.996826 12808 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:58.997920 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:58.987679 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:06:58.999938 14192 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.000413 14185 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.964922 14240 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.001400 14185 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:06:59.001719 14200 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:59.003630 14282 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:59.005095 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:59.005331 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1521) took 1176 ms. Trace:
I20260709 13:06:59.002899 14185 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.006461 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:59.005759 12881 rpcz_store.cc:276] 0709 13:06:57.828732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.438910 (+610178us) service_pool.cc:224] Handling call
0709 13:06:58.476277 (+ 37367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.477039 (+   762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.477084 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.477814 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.529214 (+ 51400us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.529303 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.529404 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.005040 (+475636us) raft_consensus.cc:1685] finished
0709 13:06:59.005061 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.005247 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2067,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":312,"thread_start_us":50756,"threads_started":1,"wal-append.queue_time_us":209936}
I20260709 13:06:59.008138 14247 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:06:59.008837 14247 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.010926 12727 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:58.998988 12808 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:59.011698 14187 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.012773 14187 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.995280 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:58.978075 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91728.4us
I20260709 13:06:59.005431 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:59.017760 14212 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.021870 13518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 170) took 1127 ms. Trace:
I20260709 13:06:59.000931 14193 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.023221 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:59.016898 14196 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.025197 14148 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:58.965335 13902 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.023141 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 59) took 2629 ms. Trace:
I20260709 13:06:59.028726 12724 rpcz_store.cc:276] 0709 13:06:56.393701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.957463 (+1563762us) service_pool.cc:224] Handling call
0709 13:06:57.989340 (+ 31877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.493832 (+504492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.493889 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.597398 (+103509us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.750968 (+153570us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.751276 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.797952 (+ 46676us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.022595 (+224643us) raft_consensus.cc:1685] finished
0709 13:06:59.022624 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.022934 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264086,"raft.queue_time_us":91287,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":14396,"thread_start_us":588060,"threads_started":2,"wal-append.queue_time_us":341905}
I20260709 13:06:58.982394 12875 rpcz_store.cc:276] 0709 13:06:57.826983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.440342 (+613359us) service_pool.cc:224] Handling call
0709 13:06:58.496527 (+ 56185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.497257 (+   730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.497296 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.498077 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.694079 (+196002us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:58.694232 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.752505 (+ 58273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.981466 (+228961us) raft_consensus.cc:1685] finished
0709 13:06:58.981501 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.981685 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9247,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":70103,"thread_start_us":146601,"threads_started":1,"wal-append.queue_time_us":424789}
I20260709 13:06:59.015005 14158 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.013248 14187 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.013236 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1247) took 1215 ms. Trace:
I20260709 13:06:59.047555 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.053548 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.047523 12807 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:06:59.053599 12771 leader_election.cc:336] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.596s (SENT)
I20260709 13:06:59.059104 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.056576 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:06:59.060632 14183 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:59.060695 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 101699us
I20260709 13:06:59.061098 14183 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.061601 14183 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.065001 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:06:59.066413 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.067157 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 171) took 1220 ms. Trace:
I20260709 13:06:59.047338 12727 rpcz_store.cc:276] 0709 13:06:57.797347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.387718 (+590371us) service_pool.cc:224] Handling call
0709 13:06:58.388228 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.011567 (+623339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.012857 (+  1290us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540040f954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:06:59.013149 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345570688}
I20260709 13:06:59.069533 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.070470 12800 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:06:59.016005 14254 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.067203 12802 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.072459 12805 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.073174 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.048683 14187 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.073664 14158 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.045560 14182 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.067662 13516 rpcz_store.cc:276] 0709 13:06:57.847089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.850883 (+  3794us) service_pool.cc:224] Handling call
0709 13:06:59.066787 (+1215904us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400339ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:06:59.066948 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556584320}
I20260709 13:06:59.079627 12808 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.080183 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:06:59.080986 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.076334 14196 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:59.082327 14196 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:06:59.079656 14278 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.083333 14278 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:06:59.083544 14196 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.063352 14193 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:59.074360 14144 consensus_meta.cc:287] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.007s
I20260709 13:06:59.089948 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:59.091962 14191 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.097899 12724 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.114214 12808 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:59.100555 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56452.7us
I20260709 13:06:59.117841 12806 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:06:59.121591 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.022416 13518 rpcz_store.cc:276] 0709 13:06:57.846683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.851001 (+  4318us) service_pool.cc:224] Handling call
0709 13:06:57.941730 (+ 90729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.040896 (+ 99166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.041079 (+   183us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.041704 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.487361 (+445657us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.487443 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.487571 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.973905 (+486334us) raft_consensus.cc:1685] finished
0709 13:06:58.973937 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.974203 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117801,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":230,"thread_start_us":481886,"threads_started":2,"wal-append.queue_time_us":583361}
I20260709 13:06:59.083779 14278 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.104867 12801 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:59.107302 14271 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.071816 14200 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.124311 14212 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.103253 14180 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:59.126646 12771 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.625s (SENT)
I20260709 13:06:59.130065 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:59.127250 14283 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.120s	user 0.004s	sys 0.000s
I20260709 13:06:59.136340 14191 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:59.137173 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 46) took 2228 ms. Trace:
I20260709 13:06:59.137585 14191 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.137691 12874 rpcz_store.cc:276] 0709 13:06:56.908353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.449504 (+1541151us) service_pool.cc:224] Handling call
0709 13:06:58.483299 (+ 33795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.484395 (+  1096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.484437 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.485189 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.822461 (+337272us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.822518 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.822608 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.038649 (+216041us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:06:59.136759 (+ 98110us) raft_consensus.cc:1685] finished
0709 13:06:59.136782 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.137080 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9234,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":130,"spinlock_wait_cycles":99128704,"thread_start_us":330660,"threads_started":1,"wal-append.queue_time_us":498950}
I20260709 13:06:59.132299 14200 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.140678 14200 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.142462 12805 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.131098 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:06:59.148427 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63584.7us
I20260709 13:06:59.148777 14158 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.149376 14254 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:59.149405 14158 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.150563 14158 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.159821 14271 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:59.161167 14271 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.163949 14267 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:59.164750 14187 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:59.169709 12771 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.646s (SENT)
I20260709 13:06:59.170634 14240 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:59.171818 12771 leader_election.cc:336] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.698s (SENT)
I20260709 13:06:59.167670 14187 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.135116 14255 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:59.176554 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.179678 14193 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.183151 14182 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:06:59.179697 14285 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.059s	user 0.005s	sys 0.000s
I20260709 13:06:59.186779 14180 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.188938 14268 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.226295 14268 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.189424 12804 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.191324 12802 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.213109 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:59.212803 14265 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.231393 14151 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.232908 12801 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.223265 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:59.235714 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.238173 14200 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:06:59.240744 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 68960.6us
W20260709 13:06:59.241680 12771 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.726s (SENT)
I20260709 13:06:59.242213 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:06:59.243665 12771 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.788s (SENT)
W20260709 13:06:59.244333 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70825.7us
I20260709 13:06:59.244975 14273 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.233947 14265 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.249958 14255 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.218400 14193 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.190122 14259 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.251652 14180 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.223874 14182 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.252503 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.253387 14183 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.225095 14263 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.258013 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.259217 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.260125 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.260576 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.260846 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.261639 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.283466 12807 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.233919 14151 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:59.322141 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 78507.9us
I20260709 13:06:59.322670 12804 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.301864 12802 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.215138 14278 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.282243 14273 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.327427 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.328287 12801 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:06:59.328989 12808 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.329501 12805 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:06:59.329726 12771 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.822s (SENT)
I20260709 13:06:59.330101 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.347895 12803 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.330842 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.331838 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:59.336182 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.281857 14254 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:06:59.354713 12807 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.285324 14247 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.362128 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.339352 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:59.367630 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 72352.4us
I20260709 13:06:59.350785 14151 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.375150 14254 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.376232 14151 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.377885 14254 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:06:59.380378 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50783.5us
I20260709 13:06:59.351130 14273 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.385116 14259 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.387053 14158 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.388610 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:59.389273 12874 raft_consensus.cc:2376] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5. Re-sending same reply.
I20260709 13:06:59.391659 12875 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.392267 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:06:59.392590 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.393301 14213 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.393672 12801 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:06:59.393761 14213 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.394219 14213 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.397015 14183 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.398480 14240 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:59.399711 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.400437 12804 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.402783 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:59.407487 12731 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:59.415000 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.419752 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:59.424907 13518 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.426204 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.427242 12801 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.433917 12724 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.434016 14263 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:59.434530 12771 leader_election.cc:336] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.844s (SENT)
I20260709 13:06:59.435024 14240 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.435588 12771 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.990s (SENT)
I20260709 13:06:59.435797 14240 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.401094 14200 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.439126 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.407413 12799 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:59.467711 12724 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:59.468101 14254 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:06:59.468549 14254 raft_consensus.cc:1068] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:59.469311 12727 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:59.469471 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.470161 13516 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.470692 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.471292 12730 raft_consensus.cc:2368] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3.
I20260709 13:06:59.471963 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.472167 14254 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.472792 12725 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.451429 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:06:59.459059 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3444465370000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:06:59.473878 12733 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.472642 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.475895 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:59.478125 12696 connection.cc:256] RPC call timeout handler was delayed by -1.2582544860000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 13:06:59.478154 12729 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:59.479890 12771 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.003s (SENT)
I20260709 13:06:59.473249 14254 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:59.495762 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.462805 14183 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.479486 13518 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.499639 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.477705 14151 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:06:59.505596 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45759.6us
W20260709 13:06:59.506772 14300 log.cc:927] Time spent T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:59.508019 14213 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.492640 14254 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:06:59.509259 12771 leader_election.cc:336] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.030s (SENT)
I20260709 13:06:59.515213 12729 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.520840 14247 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:59.526901 12731 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:59.539265 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.527376 14200 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.528024 14240 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.528196 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.500316 14265 consensus_queue.cc:1059] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:59.461077 14191 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:59.529294 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.531852 12733 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:59.528403 12728 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.534557 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.538600 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.549189 12730 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.551585 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.555336 14213 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.556371 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:59.559562 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.561197 14278 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.561429 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.562160 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.577461 12804 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.562559 12805 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.563488 12807 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.563874 12725 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.564301 14200 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.551294 14265 raft_consensus.cc:3055] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:59.566546 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.568686 14240 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.535547 14211 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.570034 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70176.9us
I20260709 13:06:59.592377 12732 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:59.556371 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.595463 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.595713 12726 raft_consensus.cc:2376] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4. Re-sending same reply.
I20260709 13:06:59.602778 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.597296 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.605669 12801 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 1.
I20260709 13:06:59.573480 14242 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.607205 12806 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.562592 12799 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:59.610277 12800 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:59.612946 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.613135 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.611912 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.589250 14265 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:06:59.616101 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.638797 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.662514 12731 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.638283 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.637951 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:06:59.664222 12771 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.053s (SENT)
I20260709 13:06:59.666353 12725 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:06:59.627411 12730 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:59.628070 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.669317 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.601043 12727 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.672672 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.673296 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.673996 12801 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:06:59.674093 12805 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:59.629611 14306 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:59.605233 14158 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.683156 12804 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:06:59.684018 12728 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.688099 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.626492 14303 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.687701 14183 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.663575 14151 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.686084 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.696979 12807 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.689203 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.629159 14213 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.692518 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.692961 12800 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:06:59.691380 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77345.2us
I20260709 13:06:59.631044 14200 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.628916 14271 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:06:59.699913 12730 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:59.700557 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 106082us
I20260709 13:06:59.694408 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.616228 14242 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.708508 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.715636 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.716262 12806 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.716913 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.604631 14211 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.713981 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:06:59.740670 12733 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:59.741029 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.741802 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.709729 14151 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.747843 14273 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.754400 12729 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.754611 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.755390 12733 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.755424 14273 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:06:59.756834 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.746126 14265 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.758845 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.759315 12726 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.759713 12724 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.750562 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.713281 14303 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.764359 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.728672 14213 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.777477 12808 raft_consensus.cc:2410] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:59.746629 12799 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:06:59.716504 14254 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.779889 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.763316 14265 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.778746 12726 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:06:59.740880 14182 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.784687 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.792399 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.793506 12803 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.794692 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.795092 12725 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:06:59.796344 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.801966 12724 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:06:59.808053 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.807343 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.815728 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.816461 12726 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.820663 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.825310 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:59.829305 14151 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:06:59.830452 14303 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:59.833142 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:06:59.834299 14200 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.821027 13518 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:06:59.842610 12731 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:59.843784 12732 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:59.808842 14316 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.794486 14193 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.863277 14312 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.863713 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:06:59.864025 14312 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:06:59.867120 14312 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:06:59.871960 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.872359 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:06:59.872815 12803 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.873195 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.874459 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.875643 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.876020 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.876693 12805 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.877666 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.844713 14240 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:59.861235 14308 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:59.891639 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.849098 14254 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.892655 12802 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.891404 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.885807 14183 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.899312 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:06:59.836596 14313 consensus_queue.cc:1175] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:06:59.904482 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:06:59.907864 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:06:59.909118 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 108967us
I20260709 13:06:59.913766 12725 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.915108 12804 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:06:59.915602 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.916466 12731 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.917364 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53795.3us
I20260709 13:06:59.918062 12808 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:59.920429 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.923977 14310 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.904599 12799 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.924630 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.862337 14316 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:06:59.924073 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:06:59.929039 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.939045 12725 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.939301 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.940485 12730 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.940789 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.943033 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.943819 12729 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.943746 12728 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:59.948609 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.950620 12724 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.940096 14211 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:06:59.959177 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.964938 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.972005 12731 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:06:59.965752 12732 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:06:59.974727 12802 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.977172 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:59.983637 12729 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:59.966493 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:06:59.984664 12724 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:06:59.988646 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:06:59.949558 14319 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.985797 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:06:59.993824 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:06:59.924688 14310 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.023257 12771 leader_election.cc:400] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:07:00.023773 12771 leader_election.cc:403] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.021621 12724 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:00.034246 12802 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.975812 14213 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:00.046932 12728 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.040623 12725 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:06:59.985206 12727 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
W20260709 13:07:00.044488 14292 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:00.051878 14318 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:00.043562 14320 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:07:00.057910 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.054128 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.060901 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.061170 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:00.084123 14193 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.084965 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:00.086571 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.086781 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.048693 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.084354 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:00.069610 12805 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:00.071519 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.052558 14319 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.081368 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:00.063931 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 153556us
I20260709 13:07:00.035542 14322 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.094051 12874 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.100011 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.087509 12732 raft_consensus.cc:2376] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3. Re-sending same reply.
I20260709 13:07:00.106055 12803 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:00.073235 14247 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.110481 12878 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:00.115161 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.087881 14158 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:07:00.112562 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.120965 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.100149 14151 raft_consensus.cc:2764] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:07:00.100706 14245 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.125901 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:00.129829 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47420.3us
I20260709 13:07:00.130664 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.130914 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.114988 14213 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.118182 14271 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:00.136973 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:00.129385 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.143221 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 181451us
I20260709 13:07:00.158461 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.160626 12876 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 2: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:00.162678 12879 raft_consensus.cc:2368] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 5.
W20260709 13:07:00.140769 14324 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:07:00.123502 12805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:07:00.119205 14318 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:07:00.172111 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.135167 14245 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:00.140936 14056 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.160943 14183 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:00.185806 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 54970.5us
I20260709 13:07:00.184129 14183 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.190909 14336 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.193539 14242 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.197252 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.198333 12733 raft_consensus.cc:2368] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:07:00.202159 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.203161 12881 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:00.208909 14310 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:00.130761 14322 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.162091 14271 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:00.231604 12728 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:00.220178 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 85895.5us
W20260709 13:07:00.232277 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 102574us
I20260709 13:07:00.230609 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:00.241925 14334 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:00.285881 14330 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.286480 14158 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.289958 12877 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:00.290766 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 61407.2us
I20260709 13:07:00.291828 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:00.237339 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57832.4us
I20260709 13:07:00.231609 12874 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:00.287815 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:00.308595 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.310292 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:00.288018 14240 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.314975 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:00.307899 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 107074us
I20260709 13:07:00.270449 14335 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:00.336687 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44981.6us
I20260709 13:07:00.338109 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.287760 14330 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:00.317569 14213 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.314165 14319 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:00.315868 14240 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:00.363215 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51416.5us
I20260709 13:07:00.314049 14183 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:00.364354 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:00.313197 14310 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:00.345646 14318 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:00.368207 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.308238 14245 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:00.357793 14242 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.389873 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:00.370206 14158 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:00.440521 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 96537us
I20260709 13:07:00.442333 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.399436 14213 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:00.444000 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89999.3us
I20260709 13:07:00.447903 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.444165 12805 raft_consensus.cc:606] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.449440 12805 raft_consensus.cc:614] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.449453 14335 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:00.447216 14151 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:00.470502 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 160347us
I20260709 13:07:00.482986 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.484750 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.461771 14318 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:00.485972 14273 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.486405 14318 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.486817 14318 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.455873 14348 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:00.492606 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89266.2us
I20260709 13:07:00.495882 14304 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:00.496500 14322 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:00.497479 14322 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.498013 14322 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.498409 14310 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:00.499248 14345 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:00.499759 14310 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.500262 14310 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.501292 14310 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.502669 14310 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.503748 14332 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 13:07:00.442716 14240 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.505666 14335 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.506785 14242 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:00.508220 14265 consensus_meta.cc:287] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.002s
I20260709 13:07:00.487898 14318 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.506273 14211 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.401211 14338 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:07:00.516912 14193 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.516995 14338 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.517472 14193 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:00.519698 14339 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:00.519006 14193 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.520305 14315 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.521677 14183 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:07:00.517807 14338 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.524452 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:00.538987 12877 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:00.545826 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 71667.8us
I20260709 13:07:00.473451 14151 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.555714 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.462167 14329 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.557524 14329 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.555399 14151 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.558991 14329 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.565587 14329 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.498121 14304 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:07:00.590740 14304 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.591231 14304 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.592624 14304 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.593901 14056 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.594254 14304 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.532557 14349 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.574841 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.578050 14350 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:00.595983 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45329.7us
I20260709 13:07:00.598475 14273 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.598747 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.499305 14322 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.599838 14247 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.602653 14273 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.603313 14273 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.603801 14273 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.601760 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.578922 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:00.578572 14265 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:00.579860 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 101932us
W20260709 13:07:00.608654 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 218824us
I20260709 13:07:00.579504 14338 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.581019 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.581163 14151 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.582160 14330 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.582461 14193 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.589258 14271 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.543161 14213 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.579007 14336 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.578254 14342 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.080s	user 0.004s	sys 0.000s
I20260709 13:07:00.615337 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.621240 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:00.613229 14056 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.613332 14350 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:00.622234 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.616882 14268 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.632959 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54340.6us
W20260709 13:07:00.637768 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.640722 14354 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:00.641542 14354 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.648537 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:00.651391 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 96907us
W20260709 13:07:00.652194 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.653625 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.654318 12874 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.654747 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.656628 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:00.657634 14348 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:00.658198 14348 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.662182 14351 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.662773 14351 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:00.664927 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.666749 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:07:00.673739 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.635828 14247 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.644467 14338 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.634380 14350 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:00.627303 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46433.6us
I20260709 13:07:00.681985 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.645175 14330 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.686758 14056 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.688246 14348 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:00.692358 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.688273 12874 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
W20260709 13:07:00.681430 12799 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.005s
W20260709 13:07:00.696686 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63684.9us
I20260709 13:07:00.697009 12878 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:00.632175 14158 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:00.625118 14213 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:00.700663 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:00.701138 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.702593 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:00.703431 13519 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:00.703723 14213 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.704491 14213 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.663899 14351 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.706082 12873 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:00.706310 14351 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.707166 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.707726 12873 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.696053 12799 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
W20260709 13:07:00.708891 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59822.9us
I20260709 13:07:00.699967 14056 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.709713 12848 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.709826 12875 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.711062 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.711894 14311 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.712369 14311 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.712678 14311 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.716173 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.716462 14319 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.716903 14319 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:00.717267 14319 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.717264 14315 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:00.683580 14336 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.719038 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:00.690426 14354 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.692422 14330 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:00.722891 14348 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:00.723134 14330 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.725860 12873 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:00.711702 14056 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.728826 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:00.728929 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.691596 14350 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.738473 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.745820 12879 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:07:00.738298 12874 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:00.746814 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.748220 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.748829 12881 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.749323 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.768303 13519 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.768589 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:00.768599 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.770269 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.771263 12877 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:00.772939 12878 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.773303 12773 leader_election.cc:400] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:07:00.773648 12773 leader_election.cc:403] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.717998 14315 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.721336 14336 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:00.786494 12726 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:00.789603 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:00.798990 12724 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:00.792094 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.800423 12808 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:00.781032 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.792732 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.801018 12876 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.800640 12879 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:00.794028 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 143195us
I20260709 13:07:00.802811 12800 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:00.737282 14303 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:00.805073 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 86148.3us
I20260709 13:07:00.806246 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.727530 14358 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.799571 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:00.809161 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:00.741073 14340 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.820456 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:00.737728 14360 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.821645 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.822937 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.844980 12733 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:00.824265 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.797021 14183 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.850715 14315 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.851052 14183 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.825735 12805 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:00.853696 12805 pending_rounds.cc:85] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 4
I20260709 13:07:00.854035 12805 pending_rounds.cc:107] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:00.854564 12805 raft_consensus.cc:2889] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.826599 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.831421 12730 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:00.845901 14268 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:00.834439 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.827316 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:00.857602 14268 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.858081 14268 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:00.858239 12807 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:00.783488 14349 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.836215 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.837903 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:00.828426 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.841077 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.818351 12732 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:00.804533 14354 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.773511 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54590.9us
W20260709 13:07:00.846887 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 154847us
I20260709 13:07:00.797396 14348 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.802587 14336 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.850211 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.859012 14268 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:00.888368 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:00.870214 12803 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:00.862411 12879 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:00.889935 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.890349 12803 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:00.890591 12879 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:07:00.862453 12808 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 2.
I20260709 13:07:00.891647 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.892195 14316 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:00.869153 12876 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:00.892688 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1513) took 1078 ms. Trace:
I20260709 13:07:00.893085 14359 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.893421 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.893760 14359 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.894390 12876 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:00.894510 14359 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.895275 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:00.895668 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.897087 14361 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:07:00.899524 12728 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.904315 12727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:00.905313 12727 raft_consensus.cc:606] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.907017 14318 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.845582 14363 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.909535 14363 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.915031 14355 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.873566 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.870386 12848 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:00.877166 12699 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.883515 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.888540 14268 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.892436 12879 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:00.862470 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.860797 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:00.809128 14303 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:00.921470 12877 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.842989 14247 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.934500 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.935142 12880 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.933377 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:00.842181 14360 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:00.942849 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:00.943536 12804 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:00.945461 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 75174.9us
I20260709 13:07:00.946759 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.954380 12728 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:00.955269 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 83308us
I20260709 13:07:00.955862 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:00.910079 14363 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.933872 14314 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:00.958318 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81344.2us
I20260709 13:07:00.956537 13487 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:00.951968 14337 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.983086 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:07:00.967344 12847 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.598s (SENT)
W20260709 13:07:00.968271 14328 log.cc:927] Time spent T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:00.968958 12696 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:00.970052 14182 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.970750 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:00.923722 14056 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:00.972909 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:00.976114 14363 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.916283 14158 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:00.919589 14151 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:00.870397 14277 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:07:00.883852 14265 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:07:00.985805 14316 raft_consensus.cc:1064] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:07:00.986333 14245 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.988279 14271 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:00.919510 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44342.4us
I20260709 13:07:00.988432 14357 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.990417 14211 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.990075 14303 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:00.991106 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:00.935194 14348 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:00.995532 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:00.935910 14349 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:00.935876 14247 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.997890 12880 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:00.949720 14360 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.059314 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:01.008484 12876 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:01.009662 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48109us
I20260709 13:07:01.059948 12880 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:01.051714 12873 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.015997 14363 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:01.018030 14311 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.018512 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:00.979753 14314 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.078984 14314 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.007685 14254 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.029865 12881 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:01.083472 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:00.991925 13516 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:00.893121 12799 rpcz_store.cc:276] 0709 13:06:59.814037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.820112 (+  6075us) service_pool.cc:224] Handling call
0709 13:07:00.892509 (+1072397us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b54001d4cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:00.892625 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186751232}
I20260709 13:07:00.996102 14337 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.993963 12727 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:00.992151 14367 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.022444 14351 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:00.916011 14355 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:07:01.080027 14314 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.057842 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:01.058162 14310 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:07:01.072568 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81559us
I20260709 13:07:01.073729 14359 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.074046 14349 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.110651 14183 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.062837 14247 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.077252 14311 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:01.111970 14273 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.003s
I20260709 13:07:01.077981 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:01.112416 14273 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.114583 14273 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.065130 14151 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:01.115945 14151 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.116361 12732 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:01.116334 14151 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:01.118029 14151 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.119268 14151 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.120127 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.121434 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.123458 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 175) took 1272 ms. Trace:
I20260709 13:07:01.123896 13516 rpcz_store.cc:276] 0709 13:06:59.850962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.872065 (+ 21103us) service_pool.cc:224] Handling call
0709 13:07:01.123243 (+1251178us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400670a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:01.123390 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466120960}
I20260709 13:07:01.125892 14278 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.082466 14254 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:01.126365 14278 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:01.126808 14254 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.049619 14358 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:01.081748 12878 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:01.030714 14357 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.086218 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 96326.4us
I20260709 13:07:01.141237 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.053973 12877 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:01.063323 14303 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.098868 12804 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:01.084751 14271 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:01.103991 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46357.1us
I20260709 13:07:01.109817 14304 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:01.131129 12847 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.671s (SENT)
I20260709 13:07:01.089150 14337 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.144258 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:07:01.162516 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.149726 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.164317 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.164215 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 168781us
I20260709 13:07:01.150672 12801 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:01.165139 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.165829 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.147801 12847 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.730s (SENT) [suppressed 69 similar messages]
I20260709 13:07:01.127422 14278 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.072575 14348 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.176100 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:01.167920 14310 raft_consensus.cc:2764] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:01.178450 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.179508 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.172948 14211 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:01.180971 14365 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.238s	user 0.000s	sys 0.002s
I20260709 13:07:01.181528 14211 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.182070 14383 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.186861 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:07:01.173614 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 337487us
I20260709 13:07:01.145578 14357 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:01.194898 14329 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.622s	user 0.016s	sys 0.000s
I20260709 13:07:01.128635 14336 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.188433 14376 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.222613 14242 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.224164 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.224692 14240 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.225710 14336 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:01.226137 14354 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3.
I20260709 13:07:01.227432 14378 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.228368 12881 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.198163 14313 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:01.232102 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52668.4us
I20260709 13:07:01.183053 14056 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:01.145150 14330 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.251632 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.258221 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 93178.8us
I20260709 13:07:01.261238 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:01.263900 12804 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.264773 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.227890 14378 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:01.229956 14265 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:01.276376 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.277778 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.214480 14310 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.230470 14273 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:01.309492 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48435.1us
I20260709 13:07:01.310627 14380 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:01.290036 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.309607 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.264178 14383 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:01.312846 14242 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.321328 14242 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.321831 14242 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.243709 14355 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.237041 14376 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.246281 14358 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.320457 14377 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.313561 14330 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.311208 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.330382 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 79115us
I20260709 13:07:01.331545 12875 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.328395 12802 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:01.277050 14313 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.260578 14329 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:07:01.362119 12848 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.362890 14329 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.363564 14329 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.364405 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.326491 14376 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.368440 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.366307 14311 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:01.369963 14386 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.335280 14349 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.364714 14329 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.340308 14310 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:01.188760 14245 consensus_queue.cc:1175] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45825bb09c34201b13ddcec07c4b3f1" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:01.386277 14350 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
W20260709 13:07:01.393270 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 83756us
I20260709 13:07:01.401201 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:01.399200 12878 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:01.393122 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.374534 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:01.386665 14312 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.386879 14247 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.409415 14350 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.410980 14247 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:01.412250 14310 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.408929 14312 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:01.413546 14312 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.414108 14381 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:01.350265 14304 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:01.382540 14311 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:01.425035 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52320.7us
I20260709 13:07:01.381930 14273 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:01.322247 14383 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.391431 14387 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.394721 14380 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:01.466950 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 155803us
I20260709 13:07:01.402822 14271 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:01.465517 14385 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.430732 14330 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.432708 14329 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.381556 14378 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.469815 14247 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.455912 14193 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.455411 14391 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.432991 14311 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:01.464113 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 279532us
I20260709 13:07:01.490725 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:01.491585 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65022.9us
W20260709 13:07:01.493710 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48644.6us
I20260709 13:07:01.484805 14349 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:01.488144 14331 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.488646 14387 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:01.517194 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:01.492234 14193 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:01.497767 14391 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:01.497254 14247 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:01.514851 14319 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.797s	user 0.017s	sys 0.000s
I20260709 13:07:01.515677 14378 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.542801 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:01.568172 13516 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.568356 14350 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:01.515677 14349 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.545938 14319 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:01.509651 14273 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.585853 12877 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:01.550796 14388 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:01.551139 14380 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.552150 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.484899 14313 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.555540 14379 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 13:07:01.556488 14390 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.556627 14393 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.557156 14387 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.558625 14338 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.863s	user 0.014s	sys 0.001s
I20260709 13:07:01.561233 14359 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.564647 14271 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:01.631268 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.573850 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.543529 12878 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:01.551604 14254 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.569720 14193 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.584892 14389 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:01.556648 13518 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:01.633005 14316 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.535516 14331 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.648530 14193 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.649040 14331 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:01.599742 14268 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.003s
I20260709 13:07:01.653272 12874 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.654014 14254 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:01.555732 14247 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.620149 14393 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.605980 14322 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.633738 13516 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
W20260709 13:07:01.657943 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 155495us
I20260709 13:07:01.662045 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.627105 14367 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.009s
W20260709 13:07:01.679528 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.677785 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 303385us
I20260709 13:07:01.684772 12801 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.688115 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.689167 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.689472 12808 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:01.690059 12802 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:01.559587 14391 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.692337 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.694314 12800 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:01.695494 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.691061 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.694674 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:01.704465 12801 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.704587 12808 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:01.705565 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:01.706144 12808 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:01.662569 14151 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.007s
W20260709 13:07:01.709627 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.722388 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 176955us
I20260709 13:07:01.728443 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.729605 12807 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:01.730194 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.731267 12806 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:01.732007 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.723080 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:01.727499 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:01.704001 14350 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:01.734709 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:01.735329 14382 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:01.735556 14384 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 13:07:01.736987 14211 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:01.737193 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44925.1us
I20260709 13:07:01.737753 14211 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.738665 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.739639 14211 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.740214 14268 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:01.741407 14268 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.741778 14268 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:01.742660 14268 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.745138 12803 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:01.745581 12803 pending_rounds.cc:85] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 1
I20260709 13:07:01.745784 12803 pending_rounds.cc:107] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:01.746018 12803 raft_consensus.cc:2889] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.747287 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:01.655095 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51463.9us
I20260709 13:07:01.755450 12801 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:07:01.757149 12801 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:01.735199 12804 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.752722 12808 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:01.747303 14314 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.003s
W20260709 13:07:01.754323 14360 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:07:01.660426 14322 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.752270 12803 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.762931 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:01.763228 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 243825us
I20260709 13:07:01.681056 14367 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.782328 12880 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:01.734186 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:01.765759 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:01.770393 12807 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.770934 14349 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.785287 12696 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:01.724108 14359 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.799445 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:01.735932 14382 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.735179 14350 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.764964 14318 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.857s	user 0.011s	sys 0.007s
I20260709 13:07:01.766561 14268 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.767679 14390 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.807507 14382 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.811262 14405 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.811669 14349 raft_consensus.cc:2764] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:01.812078 14387 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.812222 14322 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.813457 14338 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.812098 14314 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:01.817287 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51649.5us
I20260709 13:07:01.867008 12874 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:01.867353 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.806679 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43878.8us
I20260709 13:07:01.776568 14400 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:07:01.820331 12882 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.823060 12805 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:01.823253 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:01.721637 14403 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:07:01.841634 12725 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:01.807636 14363 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.863065 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:01.814371 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 80260us
W20260709 13:07:01.830626 14404 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:01.860759 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:01.774617 14242 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:01.889653 14242 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.890488 14242 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.891081 14242 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:01.822355 14348 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.816438 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:01.892516 12730 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.793077 14360 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.894644 14360 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:01.892477 14348 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:01.873006 12727 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.896189 14348 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.902354 14242 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:01.868546 14337 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.004s
I20260709 13:07:01.847150 14319 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:01.925346 12730 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:01.926142 12727 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:01.870774 14322 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.831755 14390 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.828682 14312 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:01.928480 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52236.2us
W20260709 13:07:01.929504 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.911816 14240 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.874010 14314 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.880075 14363 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:01.871598 14213 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 13:07:01.930997 14056 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.005s
I20260709 13:07:01.933063 14392 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.950201 12627 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.877048 14338 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:01.876592 14401 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:07:01.987675 12728 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:01.988184 12878 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.944620 13516 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:01.952893 14242 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.953004 14403 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:07:01.926929 14337 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:02.006167 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 143243us
I20260709 13:07:01.944079 14313 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:07:02.009869 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:01.939862 14211 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:07:02.013590 14385 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.016727 12879 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:01.987540 14387 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:02.016624 12627 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.999903 14340 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.021962 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.016182 14337 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.026006 12803 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:01.997687 14392 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.023604 12627 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:07:02.021245 14403 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.041330 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.048439 12803 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:02.038766 14247 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:02.058125 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.057268 14392 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:02.061113 14409 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:07:02.069262 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.069789 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.042943 14403 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:02.089550 12627 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 3 to 4, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 4 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.074764 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.092816 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:02.077138 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:02.097995 12804 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:02.099067 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:02.101742 12804 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.105370 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:02.044659 14314 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.021848 14363 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.108624 14363 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:02.108933 14413 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:02.052970 14350 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.091552 12627 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 2 to 5, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 5 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.114049 12803 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:02.118603 12803 pending_rounds.cc:85] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 1
I20260709 13:07:02.119004 12803 pending_rounds.cc:107] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:02.119347 12803 raft_consensus.cc:2889] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.042090 14385 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 13:07:02.121510 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50561.8us
I20260709 13:07:02.067308 14367 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:02.123730 14419 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:07:02.133257 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:02.124328 14421 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:07:02.128495 14410 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:07:02.025700 14340 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.131340 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:02.126605 14378 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.006s
W20260709 13:07:02.134694 14396 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:02.138465 12771 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.147044 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.113217 14193 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:02.148718 14193 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.151048 14193 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:02.115025 14392 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.142622 14350 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.152454 14392 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.154740 14392 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:02.147265 14420 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:07:02.156363 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.127388 12627 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 2 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.156872 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:02.135566 14329 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.003s
I20260709 13:07:02.159416 14247 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:02.159958 14349 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.160106 12627 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 3 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:02.163780 14376 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.001s
W20260709 13:07:02.166045 14397 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.549s	user 0.000s	sys 0.004s
I20260709 13:07:02.141168 14387 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.141551 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.146117 14312 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:02.170236 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 284441us
W20260709 13:07:02.171270 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.172133 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.174012 12803 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:02.174239 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.184250 12731 raft_consensus.cc:2376] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2. Re-sending same reply.
I20260709 13:07:02.176667 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.176883 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.177296 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:02.169924 14303 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.003s
I20260709 13:07:02.179677 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.164502 14338 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.190186 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.191025 12725 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:02.187055 12726 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:02.183141 12724 raft_consensus.cc:2376] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4. Re-sending same reply.
I20260709 13:07:02.202786 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.203626 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.208463 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.209048 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.210000 12802 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:02.210101 12803 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.213840 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.214994 12725 raft_consensus.cc:2368] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4.
I20260709 13:07:02.235435 13487 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:02.234211 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.181249 14376 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.236781 12802 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:02.239367 12803 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.240983 12725 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.174980 14247 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.236366 14265 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.245909 14265 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.246429 14265 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.208143 14193 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.240797 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.193701 14240 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.207827 14349 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.268379 14349 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.277824 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1538) took 1426 ms. Trace:
I20260709 13:07:02.278262 12879 rpcz_store.cc:276] 0709 13:07:00.851065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.934709 (+ 83644us) service_pool.cc:224] Handling call
0709 13:07:02.277585 (+1342876us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000c94d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:02.277731 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437667072}
I20260709 13:07:02.278910 14350 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.233506 14360 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.280659 14340 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.282557 14382 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.283706 12808 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.285544 14391 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:02.249507 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52908.5us
I20260709 13:07:02.251441 14240 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.259721 14359 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.263491 14376 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.251336 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.264586 12731 raft_consensus.cc:2368] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3.
W20260709 13:07:02.250771 14386 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.000s
I20260709 13:07:02.271754 14349 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:02.288303 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.290283 12771 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.239912 12803 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:02.294052 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:02.177569 14403 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.271340 14265 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:02.296367 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.296720 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.293491 14311 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.004s
W20260709 13:07:02.293560 14357 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.081s	user 0.013s	sys 0.001s
I20260709 13:07:02.285868 14247 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:02.302428 12882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1295) took 2221 ms (client timeout 1571 ms). Trace:
W20260709 13:07:02.309356 12882 rpcz_store.cc:269] 0709 13:07:00.081424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.081693 (+   269us) service_pool.cc:224] Handling call
0709 13:07:00.495419 (+413726us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b540011fc28. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479d0924 00007f0f46bb9227 00007f0f46bb8ab8 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:02.302179 (+1806760us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400220454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:02.302326 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054080128}
I20260709 13:07:02.289829 14391 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:02.304131 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.314865 14393 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.319492 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.308195 14360 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.311123 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.296471 14386 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.311664 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.331696 12733 raft_consensus.cc:2410] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:02.309008 14382 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.309130 14311 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.295210 14359 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.311265 14357 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.332221 12728 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.350776 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.333250 12726 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:02.306285 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 441350us
I20260709 13:07:02.335530 12724 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.341778 12733 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.339902 12771 leader_election.cc:400] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 5.
I20260709 13:07:02.344956 12725 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.306124 14405 raft_consensus.cc:697] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:02.354390 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.355585 12729 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:02.318567 12803 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.352025 12728 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:02.353669 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.385246 12877 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:02.385663 12724 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:02.387499 12730 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:02.418427 12728 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:02.432998 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48001.7us
I20260709 13:07:02.433774 12724 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:02.434306 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:02.344276 14340 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.436738 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.437899 12725 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:02.409101 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.420079 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.441685 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:02.345872 14240 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.442322 12873 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.442785 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.445335 14348 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.349367 14349 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.352955 14360 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.448820 12729 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:02.457569 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.448755 12726 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:02.458635 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.459245 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.460484 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.463476 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.464970 12725 raft_consensus.cc:2393] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:02.470052 12801 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:02.441390 14268 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.622s	user 0.015s	sys 0.004s
I20260709 13:07:02.476249 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.477029 12729 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:02.445417 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:02.452504 14278 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.408892 14386 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:07:02.475591 12803 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.457144 14382 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.463034 14240 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:02.484208 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:02.487542 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:02.488165 12801 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.462145 14378 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.488653 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:02.444480 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88235.4us
I20260709 13:07:02.467361 14348 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:02.477303 14273 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:02.454789 14340 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.453616 14358 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:02.480585 14265 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:02.537359 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.553292 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:02.490103 14151 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.523924 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.474704 14360 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.562254 14311 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.453801 14391 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.575409 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:02.577270 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 237562us
W20260709 13:07:02.579916 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.581919 13484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.001s	sys 0.023s
I20260709 13:07:02.586407 12803 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:02.558485 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.574328 14268 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.552738 14382 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:02.593292 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:02.521837 14378 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.593601 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.584720 14338 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.583845 14377 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:02.599226 12800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.025s	sys 0.081s
W20260709 13:07:02.599797 12800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.025s	sys 0.081s
I20260709 13:07:02.573733 14151 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.591208 14311 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:02.572623 14273 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:02.606091 12806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.038s	sys 0.063s
W20260709 13:07:02.609155 12806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.038s	sys 0.063s
I20260709 13:07:02.597766 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:07:02.592911 13518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.008s	sys 0.015s
W20260709 13:07:02.585345 13484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.001s	sys 0.023s
I20260709 13:07:02.613320 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.616730 14330 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.602039 14240 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.617944 12803 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:02.521004 14405 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.622272 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:02.623332 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.622216 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.625602 12806 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.626320 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:02.627024 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:02.627368 12881 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:02.628528 14240 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:02.612145 13518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.015s
I20260709 13:07:02.629583 14240 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.630470 13518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 179) took 1122 ms. Trace:
I20260709 13:07:02.630882 13518 rpcz_store.cc:276] 0709 13:07:01.508542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.522756 (+ 14214us) service_pool.cc:224] Handling call
0709 13:07:01.556258 (+ 33502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.556495 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:02.021006 (+464511us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.630018 (+609012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.630081 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:02.630134 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.630209 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.630399 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":569847,"threads_started":1}
I20260709 13:07:02.601130 14338 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.632452 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:02.634333 14338 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:02.634474 14378 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:02.634910 12806 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:02.636354 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:02.596549 14268 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.606910 14359 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:02.641705 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.678107 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.681150 14433 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:02.650249 12801 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:02.626363 12879 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:02.640899 12882 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:02.674846 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:02.686827 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:02.688376 12806 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:07:02.691540 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:02.638639 14268 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.601329 14348 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.610713 14311 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:02.701462 12881 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:02.706729 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.714083 12876 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:02.684192 14357 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:02.718317 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.727205 13519 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.737483 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.742755 12879 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:02.745645 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.749791 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.673547 14382 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:02.764258 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:02.753772 14430 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 13:07:02.771622 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:02.743141 14340 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:02.777060 14432 log.cc:927] Time spent T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:07:02.798904 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.952392 14436 log.cc:927] Time spent T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.213s	user 0.003s	sys 0.005s
I20260709 13:07:02.772289 14330 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:02.953701 14439 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.266s	user 0.000s	sys 0.007s
I20260709 13:07:02.869462 14360 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:02.878480 14438 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:07:02.754020 14359 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.948706 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.949213 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.949275 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.950461 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:02.950820 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.992908 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 214673us
I20260709 13:07:02.993687 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:02.996244 14427 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.996860 14427 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.003105 12879 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.003887 14393 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.008338 14393 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.009264 14151 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.010033 14151 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.010509 14151 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.011199 14393 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.004771 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 526) took 1263 ms. Trace:
I20260709 13:07:03.005616 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 513) took 1317 ms. Trace:
I20260709 13:07:03.012542 14273 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:03.012723 12805 rpcz_store.cc:276] 0709 13:07:01.687924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.688076 (+   152us) service_pool.cc:224] Handling call
0709 13:07:01.727701 (+ 39625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.872876 (+145175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.005373 (+1132497us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b54001d3dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:03.005562 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218433408}
I20260709 13:07:03.012229 12808 rpcz_store.cc:276] 0709 13:07:01.741341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.762231 (+ 20890us) service_pool.cc:224] Handling call
0709 13:07:01.762585 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.284355 (+521770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.004438 (+720083us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001757d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:03.004648 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197908224}
I20260709 13:07:03.014835 14427 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.016320 14444 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:03.011650 14278 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.007s
I20260709 13:07:03.016317 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:03.017915 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.018178 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.018606 12879 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:03.022051 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.017089 14330 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.017153 14444 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.024165 14338 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.024315 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:03.032823 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:02.990815 14360 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.989550 14443 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.029567 14340 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.047554 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:03.050930 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57309us
I20260709 13:07:03.053192 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:03.028889 14338 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.055934 13516 raft_consensus.cc:2410] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:03.075202 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:03.123325 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48247.4us
I20260709 13:07:03.124447 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:03.072620 14278 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.070912 14151 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:03.130914 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 123621us
I20260709 13:07:03.120050 14357 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.119335 14443 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.055598 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.153903 12879 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.050302 14340 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.122870 14268 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.125461 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:03.127082 14311 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:03.183255 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.151511 14360 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.186892 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:03.174252 14385 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.180403 14273 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.205256 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1546) took 2351 ms. Trace:
I20260709 13:07:03.212692 12873 rpcz_store.cc:276] 0709 13:07:00.854114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.274756 (+420642us) service_pool.cc:224] Handling call
0709 13:07:01.311574 (+ 36818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.448232 (+1136658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.204917 (+756685us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400209ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:03.205173 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600119552}
W20260709 13:07:03.216387 14445 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:03.183297 14450 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:03.218412 14450 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.224341 14340 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:03.228624 14437 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:03.152922 14278 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.232447 14278 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.232939 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:03.233529 14340 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.234282 12847 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 3.254s (SENT)
I20260709 13:07:03.173022 14435 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:03.199025 13521 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:03.262897 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.199478 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.278749 12879 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.191309 13518 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.197821 14447 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:03.293289 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59062.5us
I20260709 13:07:03.304366 14349 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:03.305190 14349 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.279179 14340 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.306954 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:03.308748 13519 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:03.309509 14340 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:03.310508 14340 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.311825 14340 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.245532 14452 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.312585 14452 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.280268 14444 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:03.235445 14385 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.318256 14385 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.315969 14444 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.321029 14444 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.315235 14452 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.290802 14450 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.194655 14311 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.286154 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.175103 14357 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.207742 14360 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:03.185051 14268 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.324805 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.325858 12873 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:03.325110 14360 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.288707 14338 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.322780 14311 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.329931 14311 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.331897 14357 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:03.384347 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.305580 13518 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:03.263553 14273 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.397655 14265 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.398348 14265 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.327096 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.414866 12873 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:03.416437 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.449553 12879 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:03.456766 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.457769 12879 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:03.463199 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1556) took 1647 ms. Trace:
W20260709 13:07:03.464099 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.476187 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 169358us
I20260709 13:07:03.463836 12878 rpcz_store.cc:276] 0709 13:07:01.816186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.828169 (+ 11983us) service_pool.cc:224] Handling call
0709 13:07:01.829788 (+  1619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.991467 (+161679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.462868 (+1471401us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000c80d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:03.463125 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363806464}
I20260709 13:07:03.461831 14385 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.484102 12880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1552) took 2521 ms (client timeout 2189 ms). Trace:
I20260709 13:07:03.487455 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.487218 14385 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:03.487547 12880 rpcz_store.cc:269] 0709 13:07:00.962526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.065217 (+102691us) service_pool.cc:224] Handling call
0709 13:07:03.483808 (+2418591us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54004209d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:03.483984 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539845888}
I20260709 13:07:03.488549 14268 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.489755 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.490489 14385 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.491436 12878 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.460744 14242 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.484871 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.492777 14242 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:03.494087 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.494063 14242 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.495069 12873 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.495666 14242 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.492132 14452 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.479547 14273 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:03.469846 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.491278 12880 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:03.501502 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.498142 14459 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:03.503940 12878 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:03.459725 14357 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.511098 12771 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:03.518692 12873 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:03.520571 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.521363 12873 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.521872 14359 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.524832 13518 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Advancing to term 4
I20260709 13:07:03.462359 14383 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.528776 14448 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:03.529917 14448 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.530349 14448 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:03.530478 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.510751 14311 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.532265 14311 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:03.500097 14400 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.536065 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.459163 14338 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:03.538761 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.528584 14383 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:03.515727 14451 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.282s	user 0.002s	sys 0.007s
I20260709 13:07:03.537470 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:03.538868 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.549808 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.541181 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.535686 14401 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.550573 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:03.539808 12873 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:03.553900 14401 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.555171 12873 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:03.538669 14357 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:03.551996 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.556264 14401 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:03.556489 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.536499 14400 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:03.559269 14400 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.559717 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.561519 14400 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.545081 14423 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:03.564610 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.564834 14423 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:03.566061 14423 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:03.566746 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.567658 12873 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.551941 12879 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:03.508873 14452 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.570983 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:03.571758 12727 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.572793 14452 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.568202 14423 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.534605 14459 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:03.575475 14453 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.358s	user 0.004s	sys 0.004s
I20260709 13:07:03.577365 14459 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:03.551806 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:03.614398 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 76725.6us
I20260709 13:07:03.598294 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.615971 12730 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:03.616470 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.584903 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.547183 14338 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.585120 14357 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.586577 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1553) took 1052 ms. Trace:
I20260709 13:07:03.588162 12878 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:03.590399 14318 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.591323 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1550) took 1122 ms. Trace:
I20260709 13:07:03.592710 12802 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:03.623994 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.593799 12804 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:03.626019 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.626552 12879 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.626798 12804 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:03.634285 12802 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:03.635836 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:03.636860 12804 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.579430 14311 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:03.596508 12880 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:03.581902 14383 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.598274 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:03.599220 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:03.531371 14448 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.642647 12729 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.644287 12729 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:03.646100 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.600926 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:03.647190 12808 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:03.601841 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:03.648197 12733 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.603696 12805 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:03.605469 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:03.650208 12801 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:03.606612 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:03.650763 12807 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.607239 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:03.607861 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.599424 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.618830 12878 pending_rounds.cc:85] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:03.619721 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:03.621501 12727 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:03.652480 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:03.618180 12803 rpcz_store.cc:276] 0709 13:07:02.534240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.593331 (+ 59091us) service_pool.cc:224] Handling call
0709 13:07:03.586327 (+992996us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54001b4754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:03.586497 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51032320}
I20260709 13:07:03.654654 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.651875 12800 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:03.656816 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.652472 12878 pending_rounds.cc:107] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:03.658860 12878 raft_consensus.cc:2889] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.660089 14360 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.660596 14360 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.660876 12880 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:03.660936 14360 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.661355 12880 pending_rounds.cc:85] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:03.661616 12880 pending_rounds.cc:107] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:03.661834 12880 raft_consensus.cc:2889] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.663324 12880 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:03.623003 14363 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.665202 12724 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:03.669680 12803 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:03.665922 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.671145 12808 raft_consensus.cc:2410] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:03.668210 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.671087 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.672703 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.672926 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.673884 12803 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:03.674456 12801 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:03.676518 12880 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:03.622557 14318 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:03.667477 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51071.5us
I20260709 13:07:03.678288 12873 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:03.685464 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.678367 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:03.686389 12805 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:03.692754 12847 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.658115 14423 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.695487 14318 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.700300 12875 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:03.700973 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1307) took 1011 ms. Trace:
I20260709 13:07:03.701323 12875 rpcz_store.cc:276] 0709 13:07:02.689425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.606892 (+917467us) service_pool.cc:224] Handling call
0709 13:07:03.700899 (+ 94007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.678200 14454 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.622809 12799 rpcz_store.cc:276] 0709 13:07:02.469252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.620865 (+151613us) service_pool.cc:224] Handling call
0709 13:07:02.636314 (+ 15449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.951433 (+315119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.989505 (+ 38072us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.051132 (+ 61627us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.288143 (+237011us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:03.304158 (+ 16015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.314936 (+ 10778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.574499 (+259563us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:03.590902 (+ 16403us) raft_consensus.cc:1685] finished
0709 13:07:03.590938 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.591243 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53872,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":17806,"spinlock_wait_cycles":135680384,"thread_start_us":499638,"threads_started":2,"wal-append.queue_time_us":158528}
I20260709 13:07:03.711280 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:03.716259 12880 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:03.720867 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 101032us
I20260709 13:07:03.697057 14318 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.655323 14459 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:07:03.691447 14363 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:03.693873 14448 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.710064 14338 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:03.665555 14151 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:03.725529 12805 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:03.728269 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 217269us
W20260709 13:07:03.738616 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56210.4us
I20260709 13:07:03.724540 14359 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.740470 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.724725 14454 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:03.739610 12771 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:03.719054 14423 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.737785 12804 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:03.758283 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:03.743942 14348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.031s	sys 0.061s
I20260709 13:07:03.766213 12847 leader_election.cc:400] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4.
I20260709 13:07:03.766650 12847 leader_election.cc:403] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.740070 14457 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.769550 14311 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.771975 14338 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.773384 14447 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.738852 14452 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:03.777137 14452 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.777539 14452 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:03.778475 14452 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.779702 14452 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:03.763353 14348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.032s	sys 0.061s
I20260709 13:07:03.784184 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.785379 12804 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:03.787667 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.789098 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.790555 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.791501 12805 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:07:03.792524 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.793627 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:03.786046 14350 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.796689 14340 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.790740 12799 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:03.797089 14311 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.795423 14314 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.780274 14460 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:03.798790 13518 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 4 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:03.815919 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.796155 14318 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.832139 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:03.833491 12805 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:03.831140 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 78862.9us
W20260709 13:07:03.835261 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91479.8us
I20260709 13:07:03.791610 14363 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.798446 14357 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:03.838094 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.840662 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:03.840880 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 101401us
I20260709 13:07:03.842389 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:03.833869 14464 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:07:03.802651 14457 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:03.834714 14151 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.847007 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:03.847831 14357 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.857759 14151 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:03.861441 14268 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.850828 14338 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4.
I20260709 13:07:03.857250 14457 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.862974 14457 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:03.848575 14340 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.863734 14340 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.864151 14340 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.861758 14151 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:03.860472 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:03.859333 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.865003 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:03.866374 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.851667 14360 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.872810 12807 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:03.878104 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.875669 12847 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.864326 14469 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.880002 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.847213 14314 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.846524 14459 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.888134 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:03.891127 14471 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.891989 14471 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.892387 14471 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.892740 14471 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.877666 14357 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.882791 14311 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.894515 14311 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.895017 14311 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.895437 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:03.893054 14390 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.858624 14467 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.846838 14460 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.906672 12847 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.011s (SENT)
I20260709 13:07:03.945382 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:03.909458 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.952116 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45504.3us
I20260709 13:07:03.882391 14359 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:03.893157 14360 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:03.920413 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.890057 14400 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:03.954715 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 79065.1us
I20260709 13:07:03.944701 14357 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.958247 12873 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:03.959518 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:03.873350 14268 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:03.906684 14459 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.835752 14454 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:03.996846 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:03.998986 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:03.981719 12731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 530) took 1801 ms (client timeout 2011 ms). Trace:
I20260709 13:07:03.989806 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.010918 12878 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:04.011391 12882 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:04.011847 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.948870 14151 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.992753 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1555) took 2176 ms. Trace:
I20260709 13:07:04.014604 12877 rpcz_store.cc:276] 0709 13:07:01.815843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.816735 (+   892us) service_pool.cc:224] Handling call
0709 13:07:01.842508 (+ 25773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.385726 (+543218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.992367 (+1606641us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54000717d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:03.992631 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185194752}
I20260709 13:07:04.018638 14459 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.019026 14318 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.946836 14423 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:03.885551 14469 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.013939 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.011063 12731 rpcz_store.cc:269] 0709 13:07:02.175338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.185126 (+  9788us) service_pool.cc:224] Handling call
0709 13:07:03.976777 (+1791651us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400063954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:03.977030 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137886592}
I20260709 13:07:04.028932 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.064296 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:04.024066 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:04.065312 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.005363 14465 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:07:03.897338 14240 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:03.980901 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 106579us
W20260709 13:07:04.074597 12696 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.578s (SENT)
I20260709 13:07:04.075081 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:03.954176 14314 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.070616 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 73925us
I20260709 13:07:04.078060 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:03.876816 14338 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260709 13:07:04.080109 14358 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.080781 14358 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:04.082345 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:03.961316 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:04.069819 14461 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:07:03.948522 14467 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.084174 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.015044 14475 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.019547 14318 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.098851 12802 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.950629 14460 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.095362 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.101137 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.097720 12875 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:04.121435 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.104113 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:04.122552 14268 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:04.123183 14242 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.123621 14242 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:04.083582 14359 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.122700 12805 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:04.098104 14360 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.090583 12847 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.918s (SENT)
I20260709 13:07:03.876362 14457 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:04.155675 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65153.9us
I20260709 13:07:04.083115 14476 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.118561 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.105247 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.130244 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.159096 12877 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:04.124019 14242 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.153254 14271 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:04.113422 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:04.134377 14311 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.137679 14349 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:04.149710 13516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 158) took 1522 ms (client timeout 1714 ms). Trace:
I20260709 13:07:04.138736 14475 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.102319 14423 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:07:04.152844 14391 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.183182 13516 rpcz_store.cc:269] 0709 13:07:02.626889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.632158 (+  5269us) service_pool.cc:224] Handling call
0709 13:07:04.149410 (+1517252us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540059d654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:04.149624 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911402240}
I20260709 13:07:04.188777 14311 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:04.124277 14383 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:04.194092 14457 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.199802 14473 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:07:04.154065 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 142269us
I20260709 13:07:04.101408 14390 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.069459 14469 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.113848 14318 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.174494 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61153.6us
I20260709 13:07:04.211576 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:04.214679 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.081883 14358 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:04.089589 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 211213us
W20260709 13:07:04.168229 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 152389us
I20260709 13:07:04.147346 12802 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:07:04.159933 14348 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.160099 14476 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.167168 14211 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.151826 14350 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:04.179317 14444 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.208652 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:04.222520 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 13:07:04.223424 14382 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.226239 12732 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:04.228188 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.245604 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:04.246949 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 144599us
I20260709 13:07:04.251977 13487 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:04.256731 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:04.258926 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50400.8us
I20260709 13:07:04.259712 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.262442 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.263805 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:04.233326 14467 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.226204 14390 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.238356 14387 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:04.230023 14423 consensus_queue.cc:1243] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:04.237308 14460 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.265587 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.244439 14350 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.238339 14476 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.225607 14478 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.274039 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.248440 14382 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.244392 14444 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:04.235085 14193 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:04.266408 14240 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.273425 14390 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.272845 14483 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.237941 14448 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:07:04.257915 14348 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.277292 14484 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.245385 14211 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.315968 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.316869 13513 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:04.317803 14211 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.297178 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.271457 14482 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.283587 14387 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.320626 14482 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.321090 14482 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.322258 14387 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.315541 14493 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:04.280789 14490 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:04.324211 14490 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:04.275394 14311 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:04.325366 14490 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.326865 14490 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.335587 14400 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.312727 13519 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:04.279160 14265 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.313894 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.288552 14423 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:04.315028 14483 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:04.315169 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.327056 14475 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:04.275030 14447 consensus_meta.cc:287] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.003s
I20260709 13:07:04.327492 14493 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.277578 14479 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.289325 14357 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.294409 14382 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.295048 14452 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.298233 14444 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.343986 13519 pending_rounds.cc:85] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Aborting all ops after (but not including) 5
I20260709 13:07:04.416507 13519 pending_rounds.cc:107] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:04.416874 13519 raft_consensus.cc:2889] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.295506 14383 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.373255 14423 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:04.343273 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1285) took 2525 ms. Trace:
I20260709 13:07:04.419098 12732 rpcz_store.cc:276] 0709 13:07:01.813510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.815490 (+  1980us) service_pool.cc:224] Handling call
0709 13:07:01.841221 (+ 25731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.254026 (+2412805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.331838 (+ 77812us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54001ef354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:04.338414 (+  6576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5484582656}
I20260709 13:07:04.354050 14491 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:04.354363 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.301501 14390 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.308957 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.331434 14471 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:04.350266 14474 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:07:04.340060 14254 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:04.307644 14405 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:07:04.302140 14314 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:07:04.385195 13521 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:04.373397 14265 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:04.366044 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52222.2us
W20260709 13:07:04.420161 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 132247us
W20260709 13:07:04.424347 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.459849 12878 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:04.437564 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83334.6us
I20260709 13:07:04.400894 14479 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.447827 12804 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:04.456523 14440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.312s	user 0.012s	sys 0.061s
I20260709 13:07:04.457182 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.457780 12731 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:04.400898 14447 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.410451 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.464123 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.415635 14452 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.403801 14493 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.402583 14242 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.469242 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:04.469735 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.471603 14501 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.473769 12805 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.457556 14265 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.481904 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.504290 12725 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:04.482679 13513 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 2: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:04.485572 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.466733 14254 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.468853 14483 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.506266 14265 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.464569 14424 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.524479 14424 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:04.527310 14424 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.492242 12726 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:04.470403 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.467880 14479 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.499094 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.468394 14440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.012s	sys 0.061s
I20260709 13:07:04.469170 14484 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.530301 12845 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:04.530208 14254 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.520278 14338 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.530524 14484 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.531227 14454 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.512640 13514 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:04.518893 14476 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.490621 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:04.534534 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.533937 14318 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.531414 14338 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.537195 12873 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:04.537669 12873 pending_rounds.cc:85] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:04.537901 12873 pending_rounds.cc:107] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:04.538156 12873 raft_consensus.cc:2889] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.538802 14318 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:04.539513 14338 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:04.540503 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:04.541234 14242 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:04.542052 14242 consensus_queue.cc:1059] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.479429 14452 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.544973 12724 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.547646 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.548864 12873 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.490665 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.577664 12805 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:04.578548 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:04.579252 14471 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:04.579528 13513 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:07:04.535853 14314 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.580665 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.572849 12882 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:04.579578 14486 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.584834 12728 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:04.590794 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120088us
W20260709 13:07:04.560212 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 107102us
I20260709 13:07:04.588723 12873 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:04.596084 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.597060 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.597959 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.598600 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.599110 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:04.604735 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.605854 12801 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.609571 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.614912 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.608583 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:04.615581 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.615968 12800 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:04.609735 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.610939 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.616822 12880 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:04.617165 12803 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.617820 12873 pending_rounds.cc:85] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:04.619158 14510 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.619773 14510 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:04.620255 14510 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.610095 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.621661 12873 pending_rounds.cc:107] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:04.621908 12877 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:04.622288 12877 pending_rounds.cc:85] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:04.622573 12877 pending_rounds.cc:107] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:04.622823 12877 raft_consensus.cc:2889] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.622193 12873 raft_consensus.cc:2889] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.614552 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.527915 14424 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:07:04.564499 14383 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:04.629298 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.630177 12874 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:04.496368 14350 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.492479 14428 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:07:04.535640 14400 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:07:04.506011 14423 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.492274 14502 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.139s
I20260709 13:07:04.638831 14476 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.613502 14151 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:04.640743 14360 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.640416 14383 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:04.613108 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:04.581948 14482 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.591034 14486 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.646422 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.655428 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.581785 14277 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:07:04.612623 14459 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.658102 12880 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:04.655905 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:04.689291 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 89832.5us
I20260709 13:07:04.644558 12799 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:04.672169 12803 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:04.674232 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 199500us
I20260709 13:07:04.675376 12807 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.636214 14450 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.685679 12874 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.630401 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 126429us
I20260709 13:07:04.693287 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.694921 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:04.687259 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.687815 12801 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:04.589901 14348 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.657333 14240 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:04.649739 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56729.8us
I20260709 13:07:04.704536 12727 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:04.694171 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.707871 12803 raft_consensus.cc:2376] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2. Re-sending same reply.
I20260709 13:07:04.696449 12730 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.711409 12725 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:04.717442 14482 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:04.705807 14359 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:07:04.691289 14443 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:04.686374 14387 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:04.705446 14471 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.711047 14348 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.705535 14476 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.722623 14476 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.723009 14476 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.723543 14348 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.657475 14491 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:07:04.695912 14508 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.725164 14491 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.725526 14508 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:04.725670 14491 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:04.726106 14508 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.728152 14481 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.603s	user 0.003s	sys 0.002s
W20260709 13:07:04.729198 14503 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:07:04.697701 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.731976 14484 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.732569 14484 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.733518 14240 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:04.733455 14484 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.690325 14511 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.734411 14193 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.734524 14240 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.735105 14193 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.735451 14493 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.737146 14193 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.726662 14491 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.738337 12803 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.738898 12848 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.739519 14471 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.739934 14510 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.741948 14510 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.744971 14350 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:04.745404 14469 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
I20260709 13:07:04.745832 14469 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.658674 14265 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:04.748646 14265 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:04.749223 14509 log.cc:927] Time spent T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:04.693632 14340 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.002s
W20260709 13:07:04.757601 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44927.1us
I20260709 13:07:04.759016 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.687299 14486 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.752960 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.766419 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.753643 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:04.767342 12732 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.755718 14403 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.692420 14360 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.746135 14400 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.703743 14338 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.777807 12882 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:04.763926 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:04.780081 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:04.787281 12882 pending_rounds.cc:85] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:04.787624 12882 pending_rounds.cc:107] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:04.787853 12882 raft_consensus.cc:2889] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.781826 12874 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:04.788936 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.790602 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.734465 14511 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.738361 14491 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.743139 14452 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.795341 12730 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:04.713816 14450 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.773005 14469 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.692754 14390 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.803323 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.774762 14510 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.797619 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.787153 14360 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.723820 14382 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.798441 14514 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.788025 14193 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.786444 14338 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.760483 14490 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:07:04.819262 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:04.816735 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52948.7us
I20260709 13:07:04.820917 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:04.835336 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.765214 14444 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.775403 14340 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.812464 14400 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:04.950335 12882 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:04.951215 14400 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.952459 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.954264 14490 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.954768 14490 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.957867 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:04.962270 14363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.006s	sys 0.002s
W20260709 13:07:04.962762 14363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.006s	sys 0.002s
I20260709 13:07:04.801087 14511 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.777436 14482 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:04.877121 14514 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.969858 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:04.816979 14512 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.809434 14271 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:07:04.820739 14424 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.879835 14338 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.972308 12882 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:04.884109 13516 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:04.985019 12803 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.955209 14490 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:04.977921 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 157133us
W20260709 13:07:04.859859 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.833555 14360 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.838135 14443 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.145s
I20260709 13:07:04.839897 14476 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.833237 14405 consensus_queue.cc:1059] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.153s
I20260709 13:07:04.995507 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:05.013177 14514 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.022567 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:04.880249 14193 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:04.982635 14348 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.983101 14424 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.981781 14469 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.059542 14444 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:05.063441 14515 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:05.064203 14348 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:05.065202 14390 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:04.979441 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 178632us
W20260709 13:07:05.074088 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.840050 14471 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.027516 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:05.075747 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48336.7us
I20260709 13:07:04.976825 14493 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:07:05.051501 12882 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.049926 14350 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:05.054648 14476 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.055555 12875 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:04.999264 14151 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:05.055997 14382 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:04.985090 14450 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.057539 14193 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.058010 14340 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:05.058781 14452 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:05.059188 14424 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.070714 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:05.115437 12801 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.071412 12732 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:05.071576 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:04.982999 14512 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.059698 14469 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.117312 12800 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.106459 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:05.135334 12801 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:05.143338 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.106671 14350 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.108925 14443 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.126238 14151 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:05.184890 14518 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:05.199174 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:05.200006 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:05.200711 12873 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:07:05.201808 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:05.202401 12873 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.199851 12876 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:05.185827 14521 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:07:05.190410 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:05.192828 14350 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.202625 14492 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:05.208194 14512 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:05.209959 12728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 555) took 2797 ms (client timeout 1918 ms). Trace:
W20260709 13:07:05.270921 12728 rpcz_store.cc:269] 0709 13:07:02.413066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.419761 (+  6695us) service_pool.cc:224] Handling call
0709 13:07:05.209719 (+2789958us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54002d50d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:05.209846 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4839420672}
I20260709 13:07:05.214663 14151 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.196899 14443 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.250802 12882 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:05.256888 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:05.363591 12880 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:05.365046 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:05.365955 12880 raft_consensus.cc:2368] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:05.366897 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:05.367573 12880 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.080732 12803 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:05.264217 13516 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:05.065207 14348 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.370780 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:05.145207 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:05.351087 12873 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:05.266448 14193 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.112416 14486 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.404023 14193 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:05.376255 12881 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:05.298717 14443 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.385911 12771 leader_election.cc:400] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:05.266251 14492 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:05.319291 14511 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:05.483580 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.564796 12800 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:05.621388 14311 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.621985 12771 leader_election.cc:403] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.497063 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:05.626896 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 241143us
W20260709 13:07:05.561949 12845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.008s	sys 0.007s
W20260709 13:07:05.627542 12845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.010s	sys 0.008s
W20260709 13:07:05.518887 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.009s
W20260709 13:07:05.628898 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.005s	sys 0.014s
I20260709 13:07:05.630436 14524 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:05.527961 12724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.009s	sys 0.005s
I20260709 13:07:05.626322 14382 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:05.403208 14151 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:05.627704 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:05.557092 12730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.010s
W20260709 13:07:05.573437 12696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.005s	sys 0.011s
I20260709 13:07:05.384801 14483 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.572597 14240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.010s
I20260709 13:07:05.635521 12880 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:05.397806 14469 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:05.664338 12696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.011s
I20260709 13:07:05.668962 12880 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:07:05.643136 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.619553 14424 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.002s
W20260709 13:07:05.582607 14360 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
W20260709 13:07:05.643976 12724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.007s
I20260709 13:07:05.502187 12876 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:05.674134 12876 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:05.677021 14360 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.678336 14486 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.658049 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.688835 12728 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:05.646895 12731 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.664834 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:05.666800 12730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.006s	sys 0.011s
I20260709 13:07:05.666940 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.411599 14452 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.667102 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:05.669546 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:05.669673 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 850459us
I20260709 13:07:05.701154 12729 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:05.701854 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:05.704312 12732 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:05.670040 14151 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:05.713726 14151 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:05.476127 14254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.057s	sys 0.085s
I20260709 13:07:05.690201 12880 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:05.653230 14479 consensus_meta.cc:287] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.124s	user 0.012s	sys 0.001s
I20260709 13:07:05.725163 13516 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 4 LEARNER]: Advancing to term 5
I20260709 13:07:05.727411 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:05.651486 14491 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.000s
I20260709 13:07:05.728628 14479 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.730726 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.732339 14479 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:05.733248 14254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.086s	sys 0.101s
I20260709 13:07:05.735011 14254 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:05.737378 13514 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:05.737048 14254 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:05.668087 14240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.013s
I20260709 13:07:05.753723 12876 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.645401 14505 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.646191 14514 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.644588 14475 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:05.642623 14512 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.744376 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:05.643661 14390 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.746044 12731 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:05.746600 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:05.668591 14508 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.942s	user 0.004s	sys 0.010s
I20260709 13:07:05.681135 14382 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.782686 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.637215 14311 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.763484 12728 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:05.754318 14387 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.679893 14360 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.779703 12733 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.781723 14486 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.743916 14469 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:05.763550 14338 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.006s
I20260709 13:07:05.650750 14524 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:05.800290 14338 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.786355 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:05.801113 14524 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.804486 12874 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:05.768128 14277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.018s	sys 0.013s
I20260709 13:07:05.771159 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.700278 14470 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.809279 14516 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.921s	user 0.002s	sys 0.011s
I20260709 13:07:05.811517 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1346) took 1221 ms. Trace:
I20260709 13:07:05.812078 12877 rpcz_store.cc:276] 0709 13:07:04.590555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.624202 (+ 33647us) service_pool.cc:224] Handling call
0709 13:07:04.643308 (+ 19106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.643657 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.643685 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.644181 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.703067 (+ 58886us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.775154 (+ 72087us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.786307 (+ 11153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.786383 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.808547 (+1022164us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:05.810838 (+  2291us) raft_consensus.cc:1685] finished
0709 13:07:05.810971 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.811432 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2373,"prepare.queue_time_us":72134,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":7422,"raft.queue_time_us":19274,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":29733,"spinlock_wait_cycles":19897344,"thread_start_us":58452,"threads_started":1,"wal-append.queue_time_us":146589}
I20260709 13:07:05.820480 12877 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:05.821666 14387 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:05.784214 14508 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.821708 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1593) took 1025 ms. Trace:
I20260709 13:07:05.826457 14508 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.826710 12877 rpcz_store.cc:276] 0709 13:07:04.796342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.815356 (+1019014us) service_pool.cc:224] Handling call
0709 13:07:05.815835 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.821098 (+  5263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.821626 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.792462 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:05.681031 14483 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.830744 14469 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:05.680617 14424 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.781527 14390 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.778645 14514 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.834291 14390 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.786023 14254 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:05.834640 14424 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.834545 14514 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.782635 14475 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:05.837590 12725 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.838650 12727 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:05.838832 14475 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:05.788504 14382 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:05.767026 14505 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:05.844358 14277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.019s	sys 0.013s
W20260709 13:07:05.792397 14525 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:05.847422 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 570) took 1106 ms. Trace:
I20260709 13:07:05.755064 14452 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.779352 14512 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.784746 14492 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.849937 12733 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:05.864972 12731 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:05.985948 14538 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:05.798898 14486 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:05.963485 12806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.013s	sys 0.017s
W20260709 13:07:06.037999 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.071200 12732 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
W20260709 13:07:06.098030 12806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.020s	sys 0.036s
I20260709 13:07:06.099758 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.038694 14499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.013s
W20260709 13:07:06.101078 14499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.015s
I20260709 13:07:06.098884 12803 rpcz_store.cc:276] 0709 13:07:04.740760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.752715 (+ 11955us) service_pool.cc:224] Handling call
0709 13:07:05.847243 (+1094528us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001b5154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:05.847359 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501639424}
I20260709 13:07:06.097905 14538 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.097982 14486 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.803788 14338 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.099963 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.011134 14502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.001s	sys 0.022s
I20260709 13:07:06.101001 12732 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:06.182430 12733 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:06.037495 12799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.007s	sys 0.011s
W20260709 13:07:06.043704 13486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.013s	sys 0.008s
I20260709 13:07:06.204967 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.231599 12731 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:06.231666 12728 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:07:05.958487 14471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.002s	sys 0.024s
I20260709 13:07:06.093538 14511 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:05.860430 14424 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.904924 13516 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 5 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:06.241742 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:05.927362 14193 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:07:06.101879 14505 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:06.244473 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.226544 12799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.011s	sys 0.015s
W20260709 13:07:06.230661 13486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.014s	sys 0.009s
W20260709 13:07:06.235919 14450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.009s	sys 0.030s
I20260709 13:07:06.257198 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.232719 14502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.003s	sys 0.029s
W20260709 13:07:06.206948 14476 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.013s	sys 0.023s
I20260709 13:07:06.259577 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.262543 12732 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:05.847981 14469 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:06.324304 13487 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.906s (SENT) [suppressed 16 similar messages]
I20260709 13:07:05.809331 14470 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:06.246019 14471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.004s	sys 0.026s
I20260709 13:07:06.368165 12731 raft_consensus.cc:2376] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4. Re-sending same reply.
I20260709 13:07:05.844003 14382 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:05.860931 14510 consensus_queue.cc:1059] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.391s
I20260709 13:07:06.325798 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.400197 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.400851 12733 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:06.400988 12731 raft_consensus.cc:2376] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2. Re-sending same reply.
I20260709 13:07:06.402280 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.381690 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 99) took 1386 ms. Trace:
I20260709 13:07:06.384541 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.405272 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.406013 12732 raft_consensus.cc:2376] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3. Re-sending same reply.
I20260709 13:07:06.403529 12730 rpcz_store.cc:276] 0709 13:07:04.995061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.995456 (+   395us) service_pool.cc:224] Handling call
0709 13:07:04.995852 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.018586 (+ 22734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.018633 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.026985 (+  8352us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.690670 (+663685us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.690736 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.690861 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.381444 (+690583us) raft_consensus.cc:1685] finished
0709 13:07:06.381466 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.381622 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":711,"raft.queue_time_us":79425,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":1791,"thread_start_us":637299,"threads_started":1,"wal-append.queue_time_us":1331834}
I20260709 13:07:06.410636 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.411371 12730 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.366494 12847 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.033s	sys 0.062s
W20260709 13:07:06.412869 12847 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.033s	sys 0.063s
W20260709 13:07:06.413311 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 789717us
W20260709 13:07:06.396782 14534 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
W20260709 13:07:06.289145 14450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.010s	sys 0.030s
W20260709 13:07:06.371990 14476 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.013s	sys 0.024s
W20260709 13:07:06.266528 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 1.13172e+06us
I20260709 13:07:06.415144 12731 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:06.440774 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.407600 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.442952 12732 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:07:06.444362 12882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.007s	sys 0.033s
W20260709 13:07:06.444828 12882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.007s	sys 0.033s
I20260709 13:07:06.258512 14424 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.420317 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1584) took 1639 ms. Trace:
I20260709 13:07:06.448751 12880 rpcz_store.cc:276] 0709 13:07:04.781087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.670600 (+889513us) service_pool.cc:224] Handling call
0709 13:07:05.690007 (+ 19407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.724908 (+ 34901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.419967 (+695059us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54004204d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:06.420224 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43927296}
I20260709 13:07:06.452955 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.454339 12732 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:06.393502 14193 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.456141 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.459332 12733 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.456900 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:06.436097 14348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.021s	sys 0.055s
W20260709 13:07:06.458142 14350 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.170s	user 0.013s	sys 0.001s
W20260709 13:07:06.460554 14443 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.823s	user 0.002s	sys 0.010s
I20260709 13:07:06.444564 14511 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.465734 14348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.021s	sys 0.055s
W20260709 13:07:06.458005 12847 leader_election.cc:336] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.529s (SENT)
I20260709 13:07:06.491438 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.471004 14350 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:06.427135 12724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.019s	sys 0.034s
W20260709 13:07:06.516579 12696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.013s	sys 0.051s
I20260709 13:07:06.461196 12731 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.473918 12845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.015s	sys 0.020s
W20260709 13:07:06.516881 12724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.019s	sys 0.034s
I20260709 13:07:06.472448 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.518788 12732 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:07:06.482151 14452 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:06.471247 13485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.072s	sys 0.126s
I20260709 13:07:06.507722 12873 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:06.518153 14490 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.494s	user 0.014s	sys 0.007s
I20260709 13:07:06.466111 14193 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:06.512286 14277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.025s
I20260709 13:07:06.540318 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.520504 12733 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:06.508296 14471 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:06.517809 12845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.015s	sys 0.020s
W20260709 13:07:06.495208 12773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.031s	sys 0.031s
W20260709 13:07:06.548509 12773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.032s	sys 0.031s
W20260709 13:07:06.549955 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.490355 14443 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:06.519532 12696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.013s	sys 0.051s
I20260709 13:07:06.520265 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1312) took 1804 ms. Trace:
W20260709 13:07:06.522624 12876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.025s	sys 0.038s
W20260709 13:07:06.540141 14277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.010s	sys 0.025s
I20260709 13:07:06.494925 14511 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.536966 14505 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.541457 12732 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:06.521587 13484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.014s	sys 0.055s
W20260709 13:07:06.546352 12877 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.012s	sys 0.037s
I20260709 13:07:06.543586 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.535619 13485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.072s	sys 0.126s
W20260709 13:07:06.490716 14524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.011s	sys 0.021s
W20260709 13:07:06.580667 14524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.011s	sys 0.021s
I20260709 13:07:06.529313 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:06.584470 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 55292.7us
W20260709 13:07:06.573328 12876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.026s	sys 0.038s
I20260709 13:07:06.573591 14452 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.573225 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 804965us
I20260709 13:07:06.573163 12724 rpcz_store.cc:276] 0709 13:07:04.763285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.774563 (+ 11278us) service_pool.cc:224] Handling call
0709 13:07:04.774892 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.775141 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:05.672560 (+897419us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.519797 (+847237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.519880 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.519936 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.520025 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.520195 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38617,"prepare.queue_time_us":539444,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":255,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":23563,"thread_start_us":1702367,"threads_started":2}
I20260709 13:07:06.588820 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:06.578584 12877 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.012s	sys 0.037s
W20260709 13:07:06.591656 14151 consensus_meta.cc:287] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.001s
I20260709 13:07:06.509950 12730 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:06.568353 14348 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.600587 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.586784 12733 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:06.592288 14554 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:06.593302 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.594461 14546 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:07:06.578543 13484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.014s	sys 0.055s
W20260709 13:07:06.603518 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.013s	sys 0.037s
I20260709 13:07:06.571517 14512 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:06.609898 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 285660us
I20260709 13:07:06.587852 14538 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.598251 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:06.611528 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.013s	sys 0.037s
I20260709 13:07:06.539459 14490 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.614707 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.617585 13520 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.618934 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:06.641350 13521 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 2 LEARNER]: Advancing to term 4
I20260709 13:07:06.619267 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.658876 12732 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:06.624974 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.661935 12733 raft_consensus.cc:2393] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:06.619858 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.599481 14452 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.646162 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.649667 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.652807 14271 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.651626 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:06.657935 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1354) took 1899 ms. Trace:
I20260709 13:07:06.678495 12873 rpcz_store.cc:276] 0709 13:07:04.758977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.394518 (+635541us) service_pool.cc:224] Handling call
0709 13:07:05.406312 (+ 11794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.535889 (+1129577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.657659 (+121770us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540043e9d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:06.657865 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507341696}
W20260709 13:07:06.658807 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65730.6us
I20260709 13:07:06.604941 14151 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.663175 14424 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:06.663611 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.661935 12732 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:06.647679 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.681998 14151 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:06.587590 14505 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.622231 14554 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.688426 14424 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:06.684824 12726 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:06.673112 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.602692 14314 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:07:06.713203 12728 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:06.716774 12726 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.702478 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.720358 12803 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.720546 12800 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.640326 14538 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.612401 14348 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.721900 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.735121 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.735850 12802 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:06.720566 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.624081 14512 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:07:06.722853 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.641836 14564 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.722915 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:06.721146 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:06.651780 12875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1581) took 2577 ms (client timeout 2043 ms). Trace:
I20260709 13:07:06.737347 12733 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:06.747751 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 106897us
I20260709 13:07:06.722477 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.748867 12803 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:06.660266 13520 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:06.667353 14539 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:06.743052 12807 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.711747 14357 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.718240 14303 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.677096 14499 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:06.677857 14271 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:06.753249 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:06.710156 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46511.7us
I20260709 13:07:06.761458 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:06.772753 12807 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:06.766196 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.728279 14450 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.773936 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.773949 12803 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:06.777499 12726 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:06.785739 14476 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:06.786523 14551 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:07:06.786864 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.738806 14382 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:06.787336 14193 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.788003 14193 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.788511 14542 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:07:06.789372 14559 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:06.789049 14193 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:06.786485 14476 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.790912 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1591) took 2001 ms. Trace:
I20260709 13:07:06.739099 14557 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.755795 14400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.801s	user 0.015s	sys 0.030s
I20260709 13:07:06.791172 14443 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:06.798441 14400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.843s	user 0.016s	sys 0.030s
I20260709 13:07:06.798851 14443 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:06.799264 14400 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.772538 14303 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:06.789450 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.799871 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.791957 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:06.804503 13519 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:06.801913 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:06.807958 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.810101 12847 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:06.811489 12847 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:06.800693 14476 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.764143 14357 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:06.818013 14357 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:06.818176 14558 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:06.763144 14350 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:06.819962 14556 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:06.753433 14424 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:07:06.821659 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1357) took 2061 ms. Trace:
I20260709 13:07:06.821787 14424 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.822224 14424 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:06.822067 12882 rpcz_store.cc:276] 0709 13:07:04.759815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.632623 (+872808us) service_pool.cc:224] Handling call
0709 13:07:05.644938 (+ 12315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.645358 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.645385 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.645834 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.445476 (+799642us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.727325 (+281849us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.737521 (+ 10196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.737604 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.821437 (+ 83833us) raft_consensus.cc:1685] finished
0709 13:07:06.821457 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.821601 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10460,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":8373,"thread_start_us":1036499,"threads_started":2,"wal-append.queue_time_us":870623}
I20260709 13:07:06.787745 14382 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.803280 14303 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.824060 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:06.786409 14452 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:06.800957 12876 rpcz_store.cc:276] 0709 13:07:04.788998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.754723 (+965725us) service_pool.cc:224] Handling call
0709 13:07:05.755361 (+   638us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:05.762037 (+  6676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.762070 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:05.782537 (+ 20467us) log.cc:844] Serialized 574 byte log entry
0709 13:07:06.586225 (+803688us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.586273 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.586388 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.790640 (+204252us) raft_consensus.cc:1685] finished
0709 13:07:06.790665 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.790840 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68029,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"thread_start_us":773767,"threads_started":1,"wal-append.queue_time_us":814856}
W20260709 13:07:06.825304 14547 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 13:07:06.826043 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:06.776378 14575 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.826752 12876 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.825321 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:06.827101 14575 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.828006 12882 raft_consensus.cc:2410] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:06.829896 12724 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:06.792258 14544 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:07:06.848856 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:06.849862 12803 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:06.850404 14561 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:06.852227 14501 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.852659 14501 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:06.853629 14501 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.805574 14314 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:06.799903 14400 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:06.776697 14499 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.874073 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.877396 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1363) took 1796 ms. Trace:
I20260709 13:07:06.888396 12880 rpcz_store.cc:276] 0709 13:07:05.081230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.450076 (+1368846us) service_pool.cc:224] Handling call
0709 13:07:06.450557 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.451211 (+   654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.451257 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.451875 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.717898 (+266023us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:06.717955 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.718671 (+   716us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.877030 (+158359us) raft_consensus.cc:1685] finished
0709 13:07:06.877061 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.877313 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4901,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4945,"thread_start_us":265525,"threads_started":1,"wal-append.queue_time_us":423136}
I20260709 13:07:06.891516 12880 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:06.893369 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 77) took 1634 ms. Trace:
I20260709 13:07:06.893941 12880 rpcz_store.cc:276] 0709 13:07:05.258912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.890700 (+1631788us) service_pool.cc:224] Handling call
0709 13:07:06.891132 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.893001 (+  1869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.893298 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.892292 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:06.895983 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:06.897641 12876 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:06.900329 14570 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.901319 14512 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.900997 14570 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.901845 14512 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.902401 14311 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:06.770895 14539 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.903954 14512 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:06.904449 14531 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.763s	user 0.012s	sys 0.000s
W20260709 13:07:06.747524 12875 rpcz_store.cc:269] 0709 13:07:04.074742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.121047 (+ 46305us) service_pool.cc:224] Handling call
0709 13:07:06.651523 (+2530476us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400220454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:06.651701 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997032704}
I20260709 13:07:06.907343 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.842724 14450 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.843844 14452 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.915063 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:06.917908 14450 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:06.847779 14338 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:06.874408 14555 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:06.924708 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 80) took 1493 ms. Trace:
I20260709 13:07:06.924654 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:06.880224 14486 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.002s
I20260709 13:07:06.925572 12876 rpcz_store.cc:276] 0709 13:07:05.407156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.898820 (+1491664us) service_pool.cc:224] Handling call
0709 13:07:06.899420 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.899701 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.899744 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.899811 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.899858 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.899939 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.900120 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.751792 14564 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.863160 14575 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.873319 14572 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.928789 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:06.938566 12807 raft_consensus.cc:2410] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:06.863809 14314 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:06.870754 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54668.9us
I20260709 13:07:06.878018 14382 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:06.907142 14570 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:06.949159 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:06.952714 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 255841us
I20260709 13:07:06.957599 12803 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:06.922348 14311 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.823094 14424 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:06.963971 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1595) took 2154 ms. Trace:
I20260709 13:07:06.925040 14511 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:06.920315 14452 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:06.968312 12877 rpcz_store.cc:276] 0709 13:07:04.810064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.846650 (+1036586us) service_pool.cc:224] Handling call
0709 13:07:05.894279 (+ 47629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.894549 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:06.589867 (+695318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.963601 (+373734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.963660 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.963701 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.963769 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.963911 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3045,"raft.queue_time_us":35304,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3881,"thread_start_us":1026629,"threads_started":3}
I20260709 13:07:06.974695 12728 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:06.948112 14314 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.981731 12728 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.957733 14476 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.981997 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.988392 12803 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:06.847055 13520 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.962003 14572 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:06.830238 14557 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:06.948982 14151 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:07:06.948148 14443 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:07:06.977052 14452 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:06.996332 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 148904us
I20260709 13:07:06.938732 14486 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.004860 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:06.935220 14584 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:07:07.010275 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.015972 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:06.991938 14424 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.016930 12726 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:06.977900 14512 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:07.020889 12803 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:07:07.022921 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:06.990993 12875 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.972846 14311 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.017482 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:06.991935 14490 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.012216 13520 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.030848 14575 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:07.039937 12728 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:07.022300 14193 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.047744 12728 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.977936 14400 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:07.048697 14569 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:07.060308 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.087623 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.036295 14554 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:07.126405 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 122764us
I20260709 13:07:07.037964 14564 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:07.165961 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 148527us
I20260709 13:07:07.102952 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1364) took 1898 ms. Trace:
I20260709 13:07:07.105332 12873 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:07.106127 12879 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:06.997411 14450 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.031030 14581 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:07.167168 12882 rpcz_store.cc:276] 0709 13:07:05.204070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.828803 (+1624733us) service_pool.cc:224] Handling call
0709 13:07:06.829129 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.829332 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:06.981732 (+152400us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.101835 (+120103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.102037 (+   202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:07.102124 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.102417 (+   293us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.102809 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7483,"prepare.queue_time_us":209944,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":86660,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":243392,"threads_started":3,"wal-append.queue_time_us":111622}
W20260709 13:07:07.101958 12881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1315) took 4404 ms (client timeout 1701 ms). Trace:
W20260709 13:07:07.171432 12881 rpcz_store.cc:269] 0709 13:07:02.697966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.766393 (+ 68427us) service_pool.cc:224] Handling call
0709 13:07:07.101700 (+4335307us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54002099d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:07.101846 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5257467264}
I20260709 13:07:07.173339 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.167670 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:07.084839 14193 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.189124 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.048736 14538 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:07:07.194761 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.163756 14318 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:07:07.047616 14575 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.096668 14577 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:07.184541 14565 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:07:07.270236 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 102704us
I20260709 13:07:07.292498 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:07.265765 14575 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.266067 14577 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.164186 14539 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.160513 14586 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.307688 14530 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:07.308473 14530 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.309871 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.311230 14530 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:07.314743 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.302215 14311 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:07.262348 14571 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:07.177802 14242 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.327122 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:07.184345 14584 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:07:07.304421 14577 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.332808 14539 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:07.057730 14572 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.334158 14561 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.315006 14586 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:07.335951 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.340943 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.348891 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:07.350149 14564 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.421705 14564 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.350023 14151 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.424417 14151 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.342483 14557 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.428941 12804 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:07.313097 14581 consensus_queue.cc:1243] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:07.361894 14486 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.304656 14423 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.367233 14348 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.245676 14382 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.381621 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.383641 13519 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:07.432771 12732 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:07.385282 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:07.388012 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:07.418648 12800 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:07.434710 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49547.8us
I20260709 13:07:07.437542 14564 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.437928 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.184995 14193 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.441510 14193 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.442816 14572 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.443392 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:07.444001 12882 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:07.444749 12882 pending_rounds.cc:85] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 1
I20260709 13:07:07.445046 12882 pending_rounds.cc:107] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:07.445204 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.445968 12875 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:07.447831 12875 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:07.449388 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:07.449976 14303 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.000s
I20260709 13:07:07.445349 12882 raft_consensus.cc:2889] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.450414 14303 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.451035 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:07.427762 14151 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.267683 14357 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.453433 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.453662 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:07.454227 14357 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:07.454609 12882 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:07.455583 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:07.456311 12873 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.457788 12800 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:07.459105 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.454555 12875 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.464303 14423 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.465035 14423 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.467651 14423 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.468540 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.469854 12881 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.470930 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.471702 12733 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:07.472929 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.474224 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:07.482806 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.430548 14586 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.484241 14586 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.419479 14311 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:07:07.469089 14538 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.469414 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.502578 12732 raft_consensus.cc:2368] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:07.503686 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.505046 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.506316 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.507498 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.359328 14271 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.509335 14271 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.508374 14538 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:07.511922 14538 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.537148 12733 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:07.523862 14311 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.545509 12882 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:07.540249 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.541126 12873 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:07.459844 12800 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:07.549252 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.544963 14311 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:07.522002 14452 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 13:07:07.576751 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.564838 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:07.583348 14254 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.583916 14254 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:07.584371 14254 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.588935 14452 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.591552 14151 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:07.596544 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.597350 12801 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:07.550467 14469 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.522202 14382 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.515653 14303 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:07.570235 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.388131 14582 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.620486 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:07.596632 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.549975 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.581344 14311 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.265246 14314 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:07.626477 12731 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:07.601691 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:07.603319 14348 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.603993 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:07.629981 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.632125 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:07.540431 14561 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:07.622076 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.621979 12732 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:07.624624 13521 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:07.633420 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.634228 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.604732 12800 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:07.635859 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.637389 12800 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.639235 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.641968 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.642719 12801 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:07.647552 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:07.638391 14459 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.652213 14303 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:07.652232 14424 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.005s
I20260709 13:07:07.652743 14303 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.653170 14303 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.653498 12726 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:07.626039 14510 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.654655 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.661417 12801 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:07.619877 14193 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:07:07.624913 14469 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.661954 14510 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.604205 14577 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:07.655593 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:07.636543 14561 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.664233 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.645977 14211 raft_consensus.cc:3055] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.670413 12732 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:07.654703 14311 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.653892 14240 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.678743 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.679289 12773 leader_election.cc:400] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
W20260709 13:07:07.669245 13520 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.000s
I20260709 13:07:07.680287 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.664580 14492 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.685289 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.682381 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:07.714573 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.670676 14424 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.716696 14577 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.671098 14211 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:07.722018 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:07.727401 14470 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:07.715678 12732 raft_consensus.cc:2376] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5. Re-sending same reply.
I20260709 13:07:07.677731 14572 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.679823 14151 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.680256 14240 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:07.683666 14360 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.677475 14448 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.731029 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.729817 14424 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:07.688130 12845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.043s	sys 0.090s
I20260709 13:07:07.737617 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:07.744226 12845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.046s	sys 0.092s
I20260709 13:07:07.747434 14265 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:07.745903 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.749248 12732 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:07.687219 12800 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:07.757480 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.732259 14151 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:07.733557 14577 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.738091 14240 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.737501 14360 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.742504 13520 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:07.754304 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:07.770007 14517 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 2.591s	user 0.005s	sys 0.029s
I20260709 13:07:07.771003 12845 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:07.771415 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 560) took 3176 ms. Trace:
I20260709 13:07:07.772279 14597 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.774837 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 573) took 2802 ms. Trace:
I20260709 13:07:07.736693 14448 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:07.769886 14530 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:07.767066 12732 raft_consensus.cc:2376] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5. Re-sending same reply.
W20260709 13:07:07.784626 12880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.015s
W20260709 13:07:07.785604 12771 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.057s	sys 0.089s
I20260709 13:07:07.775255 12806 rpcz_store.cc:276] 0709 13:07:04.972326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.972607 (+   281us) service_pool.cc:224] Handling call
0709 13:07:04.973272 (+   665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.067220 (+ 93948us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:05.067255 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.076027 (+  8772us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.099710 (+1023683us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:06.099755 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.774395 (+1674640us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b540028d054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:07.774448 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.774500 (+    52us) raft_consensus.cc:1685] finished
0709 13:07:07.774515 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.774765 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12672,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":18712,"spinlock_wait_cycles":215156480,"thread_start_us":1023287,"threads_started":1,"wal-append.queue_time_us":1466488}
I20260709 13:07:07.758690 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:07.842821 12771 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.058s	sys 0.090s
I20260709 13:07:07.771744 12805 rpcz_store.cc:276] 0709 13:07:04.594676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.597404 (+  2728us) service_pool.cc:224] Handling call
0709 13:07:04.597964 (+   560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.636847 (+ 38883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.636897 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.651003 (+ 14106us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.799960 (+148957us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:04.800076 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.802073 (+  1997us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.653011 (+2850938us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:07.771099 (+118088us) raft_consensus.cc:1685] finished
0709 13:07:07.771121 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.771331 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38083,"raft.queue_time_us":44983,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":163,"spinlock_wait_cycles":7991168,"thread_start_us":108543,"threads_started":1,"wal-append.queue_time_us":374922}
I20260709 13:07:07.763129 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:07.843400 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 899220us
I20260709 13:07:07.765846 13520 pending_rounds.cc:85] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Aborting all ops after (but not including) 5
I20260709 13:07:07.776734 12845 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:07.843513 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.736888 14572 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:07.848735 12877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.028s	sys 0.026s
W20260709 13:07:07.847630 12880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.015s
W20260709 13:07:07.871120 12877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.028s	sys 0.026s
I20260709 13:07:07.851187 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.871755 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 79) took 2501 ms. Trace:
I20260709 13:07:07.871853 12732 raft_consensus.cc:2376] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5. Re-sending same reply.
I20260709 13:07:07.873451 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.874697 12732 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:07.872591 12880 rpcz_store.cc:276] 0709 13:07:05.370469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.895074 (+1524605us) service_pool.cc:224] Handling call
0709 13:07:06.895478 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.895741 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.056123 (+160382us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.871341 (+815218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.871415 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.871470 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.871547 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.871692 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3049,"prepare.queue_time_us":160970,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":53385,"raft.queue_time_us":141977,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":3218,"thread_start_us":950219,"threads_started":3,"wal-append.queue_time_us":449678}
I20260709 13:07:07.875495 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.876660 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.856513 12876 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:07.865535 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.866103 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:07.867133 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 94554.4us
I20260709 13:07:07.766003 14360 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.881156 12805 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:07.884864 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.885525 12806 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.886833 12732 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:07.887274 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.888439 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:07.889886 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.890411 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.891325 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1581) took 1098 ms. Trace:
I20260709 13:07:07.891677 12805 rpcz_store.cc:276] 0709 13:07:06.793432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.890115 (+1096683us) service_pool.cc:224] Handling call
0709 13:07:07.891262 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.777058 14587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.018s
I20260709 13:07:07.892843 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.893401 12805 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.889887 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.890682 12882 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:07.900488 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.901331 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.902359 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:07.905385 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1592) took 1033 ms. Trace:
I20260709 13:07:07.865896 13520 pending_rounds.cc:107] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:07.792099 14382 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.794131 12875 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:07.906190 12801 rpcz_store.cc:276] 0709 13:07:06.872480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.889609 (+1017129us) service_pool.cc:224] Handling call
0709 13:07:07.905264 (+ 15655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.926797 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:07.897632 14587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.002s	sys 0.019s
I20260709 13:07:07.930222 12806 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:07.930439 12805 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:07.891444 14314 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.937526 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1579) took 1164 ms. Trace:
I20260709 13:07:07.937983 12805 rpcz_store.cc:276] 0709 13:07:06.773041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.892609 (+1119568us) service_pool.cc:224] Handling call
0709 13:07:07.937431 (+ 44822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.938320 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:07.938982 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.940470 12806 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.940737 12805 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:07.944334 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.945511 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1564) took 1223 ms. Trace:
I20260709 13:07:07.945981 12805 rpcz_store.cc:276] 0709 13:07:06.722477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.943938 (+1221461us) service_pool.cc:224] Handling call
0709 13:07:07.945437 (+  1499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.950170 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.918278 13520 raft_consensus.cc:2889] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.951676 12801 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:07.917317 14584 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.952905 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:07.849608 14530 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.957527 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.959216 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1591) took 1094 ms. Trace:
I20260709 13:07:07.959703 12801 rpcz_store.cc:276] 0709 13:07:06.864792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.927622 (+1062830us) service_pool.cc:224] Handling call
0709 13:07:07.959103 (+ 31481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.959195 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1575) took 1224 ms. Trace:
I20260709 13:07:07.963824 12801 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.906685 14357 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:07.965386 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1568) took 1241 ms. Trace:
I20260709 13:07:07.946633 14505 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:07.965981 12805 rpcz_store.cc:276] 0709 13:07:06.735277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.952606 (+1217329us) service_pool.cc:224] Handling call
0709 13:07:07.959103 (+  6497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.968099 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.977526 12801 rpcz_store.cc:276] 0709 13:07:06.724367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.963144 (+1238777us) service_pool.cc:224] Handling call
0709 13:07:07.963574 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.965055 (+  1481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.965322 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.982789 12801 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:07.988687 12880 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:07.896211 14151 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.908072 14600 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.983952 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:07.979456 12805 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:07.965569 14450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.010s	sys 0.011s
I20260709 13:07:07.926368 14448 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.959894 14584 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:07.987947 14501 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.990386 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 99) took 1370 ms. Trace:
W20260709 13:07:08.050740 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.042608 12880 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:07:07.997220 14450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.012s
I20260709 13:07:07.999806 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.013375 12882 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.987326 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:07.996407 14469 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.083877 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:08.095732 13521 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:07.987442 12801 pending_rounds.cc:85] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 5
I20260709 13:07:08.096374 12801 pending_rounds.cc:107] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 13:07:08.080228 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.089850 12802 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.098697 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1572) took 1373 ms. Trace:
W20260709 13:07:08.094362 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.024s	sys 0.041s
I20260709 13:07:07.998086 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1569) took 1273 ms. Trace:
I20260709 13:07:08.099187 12802 rpcz_store.cc:276] 0709 13:07:06.725622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.088950 (+1363328us) service_pool.cc:224] Handling call
0709 13:07:08.089556 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.098326 (+  8770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.098630 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.101749 12727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 563) took 2435 ms (client timeout 2240 ms). Trace:
W20260709 13:07:08.100229 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.025s	sys 0.041s
I20260709 13:07:08.096611 12801 raft_consensus.cc:2889] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:08.102202 12727 rpcz_store.cc:269] 0709 13:07:05.666688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.666834 (+   146us) service_pool.cc:224] Handling call
0709 13:07:08.101553 (+2434719us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400063e54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.101679 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316912384}
I20260709 13:07:08.103905 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1571) took 1378 ms. Trace:
I20260709 13:07:08.104097 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:08.119997 12727 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:08.119983 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 391365us
I20260709 13:07:08.121255 12727 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:08.122854 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.107668 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:08.102170 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 182634us
W20260709 13:07:08.114163 12808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.020s	sys 0.016s
I20260709 13:07:08.053586 14600 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:08.101679 14348 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.097406 14505 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.137094 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:08.134495 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.137908 13521 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:08.138029 13487 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.040776 14424 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:08.119740 12801 rpcz_store.cc:276] 0709 13:07:06.725333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.981909 (+1256576us) service_pool.cc:224] Handling call
0709 13:07:07.982335 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.103520 (+121185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.103826 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.123759 12880 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.140532 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:08.141305 12880 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:08.109115 14400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.026s
W20260709 13:07:08.125144 12808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.020s	sys 0.016s
I20260709 13:07:08.126605 12802 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:08.127391 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 564) took 2459 ms. Trace:
I20260709 13:07:08.100320 12805 rpcz_store.cc:276] 0709 13:07:06.724671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.978844 (+1254173us) service_pool.cc:224] Handling call
0709 13:07:07.979198 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.996907 (+ 17709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.998015 (+  1108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.134249 12874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1589) took 3345 ms (client timeout 1568 ms). Trace:
I20260709 13:07:08.071080 13520 rpcz_store.cc:276] 0709 13:07:06.616931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.617072 (+   141us) service_pool.cc:224] Handling call
0709 13:07:06.617435 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.966402 (+1348967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.987653 (+ 21251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.136947 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:08.152707 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.162315 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.124890 14357 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.187156 14357 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.173231 14469 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.188506 14469 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.189255 14357 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:08.144337 12874 rpcz_store.cc:269] 0709 13:07:04.788425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.802952 (+ 14527us) service_pool.cc:224] Handling call
0709 13:07:08.134058 (+3331106us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54003b9554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.134180 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266030336}
W20260709 13:07:08.190135 14254 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.001s
W20260709 13:07:08.144547 14400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.008s	sys 0.026s
I20260709 13:07:08.143541 12725 rpcz_store.cc:276] 0709 13:07:05.668335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.668456 (+   121us) service_pool.cc:224] Handling call
0709 13:07:05.753513 (+ 85057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.838209 (+ 84696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.127177 (+2288968us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b540038e854. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:08.127338 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189258112}
I20260709 13:07:08.182983 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1573) took 1457 ms. Trace:
I20260709 13:07:08.197212 12802 rpcz_store.cc:276] 0709 13:07:06.725931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.112629 (+1386698us) service_pool.cc:224] Handling call
0709 13:07:08.126366 (+ 13737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.143264 (+ 16898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.182911 (+ 39647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.139644 14265 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:08.184571 12882 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.180023 14382 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:08.143524 14505 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:07:08.185889 14526 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 2.583s	user 0.010s	sys 0.006s
I20260709 13:07:08.185968 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:08.186486 14311 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:07:08.142764 14348 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.190836 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.183552 14470 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.171825 14575 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:08.104128 12875 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:08.192759 12806 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
W20260709 13:07:08.114223 14363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.122s	sys 0.135s
I20260709 13:07:08.139529 14193 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:08.203745 12880 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:08.183974 14483 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:08.207243 12696 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.026s	sys 0.051s
I20260709 13:07:08.190480 14469 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.241743 12874 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
W20260709 13:07:08.255215 12696 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.029s	sys 0.054s
I20260709 13:07:08.257894 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:08.258496 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 629771us
I20260709 13:07:08.246759 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 107) took 1259 ms. Trace:
W20260709 13:07:08.207368 14538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.005s	sys 0.074s
I20260709 13:07:08.249647 12805 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:08.205051 14530 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.255988 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:08.259618 12806 rpcz_store.cc:276] 0709 13:07:06.987018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.938061 (+951043us) service_pool.cc:224] Handling call
0709 13:07:08.246695 (+308634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.265527 12880 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:08.266074 12806 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.266911 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1582) took 1467 ms. Trace:
I20260709 13:07:08.267279 12806 rpcz_store.cc:276] 0709 13:07:06.799240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.265516 (+1466276us) service_pool.cc:224] Handling call
0709 13:07:08.265841 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.266605 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.266843 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.199344 14600 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:08.251189 14363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.122s	sys 0.136s
I20260709 13:07:08.270920 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.271525 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.302671 12874 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:08.302987 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.263226 12802 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:08.303474 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:08.250459 14265 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.304215 12880 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.304378 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1577) took 1553 ms. Trace:
I20260709 13:07:08.305068 14505 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.306145 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1327) took 1112 ms. Trace:
I20260709 13:07:08.306339 12733 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:08.306588 12731 rpcz_store.cc:276] 0709 13:07:07.194149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.194424 (+   275us) service_pool.cc:224] Handling call
0709 13:07:08.305919 (+1111495us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400245254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.306082 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872371968}
I20260709 13:07:08.304852 12802 rpcz_store.cc:276] 0709 13:07:06.750813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.247264 (+1496451us) service_pool.cc:224] Handling call
0709 13:07:08.262996 (+ 15732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.303927 (+ 40931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.304324 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.308094 14561 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:07:08.250972 14572 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:08.261754 14538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.074s
I20260709 13:07:08.283198 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1351) took 3526 ms. Trace:
I20260709 13:07:08.245999 14586 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:08.287321 12882 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:07:08.288772 14604 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:08.261423 14424 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:08.294610 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.325032 12802 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:08.296288 14591 log.cc:927] Time spent T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 1.268s	user 0.006s	sys 0.006s
I20260709 13:07:08.281515 14582 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:08.300097 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:08.301018 14348 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.269973 14584 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.303649 12875 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:08.279122 12801 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:08.198904 14254 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.394094 14242 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.394466 12801 pending_rounds.cc:85] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:08.394665 14242 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:08.310911 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.395704 14597 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.623s	user 0.022s	sys 0.006s
I20260709 13:07:08.396184 14254 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:08.303658 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:08.396937 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1574) took 1664 ms. Trace:
I20260709 13:07:08.397187 12874 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.396201 14597 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.396996 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.400068 12875 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.320617 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:08.400941 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80415.8us
I20260709 13:07:08.320784 12878 rpcz_store.cc:276] 0709 13:07:04.756601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.756769 (+   168us) service_pool.cc:224] Handling call
0709 13:07:04.757151 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.757609 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.757649 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.786779 (+ 29130us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.068921 (+282142us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:05.068960 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.069033 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.099898 (+2030865us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4800240258. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:08.143756 (+1043858us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.282951 (+139195us) raft_consensus.cc:1685] finished
0709 13:07:08.282974 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.283133 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":942,"raft.run_cpu_time_us":12152,"raft.run_wall_time_us":2334731,"spinlock_wait_cycles":41225344,"thread_start_us":231863,"threads_started":1,"wal-append.queue_time_us":639902}
I20260709 13:07:08.323053 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:08.280503 14444 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.035s
W20260709 13:07:08.402863 14444 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.010s	sys 0.036s
I20260709 13:07:08.402897 12882 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:08.250689 14575 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:08.296609 14271 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.000s
I20260709 13:07:08.331411 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1584) took 1531 ms. Trace:
I20260709 13:07:08.335935 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.404440 12802 rpcz_store.cc:276] 0709 13:07:06.799822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.308337 (+1508515us) service_pool.cc:224] Handling call
0709 13:07:08.324826 (+ 16489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.326310 (+  1484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.331349 (+  5039us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.405047 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69192.7us
I20260709 13:07:08.405368 14475 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.405880 14475 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.406908 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.276358 14493 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:07:08.394783 12801 pending_rounds.cc:107] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:08.407707 12801 raft_consensus.cc:2889] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.408429 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1580) took 1631 ms. Trace:
I20260709 13:07:08.408759 12801 rpcz_store.cc:276] 0709 13:07:06.777010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.256715 (+1479705us) service_pool.cc:224] Handling call
0709 13:07:08.278772 (+ 22057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.408178 (+129406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.408367 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.397400 12805 rpcz_store.cc:276] 0709 13:07:06.732532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.144142 (+1411610us) service_pool.cc:224] Handling call
0709 13:07:08.183088 (+ 38946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.261949 (+ 78861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.396674 (+134725us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b540028d554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:08.396875 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152321280}
I20260709 13:07:08.410290 12801 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:08.316679 12880 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:08.401418 12875 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.403368 12878 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:07:08.302695 14303 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:07:08.395625 14242 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.411664 14303 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.410909 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 105) took 1435 ms. Trace:
I20260709 13:07:08.412325 14242 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.412578 12801 rpcz_store.cc:276] 0709 13:07:06.975435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.409649 (+1434214us) service_pool.cc:224] Handling call
0709 13:07:08.410052 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.410676 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.410863 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.413885 14303 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.406994 14254 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.410758 14530 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.407967 14475 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.410966 12805 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:08.414260 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 109) took 1410 ms. Trace:
I20260709 13:07:08.416373 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 106) took 1436 ms. Trace:
I20260709 13:07:08.418545 12805 rpcz_store.cc:276] 0709 13:07:06.979804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.410290 (+1430486us) service_pool.cc:224] Handling call
0709 13:07:08.410627 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.416086 (+  5459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.416285 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.416123 12801 rpcz_store.cc:276] 0709 13:07:07.003714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.413493 (+1409779us) service_pool.cc:224] Handling call
0709 13:07:08.413795 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.413968 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.413995 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.414038 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.414068 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.414118 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.414216 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.423134 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.425933 12876 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:08.339435 14538 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.462971 12874 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:08.322669 14561 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.327103 14572 consensus_queue.cc:1059] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:07:08.326900 14586 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.474987 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 578) took 1119 ms. Trace:
I20260709 13:07:08.340196 14582 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.331827 14424 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.339059 14360 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:08.420001 14587 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:08.471170 14475 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.479528 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 340261us
I20260709 13:07:08.480618 14597 raft_consensus.cc:2764] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:08.475622 12801 rpcz_store.cc:276] 0709 13:07:07.355534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.462520 (+1106986us) service_pool.cc:224] Handling call
0709 13:07:08.474052 (+ 11532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.474545 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.474587 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.474647 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.474691 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.474772 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.474917 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153}
I20260709 13:07:08.494266 14538 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:08.519215 14587 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:08.478142 14530 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:08.528723 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:08.527293 14240 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.006s
I20260709 13:07:08.527220 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 189) took 1909 ms. Trace:
I20260709 13:07:08.543113 13521 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.546481 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.547506 12876 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:08.536761 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:08.530732 14538 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.526546 14475 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.532341 14530 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.549721 14586 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:08.559196 14606 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:07:08.538286 14254 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:07:08.565332 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.543733 14265 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:07:08.559314 14492 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.833s	user 0.005s	sys 0.008s
W20260709 13:07:08.585952 14592 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 1.559s	user 0.001s	sys 0.015s
I20260709 13:07:08.586117 14502 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.586854 14502 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.587371 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 171) took 1686 ms. Trace:
I20260709 13:07:08.588516 14424 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:08.576617 14608 log.cc:927] Time spent T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:07:08.590741 14475 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:08.587920 13512 rpcz_store.cc:276] 0709 13:07:06.901047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.904607 (+  3560us) service_pool.cc:224] Handling call
0709 13:07:06.905032 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.905472 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.905510 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.906073 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.001997 (+ 95924us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.014616 (+ 12619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.024750 (+ 10134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.572731 (+1547981us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.586996 (+ 14265us) raft_consensus.cc:1685] finished
0709 13:07:08.587018 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.587302 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2091,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8430,"spinlock_wait_cycles":28514048,"thread_start_us":78551,"threads_started":1,"wal-append.queue_time_us":119972}
I20260709 13:07:08.593262 14499 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.543623 14240 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.595618 14151 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.597196 14240 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.599552 14360 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:07:08.601910 14452 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.546205 13516 rpcz_store.cc:276] 0709 13:07:06.616606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.616798 (+   192us) service_pool.cc:224] Handling call
0709 13:07:06.617303 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.677519 (+ 60216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.709569 (+ 32050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.804849 (+ 95280us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.972350 (+167501us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.972400 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.972489 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.295660 (+1323171us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.471284 (+175624us) raft_consensus.cc:1685] finished
0709 13:07:08.476121 (+  4837us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.526177 (+ 50056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25439,"raft.queue_time_us":51093,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":40969,"spinlock_wait_cycles":23739648,"thread_start_us":61546,"threads_started":1,"wal-append.queue_time_us":184912}
I20260709 13:07:08.572162 14587 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.549736 14211 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.606346 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.606421 14303 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:08.607354 14211 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.581301 14582 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.580091 14538 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.608593 14271 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:08.609660 14271 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.580526 14610 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:08.610342 14271 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:08.610702 14271 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:08.578956 14543 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 2.038s	user 0.010s	sys 0.010s
I20260709 13:07:08.578460 14530 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.617296 14510 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.620883 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.611557 14271 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.622581 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:08.623612 14265 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.625286 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.623107 14271 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.628698 14265 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.629269 14265 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:08.629727 14265 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.630038 14575 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:08.627784 14502 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.631956 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:08.636751 14603 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.443s	user 0.005s	sys 0.000s
I20260709 13:07:08.639024 14493 raft_consensus.cc:3055] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.639472 14493 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:08.640213 13513 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:08.640805 14486 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.641390 14486 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.644368 14486 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.644948 14493 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.651779 14448 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.654160 14561 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.648917 14265 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.658485 14587 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:08.658697 14607 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.238s	user 0.003s	sys 0.000s
I20260709 13:07:08.659490 14265 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:08.492986 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.706099 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 439925us
W20260709 13:07:08.707718 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.708845 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.715296 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1350) took 1130 ms. Trace:
I20260709 13:07:08.717746 12728 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:08.717780 12729 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:08.495476 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 356478us
I20260709 13:07:08.724025 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.724911 12801 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:08.725211 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 572) took 3841 ms. Trace:
I20260709 13:07:08.726198 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 579) took 1370 ms. Trace:
I20260709 13:07:08.726888 12801 rpcz_store.cc:276] 0709 13:07:07.356163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.531945 (+1175782us) service_pool.cc:224] Handling call
0709 13:07:08.723899 (+191954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.725773 (+  1874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.726086 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.718053 12725 rpcz_store.cc:276] 0709 13:07:07.584991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.196927 (+611936us) service_pool.cc:224] Handling call
0709 13:07:08.215479 (+ 18552us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.215867 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.215893 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.226379 (+ 10486us) log.cc:844] Serialized 52 byte log entry
0709 13:07:08.712523 (+486144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.713645 (+  1122us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.714250 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.714490 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.714563 (+    73us) raft_consensus.cc:1685] finished
0709 13:07:08.714615 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.715004 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":31690,"thread_start_us":431186,"threads_started":1,"wal-append.queue_time_us":314474}
I20260709 13:07:08.728478 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.735445 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 611) took 1112 ms. Trace:
I20260709 13:07:08.729952 12801 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:08.543193 12803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 104) took 1575 ms (client timeout 1906 ms). Trace:
I20260709 13:07:08.735976 12731 rpcz_store.cc:276] 0709 13:07:07.622924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.307482 (+684558us) service_pool.cc:224] Handling call
0709 13:07:08.307798 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.712512 (+404714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.712586 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.714147 (+  1561us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.734071 (+ 19924us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.734434 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.734744 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.734910 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.734981 (+    71us) raft_consensus.cc:1685] finished
0709 13:07:08.734996 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.735233 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109067,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":422829,"threads_started":2,"wal-append.queue_time_us":16505}
W20260709 13:07:08.736886 12803 rpcz_store.cc:269] 0709 13:07:06.967741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.989191 (+ 21450us) service_pool.cc:224] Handling call
0709 13:07:08.543015 (+1553824us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54001761d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.543134 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34812672}
I20260709 13:07:08.738417 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1583) took 1938 ms. Trace:
I20260709 13:07:08.739008 12806 rpcz_store.cc:276] 0709 13:07:06.799557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.272847 (+1473290us) service_pool.cc:224] Handling call
0709 13:07:08.277157 (+  4310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.277446 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:08.511832 (+234386us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.737331 (+225499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.737467 (+   136us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.737651 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.737797 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.738083 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":248772,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1695,"thread_start_us":452111,"threads_started":2,"wal-append.queue_time_us":76324}
I20260709 13:07:08.740662 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 581) took 1383 ms. Trace:
I20260709 13:07:08.741132 12803 rpcz_store.cc:276] 0709 13:07:07.357214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.738641 (+1381427us) service_pool.cc:224] Handling call
0709 13:07:08.739346 (+   705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.739929 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.739967 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.740238 (+   271us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.740338 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.740413 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.740576 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.741847 12724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 606) took 2162 ms (client timeout 1964 ms). Trace:
W20260709 13:07:08.742564 12724 rpcz_store.cc:269] 0709 13:07:06.580063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.588482 (+  8419us) service_pool.cc:224] Handling call
0709 13:07:08.741319 (+2152837us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400430dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.741544 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552658304}
I20260709 13:07:08.743183 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 582) took 1385 ms. Trace:
I20260709 13:07:08.743552 12803 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:08.743621 12806 rpcz_store.cc:276] 0709 13:07:07.357889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.741249 (+1383360us) service_pool.cc:224] Handling call
0709 13:07:08.741813 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.742684 (+   871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.742713 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.742853 (+   140us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:08.742881 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.742960 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.743089 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.744376 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 583) took 1386 ms. Trace:
I20260709 13:07:08.744822 12803 rpcz_store.cc:276] 0709 13:07:07.358409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.742431 (+1384022us) service_pool.cc:224] Handling call
0709 13:07:08.742986 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.744028 (+  1042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.744307 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.769172 14211 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.768095 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:08.729851 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:08.789690 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 580) took 1432 ms. Trace:
I20260709 13:07:08.731303 12802 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.792003 12801 rpcz_store.cc:276] 0709 13:07:07.356724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.728501 (+1371777us) service_pool.cc:224] Handling call
0709 13:07:08.729310 (+   809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.788172 (+ 58862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.788507 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.748852 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1320) took 1726 ms (client timeout 1531 ms). Trace:
I20260709 13:07:08.756217 14151 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.747670 12806 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:08.791024 14211 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.845275 12730 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:08.734120 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:08.794852 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.825075 12733 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:08.791024 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:08.825960 12724 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.746867 12803 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.797865 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 588) took 1432 ms. Trace:
I20260709 13:07:08.822597 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1589) took 1984 ms. Trace:
I20260709 13:07:08.747941 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 564) took 4151 ms. Trace:
I20260709 13:07:08.817504 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1348) took 1232 ms. Trace:
I20260709 13:07:08.883832 12806 rpcz_store.cc:276] 0709 13:07:07.366172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.744958 (+1378786us) service_pool.cc:224] Handling call
0709 13:07:08.745603 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.794169 (+ 48566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.797775 (+  3606us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.844247 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.795187 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.751957 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1601) took 2235 ms. Trace:
I20260709 13:07:08.804714 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1594) took 1779 ms. Trace:
I20260709 13:07:08.754025 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1338) took 4180 ms. Trace:
I20260709 13:07:08.806664 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:08.752590 12874 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:08.774717 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 615) took 1150 ms. Trace:
I20260709 13:07:08.890683 12731 rpcz_store.cc:276] 0709 13:07:07.628883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.738232 (+1109349us) service_pool.cc:224] Handling call
0709 13:07:08.739061 (+   829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.739705 (+   644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.739732 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.739811 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:08.739901 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.739989 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.774631 (+ 34642us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29224,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122}
W20260709 13:07:08.793562 12726 rpcz_store.cc:269] 0709 13:07:07.022326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.022589 (+   263us) service_pool.cc:224] Handling call
0709 13:07:08.748172 (+1725583us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540040f954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.748556 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447591296}
I20260709 13:07:08.892089 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 105) took 1252 ms. Trace:
W20260709 13:07:08.824370 12728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1326) took 1639 ms (client timeout 1951 ms). Trace:
I20260709 13:07:08.813282 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:08.887279 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 157735us
I20260709 13:07:08.826553 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.893186 12724 rpcz_store.cc:276] 0709 13:07:07.634190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.743838 (+1109648us) service_pool.cc:224] Handling call
0709 13:07:08.825591 (+ 81753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.885824 (+ 60233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.886071 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.896687 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.887336 12729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 568) took 3161 ms (client timeout 1779 ms). Trace:
I20260709 13:07:08.895246 12873 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:08.883984 12802 rpcz_store.cc:276] 0709 13:07:06.837864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.405643 (+1567779us) service_pool.cc:224] Handling call
0709 13:07:08.730688 (+325045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.792542 (+ 61854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.822232 (+ 29690us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54001761d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.822500 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746164480}
I20260709 13:07:08.799510 14311 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.893515 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1602) took 1131 ms. Trace:
I20260709 13:07:08.888118 12804 rpcz_store.cc:276] 0709 13:07:07.024822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.340539 (+315717us) service_pool.cc:224] Handling call
0709 13:07:08.804220 (+1463681us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54001a2a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.804467 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24470912}
I20260709 13:07:08.895102 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 577) took 1540 ms. Trace:
I20260709 13:07:08.900802 12803 rpcz_store.cc:276] 0709 13:07:07.761742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.745764 (+984022us) service_pool.cc:224] Handling call
0709 13:07:08.746271 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.888585 (+142314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.893454 (+  4869us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.900223 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 109607us
W20260709 13:07:08.893373 12728 rpcz_store.cc:269] 0709 13:07:07.185366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.188731 (+  3365us) service_pool.cc:224] Handling call
0709 13:07:08.823955 (+1635224us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540040d654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.824276 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3510115584}
I20260709 13:07:08.888615 12879 rpcz_store.cc:276] 0709 13:07:04.573470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.573602 (+   132us) service_pool.cc:224] Handling call
0709 13:07:07.105736 (+2532134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.167528 (+ 61792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.753327 (+1585799us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b54002099d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.753697 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5781228928}
W20260709 13:07:08.897853 12729 rpcz_store.cc:269] 0709 13:07:05.726404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.730439 (+  4035us) service_pool.cc:224] Handling call
0709 13:07:08.844178 (+3113739us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b5400029754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.887245 (+ 43067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6864481152}
I20260709 13:07:08.906183 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1380) took 1052 ms. Trace:
W20260709 13:07:08.762395 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 137055us
I20260709 13:07:08.797360 14459 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.766546 13513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 185) took 3983 ms (client timeout 1604 ms). Trace:
I20260709 13:07:08.910606 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:08.907804 12873 rpcz_store.cc:276] 0709 13:07:07.845759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.847670 (+  1911us) service_pool.cc:224] Handling call
0709 13:07:08.812763 (+965093us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:08.898299 (+ 85536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9671424}
I20260709 13:07:08.887725 14572 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.795611 14469 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.820124 14493 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.884490 12727 rpcz_store.cc:276] 0709 13:07:07.584439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.122146 (+537707us) service_pool.cc:224] Handling call
0709 13:07:08.122428 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.122765 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.122794 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.128353 (+  5559us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.503314 (+374961us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.788455 (+285141us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.816721 (+ 28266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.816851 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.816967 (+   116us) raft_consensus.cc:1685] finished
0709 13:07:08.816986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.817279 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27521,"prepare.queue_time_us":46678,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":38457,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":15736,"thread_start_us":595945,"threads_started":2,"wal-append.queue_time_us":448914}
I20260709 13:07:08.908694 14151 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.920348 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:08.924876 14363 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.930016 14363 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:08.930802 14265 raft_consensus.cc:670] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } [suppressed 1 similar messages]
I20260709 13:07:08.931124 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1349) took 1346 ms. Trace:
I20260709 13:07:08.887450 14580 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:08.932251 14151 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:08.932690 14580 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.934374 14151 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.925671 14572 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:08.925971 14211 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.902338 12805 rpcz_store.cc:276] 0709 13:07:07.354823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.419479 (+1064656us) service_pool.cc:224] Handling call
0709 13:07:08.419815 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.420024 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:08.522495 (+102471us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.894218 (+371723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.894331 (+   113us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.894489 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.894622 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.894881 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4638,"prepare.queue_time_us":122114,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2347,"raft.queue_time_us":800,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":191,"thread_start_us":430924,"threads_started":2}
I20260709 13:07:08.929071 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1379) took 1083 ms. Trace:
W20260709 13:07:08.913165 13513 rpcz_store.cc:269] 0709 13:07:04.782963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.786214 (+  3251us) service_pool.cc:224] Handling call
0709 13:07:07.348673 (+2562459us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:08.765881 (+1417208us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400339ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.766173 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328227456}
I20260709 13:07:08.935966 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.942669 12881 rpcz_store.cc:276] 0709 13:07:07.845352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.876841 (+ 31489us) service_pool.cc:224] Handling call
0709 13:07:08.806175 (+929334us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:08.928996 (+122821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23683968}
I20260709 13:07:08.885254 12808 rpcz_store.cc:276] 0709 13:07:04.596217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.603256 (+  7039us) service_pool.cc:224] Handling call
0709 13:07:04.603695 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.634210 (+ 30515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.634256 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.311793 (+2677537us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b2c000354a8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:07.312429 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.142884 (+830455us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.142921 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.143019 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.657905 (+514886us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.747111 (+ 89206us) raft_consensus.cc:1685] finished
0709 13:07:08.747173 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.747659 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21285,"raft.queue_time_us":30103,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":25224,"spinlock_wait_cycles":14906880,"thread_start_us":829997,"threads_started":1,"wal-append.queue_time_us":964074}
I20260709 13:07:08.953547 14572 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.954530 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:08.955715 14510 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:08.955987 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:08.958851 12805 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.959631 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.960225 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.960824 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.961571 14510 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.962543 14510 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.963954 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:08.957636 14470 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:07:08.964130 14561 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.965566 14561 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:08.725894 12799 rpcz_store.cc:276] 0709 13:07:04.883689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.888302 (+  4613us) service_pool.cc:224] Handling call
0709 13:07:05.025843 (+137541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.066205 (+ 40362us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:05.066241 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.066786 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.364776 (+1297990us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:06.367286 (+  2510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.392097 (+ 24811us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.550321 (+2158224us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.724467 (+174146us) raft_consensus.cc:1685] finished
0709 13:07:08.724512 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.724962 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9777536,"thread_start_us":1175005,"threads_started":1,"wal-append.queue_time_us":1420387}
I20260709 13:07:08.967911 14363 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:08.965469 12729 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:08.947739 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 126702us
I20260709 13:07:08.969677 14561 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.772851 14193 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.176s
I20260709 13:07:08.973548 12731 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:08.973658 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:08.976142 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.977543 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 106) took 1343 ms. Trace:
I20260709 13:07:08.978036 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.976331 12729 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:08.979841 14530 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.980674 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.980487 14311 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:08.981773 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.982920 13513 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:08.983433 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1353) took 1397 ms. Trace:
I20260709 13:07:08.887072 12877 rpcz_store.cc:276] 0709 13:07:06.517560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.985962 (+468402us) service_pool.cc:224] Handling call
0709 13:07:06.996695 (+ 10733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.009448 (+ 12753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.009480 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.016931 (+  7451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.871628 (+854697us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:07.871669 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.871769 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.635929 (+764160us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:08.750981 (+115052us) raft_consensus.cc:1685] finished
0709 13:07:08.751038 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.751589 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35432,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6424,"spinlock_wait_cycles":3929472,"thread_start_us":822569,"threads_started":1,"wal-append.queue_time_us":1072032}
I20260709 13:07:08.931653 12732 rpcz_store.cc:276] 0709 13:07:07.584716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.131865 (+547149us) service_pool.cc:224] Handling call
0709 13:07:08.172112 (+ 40247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.172378 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:08.494892 (+322514us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.930213 (+435321us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.930494 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.930570 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:08.930649 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.930728 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.930957 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":356767,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1134,"raft.queue_time_us":5294,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":350,"thread_start_us":715346,"threads_started":2,"wal-append.queue_time_us":427492}
I20260709 13:07:08.979454 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:09.028302 12808 raft_consensus.cc:2376] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4. Re-sending same reply.
I20260709 13:07:09.029758 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:08.998129 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:08.946910 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:08.998026 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 43809.1us
I20260709 13:07:08.978082 12731 rpcz_store.cc:276] 0709 13:07:07.634428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.897208 (+1262780us) service_pool.cc:224] Handling call
0709 13:07:08.945422 (+ 48214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.974341 (+ 28919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.977428 (+  3087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.989048 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 597) took 2593 ms. Trace:
I20260709 13:07:08.993330 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.031899 12801 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:08.984125 12807 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
W20260709 13:07:08.992533 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.025306 12733 rpcz_store.cc:276] 0709 13:07:07.585815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.307199 (+721384us) service_pool.cc:224] Handling call
0709 13:07:08.824352 (+517153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.882017 (+ 57665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.983090 (+101073us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540040d650. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.983356 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188299648}
I20260709 13:07:09.033509 12730 rpcz_store.cc:276] 0709 13:07:06.395261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.681147 (+285886us) service_pool.cc:224] Handling call
0709 13:07:08.844457 (+2163310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.879803 (+ 35346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.988682 (+108879us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400029750. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:08.988940 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4974344448}
I20260709 13:07:08.998231 14561 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:08.986579 14510 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:08.996798 14580 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:09.035704 12807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1597) took 1469 ms (client timeout 1573 ms). Trace:
I20260709 13:07:09.046622 14311 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:09.043047 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.043533 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:09.042920 12807 rpcz_store.cc:269] 0709 13:07:07.566059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.589846 (+ 23787us) service_pool.cc:224] Handling call
0709 13:07:08.826067 (+1236221us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b5800047a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:09.035294 (+209227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19306752}
I20260709 13:07:09.058521 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.060156 14193 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.065136 12805 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:09.060298 12879 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.066634 12805 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.066993 14561 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:09.068372 14561 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.064600 12802 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.071379 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:09.034332 14469 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.075182 14469 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:09.076431 14363 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.068614 12805 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.079120 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:09.080416 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.081375 12807 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:07:09.071817 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:09.082100 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:09.096925 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:09.102837 13519 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:09.102998 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.106631 14530 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.109261 12879 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.109668 14530 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:09.099946 14363 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:09.103860 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:09.111781 12803 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.081444 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.094048 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:09.117697 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59094.9us
I20260709 13:07:09.118799 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:09.120080 14582 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.120642 14582 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.120253 14580 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.121244 14582 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.126747 14265 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.128572 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 71) took 8407 ms. Trace:
I20260709 13:07:09.124701 12804 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:09.133904 12801 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:09.134876 12877 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:09.139118 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.139272 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.137670 14271 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:09.142040 14271 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:09.142154 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69624.2us
I20260709 13:07:09.142529 14271 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:09.145872 14271 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:09.132395 12627 rpcz_store.cc:276] 0709 13:07:00.848815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.886807 (+ 37992us) service_pool.cc:224] Handling call
0709 13:07:09.128267 (+8241460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:02.903076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:02.955307 (+ 52231us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:02.955371 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:07:02.955412 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:03.007793 (+ 52381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:03.007992 (+   199us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:03.008085 (+    93us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:03.009460 (+  1375us) tablet.cc:701] Row locks acquired
0709 13:07:03.009547 (+    87us) write_op.cc:260] PREPARE: finished
0709 13:07:03.009929 (+   382us) write_op.cc:270] Start()
0709 13:07:03.010287 (+   358us) write_op.cc:276] Timestamp: P: 1783602423009798 usec, L: 0
0709 13:07:03.010363 (+    76us) op_driver.cc:348] REPLICATION: starting
0709 13:07:03.036425 (+ 26062us) log.cc:844] Serialized 2853 byte log entry
0709 13:07:04.318064 (+1281639us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f3eae90ac 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b
0709 13:07:04.975346 (+657282us) op_driver.cc:464] REPLICATION: finished
0709 13:07:05.618683 (+643337us) write_op.cc:301] APPLY: starting
0709 13:07:05.619864 (+  1181us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:05.620192 (+   328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:05.620249 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:05.626049 (+  5800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:05.626413 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:07:05.626498 (+    85us) write_op.cc:312] APPLY: finished
0709 13:07:05.626966 (+   468us) log.cc:844] Serialized 58 byte log entry
0709 13:07:05.627213 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.627379 (+   166us) write_op.cc:454] Released schema lock
0709 13:07:05.627456 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:05.627931 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.627971 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6527,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":635435,"apply.run_cpu_time_us":3863,"apply.run_wall_time_us":10290,"num_ops":7,"prepare.queue_time_us":629585,"prepare.run_cpu_time_us":90932,"prepare.run_wall_time_us":1645343,"raft.queue_time_us":242034,"raft.run_cpu_time_us":39666,"raft.run_wall_time_us":135212,"replication_time_us":1964797,"spinlock_wait_cycles":15064320,"thread_start_us":2091512,"threads_started":4,"wal-append.queue_time_us":1484873,"wal-append.run_cpu_time_us":25418,"wal-append.run_wall_time_us":2090654}]]}
I20260709 13:07:09.147627 14271 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.155731 14587 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.156477 14587 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.158015 13487 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:09.158874 14587 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:09.160248 14486 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:09.160805 14486 raft_consensus.cc:697] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:09.161911 14486 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:09.169044 12802 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:09.166662 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 168965us
W20260709 13:07:09.170328 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.174296 14265 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:09.169600 14587 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:09.195847 14311 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:09.198334 14448 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.013s
I20260709 13:07:09.200102 12800 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:09.202090 12800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1590) took 2341 ms (client timeout 2721 ms). Trace:
W20260709 13:07:09.202576 12800 rpcz_store.cc:269] 0709 13:07:06.860883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.865632 (+1004749us) service_pool.cc:224] Handling call
0709 13:07:09.201807 (+1336175us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:09.202017 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3031332608}
W20260709 13:07:09.203230 14641 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:07:09.203996 14601 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:09.206072 14363 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:09.208137 12630 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 4, now has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 4 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:09.203492 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:09.213359 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.214924 14311 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:09.216555 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:09.217067 14311 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:09.218182 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:09.219638 14601 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.220196 14601 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:09.221267 14601 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.215593 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:09.192238 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:09.226891 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 107) took 1343 ms. Trace:
W20260709 13:07:09.234498 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.237519 12729 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.239331 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:09.227633 12726 rpcz_store.cc:276] 0709 13:07:07.883412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.907488 (+1024076us) service_pool.cc:224] Handling call
0709 13:07:08.948308 (+ 40820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.964680 (+ 16372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.964712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.965504 (+   792us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.037863 (+ 72359us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.037921 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.038017 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.226511 (+188494us) raft_consensus.cc:1685] finished
0709 13:07:09.226537 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.226813 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387,"raft.queue_time_us":2214,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":71803,"threads_started":1,"wal-append.queue_time_us":135210}
I20260709 13:07:09.224529 14151 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:07:09.242111 12731 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:09.225365 12630 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.247390 12727 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.255530 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.256184 14601 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.257174 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:09.258132 14193 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.258585 14193 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.258953 14193 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.240250 14363 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:09.264652 14303 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.265075 14646 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:09.265970 12803 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:09.253006 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.269403 12879 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:09.240768 14510 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.269690 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.277135 14572 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.277949 14572 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.276909 14470 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:09.279076 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.279670 14470 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:09.280673 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:09.280292 14363 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.283332 14363 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.283838 14363 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.286528 12731 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:09.275098 14530 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:09.293331 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 119708us
I20260709 13:07:09.296557 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.297968 12727 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:09.304352 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.275712 12630 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.322341 12630 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.324613 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:09.325392 12725 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.325799 14587 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.324880 12630 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.326690 14587 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:09.328675 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.330132 12630 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:09.334547 12725 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:09.333165 14587 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.338763 14459 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:09.335798 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.340086 14151 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.340780 12725 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:09.340977 14151 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:09.342046 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.343109 12725 raft_consensus.cc:2410] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:09.343438 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 72645.9us
I20260709 13:07:09.343652 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:09.356567 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 77587.5us
I20260709 13:07:09.360317 12731 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:09.333844 12630 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.372748 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:09.345481 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 193236us
I20260709 13:07:09.284564 14469 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:09.380970 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.364825 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:09.396082 14642 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:07:09.349123 14572 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:09.409264 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.412479 12732 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:09.416275 12727 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.380568 14470 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.426229 12726 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.428424 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:09.431407 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.433053 12731 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:09.435618 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.428776 12630 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 2, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:09.447654 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:09.449998 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56068.7us
I20260709 13:07:09.454152 14469 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.454698 14469 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.455068 14469 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.439421 13484 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:09.439651 14151 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:09.463164 14582 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.445390 12630 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:09.479763 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.482268 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:09.490351 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 145868us
I20260709 13:07:09.492117 12800 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.494530 14659 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.495280 14659 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:09.495831 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 66812.2us
I20260709 13:07:09.497040 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:09.489061 12728 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5. Re-sending same reply.
I20260709 13:07:09.503892 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.503705 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:09.505316 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 102594us
I20260709 13:07:09.513501 12802 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:09.517987 14658 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.509420 12630 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.518635 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.497915 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:09.526919 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.535208 12730 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:09.518729 14658 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.443890 14575 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:07:09.538887 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.542296 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:09.543397 12728 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:09.548879 14647 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:07:09.548923 14211 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.579178 14448 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:09.583141 14363 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.584966 12799 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:09.599973 12729 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:09.601191 12630 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:07:09.557420 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60526.2us
I20260709 13:07:09.590131 14211 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.607218 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.587879 14303 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.590067 14448 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:09.595835 14151 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.600342 12699 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:09.627775 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 49641.7us
I20260709 13:07:09.579226 14668 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.632846 14151 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.601580 14572 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.596674 14575 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.635324 14493 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:09.635764 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62452.8us
I20260709 13:07:09.636354 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.637401 14561 raft_consensus.cc:2764] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:09.637463 14663 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:09.638648 14652 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.623558 14211 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.695812 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59593.6us
I20260709 13:07:09.652463 14151 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.656970 14575 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:09.657282 14493 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:09.703318 14652 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.707892 14580 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.732514 14652 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.732764 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.652935 14303 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.741860 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.721103 14582 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:09.729015 14493 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.755271 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:09.769093 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47083.8us
I20260709 13:07:09.769589 14587 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.770210 14587 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.770637 14587 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.771523 14561 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.740108 14580 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:09.808094 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:09.788620 14580 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.811717 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:09.828621 14669 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.726996 14448 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.829635 12877 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.840670 12874 raft_consensus.cc:2368] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:09.842016 12873 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.808573 14470 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.851066 14303 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:09.852150 12799 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:09.852807 14470 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:09.853600 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 145297us
I20260709 13:07:09.854992 14470 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:09.855139 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:09.855577 14470 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.847126 14669 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:09.858683 14669 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:09.860224 14660 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:07:09.861300 14660 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.846808 14363 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:09.861923 14660 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:09.862721 14448 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:09.841336 14601 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.584s	user 0.016s	sys 0.000s
I20260709 13:07:09.861214 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:09.848634 14663 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:09.867082 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:09.871291 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:09.883474 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.889798 12881 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:09.812220 14582 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:07:09.894246 14561 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:09.864616 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 129694us
W20260709 13:07:09.892360 14193 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.004s
I20260709 13:07:09.911928 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:09.912930 12881 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:09.916769 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 45584.3us
I20260709 13:07:09.862965 14660 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.924439 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:09.929363 14681 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:09.905404 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:09.930661 13520 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:09.931699 14657 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.473s	user 0.002s	sys 0.002s
W20260709 13:07:09.932430 14648 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
I20260709 13:07:09.916915 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:09.941046 13513 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
W20260709 13:07:09.946535 14667 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.337s	user 0.003s	sys 0.002s
I20260709 13:07:09.875648 14575 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.902504 14601 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:09.949607 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:09.951149 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.879500 14470 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.900103 14469 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:09.975106 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 137493us
W20260709 13:07:09.975785 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 104943us
I20260709 13:07:09.988709 13519 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:09.989209 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:09.912840 14303 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:07:09.993922 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.908589 14597 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.229s
I20260709 13:07:09.917893 14193 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:10.008888 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 59395.7us
I20260709 13:07:09.972465 14211 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:09.973941 14601 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.024391 14689 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.038829 14601 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:10.039433 14601 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.039116 14689 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.046131 14658 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:10.048323 14684 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:10.049239 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.050110 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:09.924918 14663 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.016585 14665 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.017860 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:10.050688 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.061450 12807 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:10.020138 14193 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.021121 14688 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.022540 14211 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.023041 14682 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.003082 14561 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.024324 14673 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:10.026153 14652 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:10.028613 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:10.029433 14580 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.030249 14679 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.031847 14469 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:09.999348 14660 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.016193 14690 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.060236 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.067703 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:10.106918 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.220944 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 365930us
I20260709 13:07:10.039925 14601 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:10.118736 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.193876 14673 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.190958 14688 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:10.195403 14575 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.063627 14587 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:10.235510 12807 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:10.199433 14658 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.248196 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:10.223179 14689 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:10.249821 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.238497 14673 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.259948 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:10.274437 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:10.278750 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 264931us
W20260709 13:07:10.286448 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.288460 12733 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:10.288949 12733 pending_rounds.cc:85] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:07:10.289209 12733 pending_rounds.cc:107] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:10.289517 12733 raft_consensus.cc:2889] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.291653 14265 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:10.296772 14674 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
W20260709 13:07:10.305064 14685 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:07:10.310680 14687 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:10.314618 12807 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.317773 12803 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:10.237808 14151 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:07:10.352855 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.233773 14679 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.261739 14658 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.360134 12803 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:10.361979 14658 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:10.362252 12875 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:10.364236 12875 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:07:10.356518 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:10.328421 14470 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.374472 12807 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:10.236052 14690 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.376302 12881 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:10.330144 14682 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:10.387179 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 147491us
I20260709 13:07:10.388115 12806 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:10.400486 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.404552 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:10.416168 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.419615 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.401211 14665 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.410588 12806 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:10.408797 12875 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:10.467664 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:10.464252 14493 consensus_meta.cc:287] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.007s
I20260709 13:07:10.470021 14696 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:10.479610 12727 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.472321 14700 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:10.470275 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:10.463446 14580 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.480741 14493 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.477823 14601 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:10.496251 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.497954 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:10.498701 12875 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:10.498764 14694 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:07:10.484256 14696 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.479086 14652 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.401886 14688 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:10.499743 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:10.517064 14601 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.478030 14663 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:10.958830 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.862016 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.069409 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 600288us
I20260709 13:07:11.070899 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.071794 12874 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:10.884667 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 95774.9us
I20260709 13:07:10.765295 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.074440 12873 raft_consensus.cc:2410] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:11.080120 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.074712 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:11.084470 12806 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:10.705271 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.668551 12727 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:11.076684 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.086990 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.601502 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:10.824261 14702 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260709 13:07:10.825234 14706 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:07:10.721257 14582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.010s	sys 0.007s
W20260709 13:07:10.592949 14672 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.780s	user 0.000s	sys 0.010s
W20260709 13:07:11.003023 14711 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
I20260709 13:07:10.731577 14690 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:10.936578 14662 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.267s	user 0.002s	sys 0.011s
W20260709 13:07:10.722321 14700 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:11.130798 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:10.986054 14712 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:07:11.133752 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:11.003333 14695 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.666s	user 0.006s	sys 0.000s
I20260709 13:07:10.957099 14470 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.176s
I20260709 13:07:11.141646 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1407) took 1288 ms. Trace:
I20260709 13:07:10.520952 14459 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.617s
W20260709 13:07:11.143139 14710 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.670s	user 0.000s	sys 0.017s
I20260709 13:07:11.142181 12876 rpcz_store.cc:276] 0709 13:07:09.853212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.065008 (+211796us) service_pool.cc:224] Handling call
0709 13:07:10.196549 (+131541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.202897 (+  6348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.202949 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.242214 (+ 39265us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.403324 (+161110us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:10.403385 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.403481 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.141375 (+737894us) raft_consensus.cc:1685] finished
0709 13:07:11.141401 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.141570 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1467,"raft.queue_time_us":21741,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3940,"thread_start_us":120942,"threads_started":1,"wal-append.queue_time_us":213447}
I20260709 13:07:11.144891 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:11.145638 14661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.000s	sys 0.024s
W20260709 13:07:11.146020 14661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.001s	sys 0.024s
I20260709 13:07:11.149273 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 618) took 1657 ms. Trace:
I20260709 13:07:11.149788 12808 rpcz_store.cc:276] 0709 13:07:09.491626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.584103 (+ 92477us) service_pool.cc:224] Handling call
0709 13:07:09.584532 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.584770 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.584797 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.585393 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.716926 (+131533us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:09.716974 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.717067 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.591989 (+874922us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:11.148890 (+556901us) raft_consensus.cc:1685] finished
0709 13:07:11.148914 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.149171 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83208960,"thread_start_us":130577,"threads_started":1,"wal-append.queue_time_us":149443}
I20260709 13:07:11.151505 12874 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:10.824477 14675 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.976s	user 0.013s	sys 0.022s
W20260709 13:07:11.153836 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 237303us
I20260709 13:07:10.523815 14486 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.122704 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48854.5us
I20260709 13:07:11.087103 14469 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.517503 14493 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:10.609040 14665 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:10.668162 14597 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.607107 14686 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:11.129736 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.087455 14587 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:10.668469 14652 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.603031 14659 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:11.112202 14691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.012s	sys 0.009s
W20260709 13:07:11.119958 14582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.012s	sys 0.016s
I20260709 13:07:11.110685 12875 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.791519 14679 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.120103 14575 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:11.109670 14561 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.551343 14265 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.138041 12873 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.144964 12876 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:11.152107 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1404) took 1299 ms. Trace:
W20260709 13:07:11.049638 14708 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.353s	user 0.001s	sys 0.001s
I20260709 13:07:10.524349 14151 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.087149 14601 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.174805 14493 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:11.159309 14510 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.178032 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.175417 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 621) took 1592 ms. Trace:
I20260709 13:07:11.183297 14718 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.183617 12771 leader_election.cc:400] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:11.209151 12771 leader_election.cc:403] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:07:11.176189 14691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.013s	sys 0.009s
I20260709 13:07:11.189944 12874 rpcz_store.cc:276] 0709 13:07:09.852389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.904923 (+ 52534us) service_pool.cc:224] Handling call
0709 13:07:10.882316 (+977393us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:11.152016 (+269700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10502912}
I20260709 13:07:11.165807 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:11.172971 14597 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.191461 14714 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.168684 12806 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:11.202009 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:11.167501 14469 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.216286 14691 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.217605 14469 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.166966 14665 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.213637 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1401) took 1338 ms. Trace:
W20260709 13:07:11.205549 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.188104 14486 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.210769 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1409) took 1357 ms. Trace:
W20260709 13:07:11.197319 14704 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.712s	user 0.008s	sys 0.009s
I20260709 13:07:11.187698 14717 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.202623 12802 rpcz_store.cc:276] 0709 13:07:09.583151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.596330 (+ 13179us) service_pool.cc:224] Handling call
0709 13:07:09.608822 (+ 12492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.899086 (+290264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.899119 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.965538 (+ 66419us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.246612 (+281074us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.259390 (+ 12778us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.262691 (+  3301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.262853 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.559599 (+296746us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800354a60. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:11.171510 (+611911us) raft_consensus.cc:1685] finished
0709 13:07:11.175132 (+  3622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.175339 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79468,"prepare.queue_time_us":29616,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":145514,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":21820,"spinlock_wait_cycles":12718080,"thread_start_us":419127,"threads_started":2,"wal-append.queue_time_us":358193}
I20260709 13:07:11.179385 14652 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:11.238731 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 73916.7us
I20260709 13:07:11.179942 14686 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.209497 14510 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:11.244920 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.245604 14715 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.198963 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.247152 12874 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.194103 14265 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.239358 12882 rpcz_store.cc:276] 0709 13:07:09.853809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.193147 (+339338us) service_pool.cc:224] Handling call
0709 13:07:10.225600 (+ 32453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:10.242562 (+ 16962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.242596 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:10.329428 (+ 86832us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.459176 (+129748us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:10.460173 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.460272 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.210387 (+750115us) raft_consensus.cc:1685] finished
0709 13:07:11.210423 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.210673 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5631,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3599,"thread_start_us":49436,"threads_started":1,"wal-append.queue_time_us":207731}
I20260709 13:07:11.259106 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:11.262745 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.263223 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.196137 14561 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.219892 12880 rpcz_store.cc:276] 0709 13:07:09.851345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.866038 (+ 14693us) service_pool.cc:224] Handling call
0709 13:07:09.891332 (+ 25294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.922862 (+ 31530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.922886 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.984255 (+ 61369us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.327720 (+343465us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.416239 (+ 88519us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.416498 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.416570 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.189758 (+773188us) raft_consensus.cc:1685] finished
0709 13:07:11.189781 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.189918 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28320,"prepare.queue_time_us":151641,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":3618,"raft.queue_time_us":19264,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":16027,"thread_start_us":367325,"threads_started":2,"wal-append.queue_time_us":404019}
I20260709 13:07:11.274891 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:11.276147 13514 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.277688 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.278371 13519 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:11.241686 14661 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:11.289352 14151 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.264856 14663 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:11.292788 14151 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:11.293294 14151 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.295259 14601 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.240022 14714 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.215018 14493 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.288422 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.208747 14575 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.289435 14265 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:11.289601 14673 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.003s
I20260709 13:07:11.247509 14717 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:11.290208 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.290160 12874 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:11.290710 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 98094.9us
W20260709 13:07:11.297593 14668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.660s	user 0.030s	sys 0.056s
W20260709 13:07:11.237421 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 82324.4us
I20260709 13:07:11.287719 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 622) took 1704 ms. Trace:
I20260709 13:07:11.256106 14469 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.266706 14715 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:11.298556 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.308442 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.289354 14486 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.309036 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:11.250499 14510 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.301203 14582 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.313493 14716 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:11.313889 14582 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.314910 14714 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.307891 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.316141 14686 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:11.316388 14582 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:11.311121 14713 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:07:11.302366 13513 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:11.306071 14668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.030s	sys 0.057s
I20260709 13:07:11.299077 14587 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.240471 14718 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.323132 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.324479 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.328217 12880 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:11.325560 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.306449 12800 rpcz_store.cc:276] 0709 13:07:09.583539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.585665 (+  2126us) service_pool.cc:224] Handling call
0709 13:07:09.586053 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.586511 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.586538 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.587312 (+   774us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.680955 (+ 93643us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:09.681003 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.681116 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.505624 (+824508us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:11.272301 (+766677us) raft_consensus.cc:1685] finished
0709 13:07:11.272336 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.287642 (+ 15306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3987,"raft.queue_time_us":114066,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":21650,"spinlock_wait_cycles":34261760,"thread_start_us":86976,"threads_started":1,"wal-append.queue_time_us":169952}
W20260709 13:07:11.313230 14719 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:11.364048 12878 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:11.336256 14493 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.322913 14663 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.338335 14715 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.342716 14718 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.343365 14469 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.343463 14717 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.344105 13514 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:11.345584 14575 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.346594 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.320114 14691 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.324419 14668 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:11.347759 14587 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.348531 14679 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:11.342773 14597 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:11.352661 14582 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.354211 14660 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.126s	user 0.012s	sys 0.003s
I20260709 13:07:11.355084 14665 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.329731 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:11.381217 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 275672us
I20260709 13:07:11.400372 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.405982 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:11.398733 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 225312us
I20260709 13:07:11.410060 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:11.410341 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:11.423022 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59178.3us
I20260709 13:07:11.423413 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.308557 14673 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:11.398780 14723 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:11.426256 14714 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.426963 14714 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:11.427264 14673 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.428575 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
W20260709 13:07:11.429080 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82607.6us
I20260709 13:07:11.429414 12733 raft_consensus.cc:606] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:11.429878 12733 raft_consensus.cc:614] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:11.430012 12771 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.430694 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:11.430881 12724 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:11.431210 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.431466 14679 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.432026 14679 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:11.432613 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.432899 14661 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.433308 14661 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.433588 12724 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:11.433678 14661 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.434785 14696 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.435395 14696 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.436128 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.437009 12724 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:11.439041 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.439206 12874 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:11.439682 12725 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:11.440505 12881 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:11.441223 12725 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:11.432274 14575 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.443277 12725 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.443572 14575 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.443979 14575 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.445204 12724 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:11.444967 14668 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.446146 14693 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.446565 14693 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:11.447379 12725 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:11.430050 14587 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:11.448629 14652 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:11.401158 14704 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:11.420871 14717 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.449198 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.421897 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.436847 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.450897 12873 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:11.453657 12847 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.579s (SENT) [suppressed 45 similar messages]
I20260709 13:07:11.457161 12725 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:11.455749 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1413) took 1063 ms. Trace:
I20260709 13:07:11.457188 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1417) took 1064 ms. Trace:
I20260709 13:07:11.454903 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.458964 12732 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:11.458249 12873 rpcz_store.cc:276] 0709 13:07:10.393054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.123187 (+730133us) service_pool.cc:224] Handling call
0709 13:07:11.457130 (+333943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:11.457957 12879 rpcz_store.cc:276] 0709 13:07:10.392004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.401601 (+  9597us) service_pool.cc:224] Handling call
0709 13:07:10.413228 (+ 11627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.437009 (+ 23781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.437076 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.455475 (+ 18399us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.917932 (+462457us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:10.952549 (+ 34617us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.952797 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.952881 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.050267 (+ 97386us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800348820. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:11.454129 (+403862us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b24001ff628. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3e98c9c4 00007f0f3e98aacb 00007f0f3eb45dc9 00007f0f3eb45a55 00007f0f3eb44fb0 00007f0f417bb488 00007f0f417bbbe8 00007f0f41793398 00007f0f4178e76a 00007f0f4178dbb6
0709 13:07:11.455480 (+  1351us) raft_consensus.cc:1685] finished
0709 13:07:11.455506 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.455678 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34886,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":809,"raft.queue_time_us":285,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":9728,"spinlock_wait_cycles":67065984,"thread_start_us":431300,"threads_started":1,"wal-append.queue_time_us":674646}
I20260709 13:07:11.403330 14493 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:11.401623 14690 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.449105 14587 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.480288 12727 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:07:11.478503 12733 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:07:11.478752 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56936.1us
I20260709 13:07:11.376021 14151 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:11.485222 12773 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.531s (SENT)
I20260709 13:07:11.455469 14469 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:11.417963 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 245639us
I20260709 13:07:11.485345 12724 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:11.483376 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:11.486114 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60306.8us
W20260709 13:07:11.487196 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.482577 12733 pending_rounds.cc:85] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:11.397535 14663 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.489673 12733 pending_rounds.cc:107] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:07:11.493113 12847 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.964s (SENT)
I20260709 13:07:11.493301 12733 raft_consensus.cc:2889] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.501888 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1406) took 1649 ms. Trace:
I20260709 13:07:11.479245 14690 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:11.477828 14561 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.510342 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.502353 12877 rpcz_store.cc:276] 0709 13:07:09.852944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.035288 (+182344us) service_pool.cc:224] Handling call
0709 13:07:10.035810 (+   522us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:10.067718 (+ 31908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.067754 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:10.197438 (+129684us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.317799 (+120361us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.405236 (+ 87437us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.405475 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.405560 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.565375 (+159815us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800350aa0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06557 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:10.824613 (+259238us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:11.501682 (+677069us) raft_consensus.cc:1685] finished
0709 13:07:11.501703 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.501832 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138043,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3579,"raft.queue_time_us":125094,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":26662,"spinlock_wait_cycles":32688000,"thread_start_us":152094,"threads_started":2,"wal-append.queue_time_us":197824}
I20260709 13:07:11.485883 14660 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.518544 14660 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.519223 14660 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.513998 14601 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:11.530320 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.519433 14665 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.433034 14679 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.464857 14582 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:11.490260 14493 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.504051 14729 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.543195 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.544181 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:11.547681 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.542517 14732 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:07:11.488921 14587 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.552474 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.558373 12729 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:11.568120 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 87623.9us
I20260709 13:07:11.570214 12727 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:11.550014 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.577437 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.578215 12724 raft_consensus.cc:2410] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:11.571606 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.581146 12730 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:11.550684 14670 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.447455 14693 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.556770 14729 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.529553 14714 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:11.620985 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.579531 14597 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.625346 12875 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:11.541600 14660 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.626483 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1415) took 1233 ms. Trace:
I20260709 13:07:11.626884 12875 rpcz_store.cc:276] 0709 13:07:10.392595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.499503 (+106908us) service_pool.cc:224] Handling call
0709 13:07:11.626410 (+1126907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:11.627410 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59033.9us
I20260709 13:07:11.576960 14665 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:11.638439 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:11.615871 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58431.3us
I20260709 13:07:11.626538 14469 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:11.622534 14729 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.657364 12724 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:11.657299 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.660650 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.660733 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.661329 14663 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.661756 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.626303 14597 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.625054 14670 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:11.728207 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.728960 12873 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:07:11.724059 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.731309 12875 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
I20260709 13:07:11.652251 13512 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.720436 12729 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:11.721179 12725 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 2.
W20260709 13:07:11.723500 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61618.3us
I20260709 13:07:11.620364 14561 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:11.726354 14733 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.733049 14740 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:07:11.733459 12732 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:11.734375 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.735193 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.787005 12877 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
W20260709 13:07:11.736176 14730 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:11.654795 14510 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:11.737289 14587 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.662165 14575 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:11.740370 14739 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:11.746492 14660 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:11.727139 14597 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.628023 14690 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:11.822794 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.750900 12733 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:11.751561 14469 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.752242 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:11.753306 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.832084 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:11.718484 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.778628 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:11.783728 14729 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.788796 12879 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:11.794229 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:11.841284 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47165.6us
I20260709 13:07:11.841883 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.842972 12733 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
W20260709 13:07:11.800707 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 172163us
I20260709 13:07:11.826395 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.829771 12728 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.640941 14665 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.836397 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.839202 12724 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:11.840339 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.845899 12725 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:11.839318 14690 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.803725 14733 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:11.853111 12732 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.858199 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:11.824992 14151 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:11.862914 14749 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.863559 14582 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:11.863672 14749 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.864488 14582 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.874279 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.755924 14670 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:11.859071 14688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.020s	sys 0.022s
I20260709 13:07:11.877331 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.878535 12873 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:11.853839 14686 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.882939 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:11.884493 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.885097 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.885634 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.851855 13513 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:11.856738 14732 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.887818 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:11.892570 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:11.893672 12807 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:11.893987 12879 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:11.888972 12875 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:11.893173 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:11.896634 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:11.896956 12875 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:11.881709 14688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.020s	sys 0.022s
I20260709 13:07:11.900731 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.903401 12801 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:11.905282 14749 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:11.839458 14459 consensus_queue.cc:1175] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a865487bf1854df8a5619d42465bb36c" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:11.916534 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.881430 14686 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.918268 12733 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:07:11.905767 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:11.935004 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.894870 14732 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.953917 12882 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:11.944305 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.953015 12733 pending_rounds.cc:85] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:11.955900 12733 pending_rounds.cc:107] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:07:11.946961 12730 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:11.956200 12733 raft_consensus.cc:2889] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.961053 12732 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:11.962122 12877 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
W20260709 13:07:11.966441 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 76008.2us
I20260709 13:07:11.966949 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:11.967923 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:11.969132 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:11.886408 14470 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:07:11.971298 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:11.993808 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.994470 12882 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.898897 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:11.993264 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:11.978786 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:11.990630 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.996430 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:11.997165 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.008659 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:12.008713 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:12.013407 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44509.7us
I20260709 13:07:12.013782 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:11.960126 14686 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:11.995512 14661 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.008s
I20260709 13:07:12.002140 12726 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:12.022444 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:12.022636 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:12.023033 12875 raft_consensus.cc:2376] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4. Re-sending same reply.
I20260709 13:07:11.996582 14751 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.996675 14688 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:12.016695 14575 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.017592 14729 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:11.961400 14732 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.014636 12877 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:12.020398 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 623) took 2436 ms. Trace:
W20260709 13:07:12.016171 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 127788us
I20260709 13:07:12.021410 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.023414 12879 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:12.052616 14688 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:12.053766 14688 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:11.960664 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:12.026824 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.036572 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.038372 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.050431 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.329236 12882 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:12.342885 12725 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:12.348994 12873 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:12.057534 12732 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.322628 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.358203 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:12.362124 12801 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:12.124512 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:12.381597 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 325020us
W20260709 13:07:12.065013 12773 connection.cc:256] RPC call timeout handler was delayed by -1.45112081700006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:07:12.383224 12773 connection.cc:256] RPC call timeout handler was delayed by -1.4373586780000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:07:12.383744 12773 connection.cc:256] RPC call timeout handler was delayed by -1.4130377449999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 13:07:12.392091 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:12.392431 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:12.387272 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:12.037395 14751 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:12.362995 14755 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:07:12.341382 14693 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:12.395548 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.402704 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:12.094563 14510 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:12.056150 14665 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.339480 14469 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.049592 12805 rpcz_store.cc:276] 0709 13:07:09.583883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.581443 (+997560us) service_pool.cc:224] Handling call
0709 13:07:10.604205 (+ 22762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:10.604866 (+   661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.604924 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.068515 (+463591us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.464872 (+396357us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:11.497916 (+ 33044us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.498225 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.498345 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.019927 (+521582us) raft_consensus.cc:1685] finished
0709 13:07:12.019960 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.020299 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32775,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":7064,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":7275,"thread_start_us":340320,"threads_started":1,"wal-append.queue_time_us":473936}
I20260709 13:07:12.428843 13512 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:12.036962 14661 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.433888 12801 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:12.075608 12799 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:12.406523 12807 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:12.364704 14660 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.444938 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:12.445897 12801 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
W20260709 13:07:12.388089 14759 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.436s	user 0.001s	sys 0.001s
W20260709 13:07:12.425140 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.449465 12773 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.704s (SENT)
I20260709 13:07:12.386046 14764 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:12.440351 12724 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.002s
I20260709 13:07:12.361629 14679 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:12.453152 12724 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:12.405990 14751 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.461961 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:12.457744 12732 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:12.035975 14733 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:12.452445 14764 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.488826 14601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.013s	sys 0.008s
I20260709 13:07:12.465013 14679 consensus_queue.cc:1243] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:12.469485 14740 raft_consensus.cc:2764] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:12.503906 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.494661 14470 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.490767 14765 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.497188 14764 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.503017 14690 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.002s
W20260709 13:07:12.504837 14601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.008s
W20260709 13:07:12.509683 14717 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.037s	user 0.006s	sys 0.009s
W20260709 13:07:12.527917 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 102527us
W20260709 13:07:12.559957 14769 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:07:12.507580 14670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.027s
W20260709 13:07:12.633782 12773 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.729s (SENT)
W20260709 13:07:12.540864 14768 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:07:12.507513 14770 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:12.564812 14732 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.002s
I20260709 13:07:12.529994 14765 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.623817 14303 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.635900 14670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.021s	sys 0.028s
I20260709 13:07:12.674491 12724 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:07:12.678933 12773 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.766s (SENT)
W20260709 13:07:12.676258 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 284055us
I20260709 13:07:12.640252 14770 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:12.675606 14686 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.005s
I20260709 13:07:12.686455 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.690307 12725 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:12.691072 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.692222 12732 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:12.687278 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.688189 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.688751 12726 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:12.692951 12730 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.682277 14756 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.335s	user 0.002s	sys 0.002s
I20260709 13:07:12.694413 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.675319 14661 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.656335 14732 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.707360 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.698673 12724 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:12.699838 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:12.700965 14774 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:07:12.702791 14778 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:12.708947 12726 raft_consensus.cc:2376] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4. Re-sending same reply.
I20260709 13:07:12.711267 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:12.684585 14770 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.711423 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.716480 12725 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:12.716856 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.719379 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.719501 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.720060 12726 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.678678 14303 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.731307 14691 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:12.731992 14691 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:12.732975 14691 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.737448 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.738385 12732 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:12.739109 12726 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:12.695784 14686 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:12.741469 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.743151 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.752678 12725 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:12.753441 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.754583 12732 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:12.755403 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.743427 14691 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.745158 14303 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:12.745700 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 43726us
I20260709 13:07:12.756253 12732 raft_consensus.cc:2410] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:12.756892 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.757602 12729 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.758482 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.773304 12725 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:12.774338 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.775462 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.780527 12726 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5. Re-sending same reply.
I20260709 13:07:12.781395 12729 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:12.768390 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 128) took 1106 ms. Trace:
I20260709 13:07:12.800976 12728 rpcz_store.cc:276] 0709 13:07:11.659740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.659853 (+   113us) service_pool.cc:224] Handling call
0709 13:07:11.732296 (+ 72443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.849409 (+117113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.765375 (+915966us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b5400062f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:12.765677 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223434624}
W20260709 13:07:12.767361 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65791.2us
I20260709 13:07:12.782634 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.804649 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.785028 14765 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:12.791424 13486 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:12.793345 14732 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:12.795290 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.808425 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.800364 12730 raft_consensus.cc:2410] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:12.803378 12725 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.782495 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.794392 14781 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.799841 14773 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:07:12.812997 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.813273 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.813812 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.811726 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.815238 12730 raft_consensus.cc:2410] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:12.815474 12773 leader_election.cc:336] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.940s (SENT)
I20260709 13:07:12.816002 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:12.816221 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.816777 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4364585179999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:07:12.817191 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4202585179999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:07:12.817458 12696 connection.cc:256] RPC call timeout handler was delayed by -1.404958517999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:07:12.817685 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3896585179999192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:07:12.817917 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3473585179999645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:07:12.818615 12696 connection.cc:256] RPC call timeout handler was delayed by -1.1538585179999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:07:12.818907 12696 connection.cc:256] RPC call timeout handler was delayed by -1.1079585179999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:07:12.819288 12696 connection.cc:256] RPC call timeout handler was delayed by -1.042258517999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:07:12.819622 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0305585179999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:07:12.820355 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:12.820698 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:12.820436 14781 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.824187 14668 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.824716 14668 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.810876 14597 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.005s
I20260709 13:07:12.827637 14668 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.831168 14751 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.832150 14575 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.832482 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:12.833151 14686 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.833453 14751 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.828891 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1627) took 1535 ms. Trace:
I20260709 13:07:12.836184 12727 raft_consensus.cc:2410] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:12.836082 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:12.836175 12880 rpcz_store.cc:276] 0709 13:07:11.293372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.424361 (+130989us) service_pool.cc:224] Handling call
0709 13:07:11.424757 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.486095 (+ 61338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.486138 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.515115 (+ 28977us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.623749 (+108634us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:11.637011 (+ 13262us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.016732 (+379721us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b18003b8a20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:12.790498 (+773766us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18003b8a20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:12.828466 (+ 37968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.828540 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.828611 (+    71us) raft_consensus.cc:1685] finished
0709 13:07:12.828629 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.828812 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24805,"prepare.queue_time_us":13045,"prepare.run_cpu_time_us":8162,"prepare.run_wall_time_us":56934,"raft.queue_time_us":164244,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":46633,"spinlock_wait_cycles":27064576,"thread_start_us":119108,"threads_started":2,"wal-append.queue_time_us":195990}
I20260709 13:07:12.835047 14770 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:12.837270 12728 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 2.
I20260709 13:07:12.823931 14781 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.849895 12725 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:12.814926 14783 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.869653 12724 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:12.869951 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54524.5us
I20260709 13:07:12.842412 14751 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.829675 14733 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.872870 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52686.4us
I20260709 13:07:12.873574 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:12.836371 14597 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:12.878448 12773 leader_election.cc:336] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.951s (SENT)
I20260709 13:07:12.886268 14783 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:12.886952 14783 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.887046 14764 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:12.889357 12773 connection.cc:256] RPC call timeout handler was delayed by -1.3174721770000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.259s for a response
I20260709 13:07:12.889606 14783 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:12.890084 14770 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:12.890321 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2726377449999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:07:12.890758 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2626302659999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:07:12.891093 12773 connection.cc:256] RPC call timeout handler was delayed by -1.1114995609999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260709 13:07:12.892292 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:12.898138 14787 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 13:07:12.902596 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1372) took 1319 ms. Trace:
I20260709 13:07:12.903467 14597 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:12.904662 12733 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:12.905136 12733 pending_rounds.cc:85] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:12.905390 12733 pending_rounds.cc:107] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:12.905625 12733 raft_consensus.cc:2889] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.903239 12727 rpcz_store.cc:276] 0709 13:07:11.582786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.583769 (+   983us) service_pool.cc:224] Handling call
0709 13:07:12.902275 (+1318506us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400063954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:12.902511 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792081792}
I20260709 13:07:12.914525 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:12.909575 14740 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:12.917613 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:12.918171 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.903890 14660 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.918170 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44652.6us
I20260709 13:07:12.916347 14764 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:12.916615 14721 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:12.929168 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:12.929994 14795 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.925321 14688 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.880254 14733 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:12.925225 14660 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.920302 14740 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:12.942200 14785 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
W20260709 13:07:12.958335 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.980655 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57481.6us
I20260709 13:07:12.997565 12802 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:13.018191 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:12.916760 14271 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:13.022879 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.005769 12806 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:12.072173 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 171590us
I20260709 13:07:13.024170 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.025913 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.014921 14582 raft_consensus.cc:1064] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:07:13.015784 14688 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:12.918685 14668 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:13.019712 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.010850 14493 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.028301 14575 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.040903 13513 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:13.041821 12726 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:13.008239 14750 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:07:13.012315 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66434.9us
I20260709 13:07:13.051630 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.051239 14693 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.053845 14470 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.065800 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.041733 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.067550 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:13.063051 14757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.021s
I20260709 13:07:13.087839 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.091455 14151 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:13.063812 14582 raft_consensus.cc:1068] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:13.065232 14714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.431s	user 0.005s	sys 0.008s
I20260709 13:07:13.094027 14151 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:13.090951 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.100284 14151 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.095821 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.097289 14668 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.095270 13520 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:13.101137 12806 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:13.102537 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51007us
I20260709 13:07:13.103917 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:13.094115 14757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.008s	sys 0.022s
I20260709 13:07:13.052145 14271 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:13.100069 14714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.008s	sys 0.021s
I20260709 13:07:13.108630 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.089026 14575 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:13.093670 14561 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.110203 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.103632 14459 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.111514 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1436) took 1085 ms. Trace:
I20260709 13:07:13.113058 12875 rpcz_store.cc:276] 0709 13:07:12.026528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.042965 (+ 16437us) service_pool.cc:224] Handling call
0709 13:07:12.043538 (+   573us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.062077 (+ 18539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.062132 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.362963 (+300831us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.556975 (+194012us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:12.557058 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.558464 (+  1406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.941209 (+382745us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:13.109391 (+168182us) raft_consensus.cc:1685] finished
0709 13:07:13.109416 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.111449 (+  2033us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10397,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"spinlock_wait_cycles":22221184,"thread_start_us":131133,"threads_started":1,"wal-append.queue_time_us":327070}
I20260709 13:07:13.093616 14470 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:13.105783 12799 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:13.066496 14690 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:13.115787 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.122308 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.123100 14151 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.114775 14459 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.123775 14470 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.127622 14764 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:13.127914 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.129606 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1361) took 1691 ms. Trace:
I20260709 13:07:13.128993 14747 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:13.112864 14693 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.137418 14151 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.138003 12728 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.138981 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.129220 14688 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.147154 14688 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.147728 14688 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.138463 14803 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.150792 14688 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.152904 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.154565 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.155942 12771 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.155160 14151 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.156529 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.137989 12731 rpcz_store.cc:276] 0709 13:07:11.438203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.438342 (+   139us) service_pool.cc:224] Handling call
0709 13:07:11.438658 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.439042 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.439071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.439616 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.529040 (+ 89424us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:11.577273 (+ 48233us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.806896 (+229623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.807568 (+   672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.946023 (+1138455us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b180004a020. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:13.116209 (+170186us) raft_consensus.cc:1685] finished
0709 13:07:13.129404 (+ 13195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.129544 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86139,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":90589,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"spinlock_wait_cycles":28911488,"thread_start_us":355030,"threads_started":3,"wal-append.queue_time_us":175605}
I20260709 13:07:13.158252 14758 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.115268 14510 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:07:13.135452 14459 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.138392 14747 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:13.159974 14151 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:13.137578 14673 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.162134 14758 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.164079 14673 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.160943 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.276110 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1389) took 1360 ms. Trace:
I20260709 13:07:13.164232 14758 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.173074 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 180) took 1630 ms. Trace:
I20260709 13:07:13.312319 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.283785 12848 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:13.169317 14735 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:13.284714 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.312335 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 151442us
I20260709 13:07:13.281975 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.281015 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.173094 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.169530 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.319195 12724 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:13.320219 12729 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:13.261418 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.260797 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:13.322034 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60743.7us
I20260709 13:07:13.240456 14271 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.244455 14151 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:13.267424 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.323385 12727 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:13.244242 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.324803 12806 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:13.173734 12805 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:13.167402 12731 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:13.174463 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.327708 12804 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:07:13.169936 14575 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.164535 14673 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.175114 14679 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:13.171003 14740 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:13.297185 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.299683 14696 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:13.164712 14717 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:13.187821 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 79271.8us
I20260709 13:07:13.169160 14747 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.307485 12800 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.308543 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:13.323889 14767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.007s	sys 0.012s
W20260709 13:07:13.287469 14786 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.457s	user 0.005s	sys 0.001s
I20260709 13:07:13.311111 12733 rpcz_store.cc:276] 0709 13:07:11.915409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.074762 (+159353us) service_pool.cc:224] Handling call
0709 13:07:12.904120 (+829358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.906396 (+  2276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.269951 (+363555us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400063950. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:13.275997 (+  6046us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699506560}
W20260709 13:07:13.335044 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.372910 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:13.337630 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74729.1us
I20260709 13:07:13.346674 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.366240 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.374243 12806 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.366349 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.367183 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.318470 14698 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.333518 14715 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.374981 12804 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:13.376201 12726 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.373579 12805 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.333226 14765 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.323746 14735 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:13.391933 12847 connection.cc:256] RPC call timeout handler was delayed by -1.3306773780000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3169s for a response
I20260709 13:07:13.332994 14679 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:13.399906 12847 connection.cc:256] RPC call timeout handler was delayed by -1.2645697780000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3351s for a response
W20260709 13:07:13.408463 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0727647759999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:07:13.341225 14717 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.372793 14767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.007s	sys 0.013s
W20260709 13:07:13.398859 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 75314.1us
I20260709 13:07:13.403618 12728 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 3.
I20260709 13:07:13.405316 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.406462 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.340180 14696 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:13.417061 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:13.429378 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.434583 14765 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:13.397843 14715 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.444991 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.447832 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.311906 13520 rpcz_store.cc:276] 0709 13:07:11.542529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.550427 (+  7898us) service_pool.cc:224] Handling call
0709 13:07:12.832332 (+1281905us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:13.172816 (+340484us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54007f0154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:13.172971 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604384384}
W20260709 13:07:13.507910 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.399188 14764 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:13.511499 14764 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:13.517488 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.518510 12728 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:13.507702 12802 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.428524 14717 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.459252 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.468901 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.460944 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:13.469736 12805 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:13.530037 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:13.531104 12805 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:13.461596 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.531738 12726 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:13.469686 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.463272 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.533421 12725 raft_consensus.cc:2410] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:13.488106 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:13.534210 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73341.8us
I20260709 13:07:13.534857 12727 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:13.488135 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.389586 14747 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.407446 14660 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:13.494357 12773 connection.cc:256] RPC call timeout handler was delayed by -1.3571291169999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.43280000000000007s for a response
W20260709 13:07:13.538810 12773 connection.cc:256] RPC call timeout handler was delayed by -1.3535303820000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:07:13.440987 14271 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:07:13.501921 12806 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:13.536525 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48587.6us
W20260709 13:07:13.539305 12773 connection.cc:256] RPC call timeout handler was delayed by -1.3472303820000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:07:13.545862 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2671303820001185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:07:13.546046 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.546288 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:13.546504 12773 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.529s (SENT)
I20260709 13:07:13.547080 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.497352 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.548013 12729 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:13.441751 14740 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:07:13.542183 12730 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 3: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:13.459095 14748 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:13.546829 12800 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:13.551515 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.564600 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:13.601025 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54563us
I20260709 13:07:13.551025 14698 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:13.602209 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.602567 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.563967 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.522131 14765 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.569057 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 650) took 1697 ms. Trace:
I20260709 13:07:13.556598 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.612762 12806 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:13.571591 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:13.613757 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49927.8us
I20260709 13:07:13.477710 14668 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:13.574716 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.617225 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:13.575625 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.617822 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:13.617301 12801 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.539011 14714 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.578181 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.629949 12730 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:13.544492 14780 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.581760 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:13.633353 12875 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:13.584672 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.587894 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.634680 12725 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:13.588769 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:13.635771 12878 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:13.553467 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.589963 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.633553 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:13.642138 12727 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:13.595796 12724 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:13.603147 12726 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:13.523350 14715 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.648115 12730 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.618029 12732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:13.568296 14582 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.611414 12808 rpcz_store.cc:276] 0709 13:07:11.871247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.878525 (+  7278us) service_pool.cc:224] Handling call
0709 13:07:11.889168 (+ 10643us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.025463 (+136295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.038787 (+ 13324us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.384703 (+345916us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.675164 (+290461us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:12.675205 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.675277 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.242988 (+567711us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:13.552750 (+309762us) raft_consensus.cc:1685] finished
0709 13:07:13.552858 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.568987 (+ 16129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338492,"raft.queue_time_us":136096,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":15657,"spinlock_wait_cycles":11314944,"thread_start_us":354890,"threads_started":2,"wal-append.queue_time_us":404706}
I20260709 13:07:13.626283 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.627967 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.650287 12729 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:13.651093 12880 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.484108 14679 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.655026 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:13.655757 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.656093 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:13.537515 14764 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:13.644834 12879 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:13.645879 12801 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.579773 14767 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.567392 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:13.691280 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:13.671214 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.984532 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.658932 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.987600 12873 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:13.692081 12875 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:13.693943 12731 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:13.660576 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:13.994527 14764 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.995067 14764 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.995497 14764 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.977366 14765 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:14.007555 14764 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:13.895686 14812 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:07:13.957511 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.855453 14493 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:13.779265 14750 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.006s
I20260709 13:07:13.392699 13512 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:13.865675 12808 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:07:14.151732 12878 consensus_meta.cc:287] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.004s
I20260709 13:07:13.802120 12802 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:13.632723 14780 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:13.652459 14813 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.647256 14733 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:13.893319 12733 pending_rounds.cc:85] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:13.647259 12804 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:13.647981 14740 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:07:13.737308 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:13.735814 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:13.887058 14510 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.785972 14459 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
W20260709 13:07:13.742648 14808 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:07:13.777263 14660 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:13.561076 14735 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:13.610110 14748 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:13.647305 14688 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:07:13.780821 14679 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.858542 14151 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:13.740936 14809 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:13.968641 12805 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:13.741888 14806 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:07:13.773828 14698 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:13.647444 14693 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:13.971433 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 436216us
W20260709 13:07:13.976198 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 374453us
I20260709 13:07:13.903621 12880 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:14.009356 14673 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.000s
W20260709 13:07:14.010355 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 356993us
I20260709 13:07:13.899562 14696 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:14.021055 14714 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:14.030982 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 413216us
W20260709 13:07:13.971135 14690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.033s
W20260709 13:07:14.025473 14758 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.002s
I20260709 13:07:14.061215 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:14.071290 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.974685 14767 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:14.059126 12772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.007s
W20260709 13:07:14.124137 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.151249 14816 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.699740 13516 raft_consensus.cc:2368] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:14.155911 12802 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:07:14.119167 14717 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.004s
I20260709 13:07:14.059051 14715 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:14.522655 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.043s	sys 0.069s
W20260709 13:07:14.523353 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.044s	sys 0.069s
I20260709 13:07:14.527341 12733 pending_rounds.cc:107] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:07:14.528554 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1636) took 1128 ms. Trace:
I20260709 13:07:14.531252 12802 rpcz_store.cc:276] 0709 13:07:13.400231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.155170 (+754939us) service_pool.cc:224] Handling call
0709 13:07:14.155631 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.528255 (+372624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.528493 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.533084 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1637) took 1109 ms. Trace:
W20260709 13:07:14.533617 12772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.009s	sys 0.017s
I20260709 13:07:14.533967 12733 raft_consensus.cc:2889] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.533761 12805 rpcz_store.cc:276] 0709 13:07:13.424101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.543063 (+118962us) service_pool.cc:224] Handling call
0709 13:07:14.533012 (+989949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.528968 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:14.529167 12878 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:14.529575 12773 connection.cc:256] RPC call timeout handler was delayed by -1.226630382000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 13:07:14.529870 12877 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:14.535961 12773 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.715s (SENT)
W20260709 13:07:14.468995 12730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.028s	sys 0.014s
W20260709 13:07:14.537002 12773 connection.cc:256] RPC call timeout handler was delayed by -1.21853038200004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:07:14.523319 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.156675 12801 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.520728 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:14.537236 12730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.029s	sys 0.015s
W20260709 13:07:14.367214 12806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.012s	sys 0.006s
W20260709 13:07:14.521898 12882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.002s
I20260709 13:07:14.533107 12879 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.540205 12874 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:14.532636 14816 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:14.543982 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 201) took 1081 ms. Trace:
W20260709 13:07:14.229787 14561 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.031s
I20260709 13:07:14.537838 14510 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.544971 14817 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.546000 14827 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:07:14.504073 14833 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:07:14.551659 14757 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.518244 14822 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.452s	user 0.000s	sys 0.001s
I20260709 13:07:14.542336 14714 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.613965 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1617) took 1563 ms. Trace:
I20260709 13:07:14.615340 12803 rpcz_store.cc:276] 0709 13:07:13.050249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.050489 (+   240us) service_pool.cc:224] Handling call
0709 13:07:14.613569 (+1563080us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001a2a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:14.613843 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312933120}
I20260709 13:07:14.553119 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:14.716475 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.717383 12878 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
W20260709 13:07:14.533383 14690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.012s	sys 0.045s
I20260709 13:07:14.732597 14765 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:14.733525 14765 consensus_queue.cc:1243] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:14.741039 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:14.742260 12878 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:14.743481 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.744355 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:14.542196 12806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.012s	sys 0.008s
I20260709 13:07:14.748214 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 664) took 1446 ms. Trace:
I20260709 13:07:14.748718 12806 rpcz_store.cc:276] 0709 13:07:13.302044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.613755 (+311711us) service_pool.cc:224] Handling call
0709 13:07:13.647360 (+ 33605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.647652 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:13.812946 (+165294us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.747528 (+934582us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.747739 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.747795 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.747858 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.747945 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.748136 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65850,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":933627,"threads_started":1,"wal-append.queue_time_us":811083}
I20260709 13:07:14.514153 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1625) took 1342 ms. Trace:
I20260709 13:07:14.159291 14780 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:14.542418 12882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.010s	sys 0.002s
W20260709 13:07:14.563470 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.561136 12773 leader_election.cc:336] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.470s (SENT)
W20260709 13:07:14.576305 14561 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.005s	sys 0.050s
W20260709 13:07:14.759872 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 232083us
I20260709 13:07:14.583019 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.542200 14813 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.535245 14717 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.564489 13516 rpcz_store.cc:276] 0709 13:07:13.458987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.468784 (+  9797us) service_pool.cc:224] Handling call
0709 13:07:14.540520 (+1071736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.541059 14758 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.554121 14459 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:14.511132 14747 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.959s	user 0.013s	sys 0.000s
I20260709 13:07:14.618444 12875 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.619413 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1637) took 1031 ms. Trace:
I20260709 13:07:14.835453 12880 rpcz_store.cc:276] 0709 13:07:13.587864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.588088 (+   224us) service_pool.cc:224] Handling call
0709 13:07:14.617890 (+1029802us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b540006ccd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:14.619289 (+  1399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76040576}
I20260709 13:07:14.837607 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.625763 14510 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:14.560388 14686 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:14.635557 12879 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:14.841259 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1446) took 1201 ms. Trace:
I20260709 13:07:14.841696 12879 rpcz_store.cc:276] 0709 13:07:13.639875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.735492 (+ 95617us) service_pool.cc:224] Handling call
0709 13:07:14.841175 (+1105683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.638156 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:14.649746 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:14.652156 14816 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:14.653337 14715 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:14.609349 14757 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:14.655594 14714 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:14.593016 14764 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:14.661067 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 126) took 1502 ms. Trace:
I20260709 13:07:14.663518 14803 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:14.664577 14840 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.668794 14748 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:14.671684 14767 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:14.590488 14817 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.675800 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.676239 14696 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.678774 14830 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:14.542125 14673 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.552974 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:14.714351 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 672) took 1345 ms. Trace:
I20260709 13:07:14.889206 12801 rpcz_store.cc:276] 0709 13:07:13.369237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.693071 (+323834us) service_pool.cc:224] Handling call
0709 13:07:14.156476 (+463405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.539079 (+382603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.714056 (+174977us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400033ed0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:14.714271 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762534784}
W20260709 13:07:14.316922 14470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.029s
I20260709 13:07:14.745430 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.893675 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.894860 12878 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:14.746112 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:14.895659 12881 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.762178 12877 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:14.751605 12799 rpcz_store.cc:276] 0709 13:07:13.171958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.258948 (+ 86990us) service_pool.cc:224] Handling call
0709 13:07:13.319559 (+ 60611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.575846 (+256287us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:13.584424 (+  8578us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.734559 (+150135us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.047787 (+313228us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:14.056077 (+  8290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.058770 (+  2693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.513735 (+454965us) raft_consensus.cc:1685] finished
0709 13:07:14.513783 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.514056 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58665,"raft.queue_time_us":62340,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":65409,"thread_start_us":327309,"threads_started":2,"wal-append.queue_time_us":621527}
I20260709 13:07:14.767549 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:14.767642 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:14.897286 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 129789us
I20260709 13:07:14.844318 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:14.899305 12880 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.899690 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:14.845079 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:14.851033 12807 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.871814 14840 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:14.841368 14733 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.841521 14693 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.847586 14660 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.871990 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 335610us
W20260709 13:07:14.867781 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 338856us
I20260709 13:07:14.943815 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:14.900660 12880 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.945539 12878 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.946663 12880 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.947295 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:14.948164 12879 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:14.948959 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.897454 14470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.013s	sys 0.036s
I20260709 13:07:14.957005 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1448) took 1307 ms. Trace:
I20260709 13:07:14.961302 12877 rpcz_store.cc:276] 0709 13:07:13.649408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.905245 (+1255837us) service_pool.cc:224] Handling call
0709 13:07:14.956467 (+ 51222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.956609 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.956624 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.956652 (+    28us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.956685 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.956720 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.956903 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:14.954746 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 254441us
I20260709 13:07:14.965894 12876 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.956724 12880 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:14.958420 12879 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:14.974030 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:14.980199 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 208771us
I20260709 13:07:14.985282 12696 leader_election.cc:400] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:14.985899 12696 leader_election.cc:403] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:07:14.986709 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.944707 14748 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.871606 14803 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.938565 14714 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:14.942065 14840 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.961263 14747 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.011749 14271 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.012578 14271 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.017155 14271 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.010700 12881 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:14.989421 14825 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:14.857024 13513 rpcz_store.cc:276] 0709 13:07:13.158640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.158819 (+   179us) service_pool.cc:224] Handling call
0709 13:07:13.164199 (+  5380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.238450 (+ 74251us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:13.238493 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.239147 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.430337 (+191190us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.439123 (+  8786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.445943 (+  6820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.660554 (+1214611us) raft_consensus.cc:1685] finished
0709 13:07:14.660598 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.660929 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93070,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":12007,"thread_start_us":166494,"threads_started":1,"wal-append.queue_time_us":286585}
I20260709 13:07:15.029238 14825 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.029775 14825 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:15.022233 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.030642 14825 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.031837 12799 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.994895 14748 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.032720 14748 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.009042 14493 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.010061 14714 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:15.040282 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 63369.7us
I20260709 13:07:15.042634 14714 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.043680 14839 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.044682 14839 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:15.046448 14825 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.047825 14839 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:15.052304 14747 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:15.055168 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:14.961202 14816 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:07:15.073073 14816 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:14.950969 14693 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.955981 14660 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.973003 14750 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 13:07:15.092820 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.095528 14870 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.096258 14870 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:14.891372 14830 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:14.977262 14510 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:07:15.085868 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 128) took 1784 ms. Trace:
I20260709 13:07:15.090440 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:15.091331 14813 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.091704 14660 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:15.091799 14757 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.010262 14845 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.095729 14803 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:15.089475 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.092406 14841 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 13:07:15.111382 12732 raft_consensus.cc:606] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.113313 13521 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
W20260709 13:07:15.117703 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115107us
I20260709 13:07:15.116263 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:15.124832 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.132392 13487 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.550s (SENT)
I20260709 13:07:15.149150 12799 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:15.154687 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.151473 14660 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.101619 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.167379 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.168677 14817 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.168982 14733 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.173187 14660 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:15.197175 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.097486 14870 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.213142 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1411) took 1749 ms. Trace:
W20260709 13:07:15.222093 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 166782us
I20260709 13:07:15.225670 12733 rpcz_store.cc:276] 0709 13:07:13.463793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.866187 (+402394us) service_pool.cc:224] Handling call
0709 13:07:13.893045 (+ 26858us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.560918 (+667873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.560954 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.561696 (+   742us) log.cc:844] Serialized 52 byte log entry
0709 13:07:14.952811 (+391115us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.952878 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.952988 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.212881 (+259893us) raft_consensus.cc:1685] finished
0709 13:07:15.212904 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.213069 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1361,"raft.queue_time_us":106344,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":365675,"threads_started":1,"wal-append.queue_time_us":483676}
W20260709 13:07:15.212844 13484 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.550s (SENT)
I20260709 13:07:15.227635 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.087195 14747 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.243346 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1447) took 1603 ms. Trace:
I20260709 13:07:15.213869 14717 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.207157 14845 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.249572 14847 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:15.257309 14826 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.929s	user 0.011s	sys 0.011s
I20260709 13:07:15.259143 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.263393 14735 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.248236 12874 rpcz_store.cc:276] 0709 13:07:13.641264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.577866 (+936602us) service_pool.cc:224] Handling call
0709 13:07:14.592903 (+ 15037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.593133 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:14.892766 (+299633us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.242739 (+349973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.242839 (+   100us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:15.242923 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.243034 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.243237 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14659,"prepare.queue_time_us":406654,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":53399,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":136,"thread_start_us":599881,"threads_started":3,"wal-append.queue_time_us":214855}
W20260709 13:07:15.268731 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 101431us
I20260709 13:07:15.223284 14459 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:15.271667 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.273310 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.230583 14830 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.282065 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 661) took 1996 ms. Trace:
I20260709 13:07:15.282575 12804 rpcz_store.cc:276] 0709 13:07:13.286089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.614917 (+328828us) service_pool.cc:224] Handling call
0709 13:07:13.646947 (+ 32030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.647146 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:14.661081 (+1013935us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.883648 (+222567us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.281527 (+397879us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800354b20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:15.281691 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.281743 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:15.281798 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.281864 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.281999 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2939,"prepare.queue_time_us":281861,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":1970,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":3931,"spinlock_wait_cycles":6736256,"thread_start_us":220738,"threads_started":1,"wal-append.queue_time_us":552326}
W20260709 13:07:15.286522 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60545.8us
I20260709 13:07:15.266908 14870 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.283890 14693 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.284024 14803 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.318670 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1441) took 1680 ms. Trace:
I20260709 13:07:15.319168 12882 rpcz_store.cc:276] 0709 13:07:13.638320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.985871 (+347551us) service_pool.cc:224] Handling call
0709 13:07:13.986157 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.986509 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:13.993471 (+  6962us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.001534 (+1008063us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.318288 (+316754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.318346 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.318399 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.318469 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.318601 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326207,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":79209,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":52083,"spinlock_wait_cycles":50273536,"thread_start_us":1316333,"threads_started":3,"wal-append.queue_time_us":585209}
I20260709 13:07:15.281396 14845 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.285542 14874 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.325958 14845 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.311272 14673 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.329779 14747 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.109823 13512 rpcz_store.cc:276] 0709 13:07:13.301890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.302821 (+   931us) service_pool.cc:224] Handling call
0709 13:07:13.333854 (+ 31033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.374533 (+ 40679us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:14.589574 (+1215041us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.084956 (+495382us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.085281 (+   325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.085362 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:15.085477 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.085601 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.085773 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181350,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":40434,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":367,"thread_start_us":385801,"threads_started":2,"wal-append.queue_time_us":577249}
W20260709 13:07:15.333736 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 60553.9us
W20260709 13:07:15.339298 14780 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.006s
W20260709 13:07:15.355890 14864 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:15.356310 14758 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:15.357390 14853 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:07:15.360317 14871 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.381150 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44939.2us
I20260709 13:07:15.383158 12847 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.322288 14803 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.363747 14764 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:15.387741 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 95832.1us
I20260709 13:07:15.388676 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1444) took 1749 ms. Trace:
I20260709 13:07:15.392238 12875 rpcz_store.cc:276] 0709 13:07:13.639299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.989219 (+349920us) service_pool.cc:224] Handling call
0709 13:07:14.618108 (+628889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.835323 (+217215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.388457 (+553134us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540006ccd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:15.388610 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445553408}
I20260709 13:07:15.393481 14493 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
W20260709 13:07:15.394006 14837 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.766s	user 0.005s	sys 0.004s
I20260709 13:07:15.351395 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.398518 14748 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:15.399538 14696 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.003s
I20260709 13:07:15.361138 14871 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.400305 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1629) took 2142 ms. Trace:
I20260709 13:07:15.400846 12807 rpcz_store.cc:276] 0709 13:07:13.257775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.257966 (+   191us) service_pool.cc:224] Handling call
0709 13:07:13.258445 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.949172 (+1690727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.400018 (+450846us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002b20d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:15.400239 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3662260608}
I20260709 13:07:15.402607 14871 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.403295 14859 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.377686 14876 consensus_queue.cc:1059] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:15.405162 14876 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.405543 14876 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.406520 14876 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.378732 14780 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.408180 14874 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.410257 14874 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.355919 14840 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.412842 14840 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.412969 14561 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.413383 14561 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:15.403800 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1442) took 1765 ms. Trace:
I20260709 13:07:15.417971 14561 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:15.418421 12873 rpcz_store.cc:276] 0709 13:07:13.638621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.988332 (+349711us) service_pool.cc:224] Handling call
0709 13:07:13.988612 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.556620 (+568008us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:14.873057 (+316437us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.402697 (+529640us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18003fd540. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287
0709 13:07:15.402811 (+   114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.402873 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.402936 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.403567 (+   631us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400070dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:15.403605 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.403736 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":421326,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":59,"raft.queue_time_us":68646,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"spinlock_wait_cycles":1347380352,"thread_start_us":480061,"threads_started":3,"wal-append.queue_time_us":221875}
I20260709 13:07:15.420284 13520 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.420552 14493 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.421067 14493 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.423189 14803 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.423035 14825 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:15.424168 14825 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.424682 14825 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:15.411336 14874 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.425277 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:15.425789 14825 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.427424 14825 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:15.428376 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45322.9us
I20260709 13:07:15.424758 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58468 (request call id 6) took 1962 ms. Trace:
I20260709 13:07:15.429143 12732 rpcz_store.cc:276] 0709 13:07:13.461964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.617872 (+155908us) service_pool.cc:224] Handling call
0709 13:07:15.424579 (+1806707us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540038f254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bed853 00007f0f46bbb60a 00007f0f401417d4 00007f0f40141762 00007f0f40141691 00007f0f4014160c 00007f0f401408c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:15.424662 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3363797248}
W20260709 13:07:15.430081 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.428685 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 868370us
W20260709 13:07:15.430879 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.431069 12773 leader_election.cc:336] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.498s (SENT)
I20260709 13:07:15.431474 14748 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:15.431565 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.432358 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 676) took 2042 ms. Trace:
W20260709 13:07:15.432945 12773 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.590s (SENT)
I20260709 13:07:15.433004 14470 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:15.433856 12773 connection.cc:256] RPC call timeout handler was delayed by -1.0790303820000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:07:15.433734 14470 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.429293 14698 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.436282 14876 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.432740 12800 rpcz_store.cc:276] 0709 13:07:13.390034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.062084 (+672050us) service_pool.cc:224] Handling call
0709 13:07:14.147011 (+ 84927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.147382 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:14.897628 (+750246us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.431954 (+534326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.432008 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.432102 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.432178 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.432303 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420670,"prepare.queue_time_us":373898,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":488253,"threads_started":2,"wal-append.queue_time_us":199130}
I20260709 13:07:15.437343 14698 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.400439 12728 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:15.423879 14493 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.429528 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.442747 14690 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.443039 14823 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.443435 14690 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.444056 14764 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.443853 14823 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.410333 14780 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:15.456970 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 904057us
I20260709 13:07:15.446856 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.442633 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1404) took 1992 ms. Trace:
I20260709 13:07:15.457871 12728 rpcz_store.cc:276] 0709 13:07:13.449833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.625979 (+176146us) service_pool.cc:224] Handling call
0709 13:07:15.442325 (+1816346us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400062a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:15.442544 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3924824832}
I20260709 13:07:15.419837 14561 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.484076 12847 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:15.481863 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46776.9us
I20260709 13:07:15.488390 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.490711 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.491515 12807 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:15.492419 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:15.493494 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.493827 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.488817 12627 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.494438 12802 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.494501 12801 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:15.495792 12627 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 3, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 3 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:15.445947 14582 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.503068 14758 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.503656 14878 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.504278 14881 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:15.504817 14717 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.505307 14758 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:15.505415 14673 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.491071 14840 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.486166 14740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.024s	sys 0.017s
I20260709 13:07:15.503522 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:15.508785 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.508755 12802 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:15.483247 14830 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.512817 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:15.513266 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:15.513056 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:15.507413 14493 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.534638 12800 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:15.517850 12808 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:15.519732 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:15.520763 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.505713 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.497937 12627 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.491271 14696 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.496228 14470 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.495965 14767 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.529623 14690 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:15.525759 14740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.025s	sys 0.017s
I20260709 13:07:15.530889 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.518615 14582 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.527832 14840 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.506211 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.542328 12627 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.549975 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 152) took 10496 ms. Trace:
I20260709 13:07:15.550386 14817 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.528481 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:15.517498 14715 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.523766 14673 consensus_queue.cc:1243] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:15.558794 12799 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:15.561161 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 55532.2us
I20260709 13:07:15.562600 14698 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.563437 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.565131 14758 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.552942 14882 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.570154 14748 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:15.571579 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68170.8us
I20260709 13:07:15.570655 12630 rpcz_store.cc:276] 0709 13:07:05.053597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.065514 (+ 11917us) service_pool.cc:224] Handling call
0709 13:07:15.549827 (+10484313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:10.199151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:10.444462 (+245311us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:10.455010 (+ 10548us) write_op.cc:435] Acquired schema lock
0709 13:07:10.458197 (+  3187us) tablet.cc:662] Decoding operations
0709 13:07:10.834942 (+376745us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:10.835070 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:10.835114 (+    44us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:07:11.117404 (+282290us) tablet.cc:701] Row locks acquired
0709 13:07:11.131792 (+ 14388us) write_op.cc:260] PREPARE: finished
0709 13:07:11.161348 (+ 29556us) write_op.cc:270] Start()
0709 13:07:11.182091 (+ 20743us) write_op.cc:276] Timestamp: P: 1783602431142102 usec, L: 0
0709 13:07:11.186961 (+  4870us) op_driver.cc:348] REPLICATION: starting
0709 13:07:11.217446 (+ 30485us) log.cc:844] Serialized 4645 byte log entry
0709 13:07:11.517637 (+300191us) op_driver.cc:464] REPLICATION: finished
0709 13:07:11.655985 (+138348us) write_op.cc:301] APPLY: starting
0709 13:07:11.656145 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:11.656535 (+   390us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:11.660599 (+  4064us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:11.665522 (+  4923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:11.739660 (+ 74138us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:07:11.739739 (+    79us) write_op.cc:312] APPLY: finished
0709 13:07:11.740226 (+   487us) log.cc:844] Serialized 82 byte log entry
0709 13:07:11.741260 (+  1034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.741476 (+   216us) write_op.cc:454] Released schema lock
0709 13:07:11.741582 (+   106us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:11.744220 (+  2638us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.744256 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30696,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":123052,"apply.run_cpu_time_us":9740,"apply.run_wall_time_us":88170,"num_ops":11,"prepare.queue_time_us":333935,"prepare.run_cpu_time_us":22695,"prepare.run_wall_time_us":1206342,"raft.queue_time_us":222416,"raft.run_cpu_time_us":38433,"raft.run_wall_time_us":69101,"replication_time_us":328126,"thread_start_us":387668,"threads_started":4,"wal-append.queue_time_us":71971,"wal-append.run_cpu_time_us":32068,"wal-append.run_wall_time_us":1458196}]]}
I20260709 13:07:15.579325 12627 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:07:15.573712 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45322.7us
I20260709 13:07:15.578261 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:15.576752 13521 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:15.580466 14879 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.587529 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.592756 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.527951 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.590224 12728 raft_consensus.cc:606] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.593628 12728 raft_consensus.cc:614] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.590236 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:15.599758 14758 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:15.600868 14459 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.601914 14757 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.576817 14874 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.612311 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.613988 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.606222 14717 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.611739 14688 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.556479 14696 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.557660 14493 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.597281 12627 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.615629 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:15.621557 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.573601 13520 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:15.624148 12627 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:15.631727 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.588718 14748 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:15.641995 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 51860.4us
I20260709 13:07:15.643153 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.571125 14767 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.578344 14715 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.623924 14740 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.646174 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:15.624135 14823 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.616765 14870 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.641212 14575 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.641388 12627 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 4, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.610977 14459 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:15.665208 14459 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.666678 14459 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.667352 14871 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.621068 14688 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:15.668797 14688 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.598323 14673 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:07:15.625680 14879 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.612493 14757 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:15.581065 14882 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.601086 14758 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.669214 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.672883 14748 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.673906 14870 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.659511 14740 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.674443 14870 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.675359 14870 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.680526 14673 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.577036 14817 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.646166 14869 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.647464 14866 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.655370 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.669989 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:15.726673 12805 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:15.681715 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:15.681980 12806 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:15.645814 14880 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.623729 14679 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:15.614826 14876 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:07:15.711901 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51552.1us
W20260709 13:07:15.712473 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.648731 14813 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.655786 14830 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.724681 12808 raft_consensus.cc:2376] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6. Re-sending same reply.
I20260709 13:07:15.711932 12627 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.721765 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:15.723045 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.679941 14688 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.734793 12800 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:07:15.738421 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69329.1us
I20260709 13:07:15.740336 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.740921 14840 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.741091 14876 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.741716 14876 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.743193 14876 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.744648 14757 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.745561 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:15.746250 12728 raft_consensus.cc:606] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.746515 14866 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.746729 12728 raft_consensus.cc:614] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.747502 14866 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.748257 14764 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.681238 14575 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:15.749414 14575 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.750387 12627 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.755112 14582 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.756750 14878 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.747696 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.758394 14764 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.760875 12882 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:15.761413 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.762647 14767 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.762921 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:15.762663 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:15.764489 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.764842 12873 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:15.765519 14817 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.687834 14740 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.766135 12878 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.746016 14757 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:15.767163 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.762987 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:15.767794 12879 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.760875 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.763868 12876 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:15.771759 12881 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:15.774652 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.772603 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.792870 12875 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:07:15.812245 12730 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
W20260709 13:07:15.817982 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.795526 14715 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:15.799824 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:15.821280 12732 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:15.821612 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.800496 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.712891 14673 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:15.837584 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.755012 14876 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.778889 12627 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:07:15.824625 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.823473 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:15.836879 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:15.845299 12873 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:15.846025 14740 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.846575 14740 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.847051 14673 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.825062 14880 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.848574 14880 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:15.849181 14735 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.848954 14575 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.849722 14735 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.850193 14735 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.836602 14817 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:07:15.851645 14575 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:15.840363 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:15.818704 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46199.5us
I20260709 13:07:15.843279 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.861238 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:15.839329 12881 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:15.867398 14816 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.869931 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.878211 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:15.858345 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:15.881753 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 227040us
I20260709 13:07:15.884857 12848 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:15.890743 14735 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:15.892498 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:15.893374 12733 raft_consensus.cc:606] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.894153 12733 raft_consensus.cc:614] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.850143 14880 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.858296 12627 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 4, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.905818 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:15.912565 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.916127 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.915547 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91401.8us
I20260709 13:07:15.919203 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:15.913498 12627 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 3 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.929098 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.907191 14688 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.930335 12627 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.923977 14459 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.924364 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:15.928642 14735 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:15.932751 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:15.916868 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:15.881836 14561 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.921761 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:15.897874 14673 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.904778 14748 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:15.939628 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:15.980754 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.981420 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:15.927305 14816 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.908113 14877 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.922466 14765 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:15.952226 12879 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.953644 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.930106 14688 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:15.946910 14767 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:15.958987 14817 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.963388 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:15.963100 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:16.010111 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47316.7us
I20260709 13:07:16.005723 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:16.014310 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 97556.8us
I20260709 13:07:15.945457 14493 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:15.968381 12627 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 3 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.992782 14813 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.968999 14459 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:15.969136 14882 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.000818 14765 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.004743 12773 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:16.006865 14767 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:16.001511 14575 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.001163 14748 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:15.994835 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.016010 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:16.009630 13512 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:16.051380 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:16.044375 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.044358 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:16.019316 14679 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.049007 12877 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:16.026228 14660 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.079392 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.080144 13486 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:16.081784 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.082753 12730 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:16.084239 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.085829 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:16.086922 12730 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.105628 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.115432 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.039839 14459 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.118465 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.032512 12627 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:16.018930 14877 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:16.123574 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.124131 12731 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:16.046459 14765 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.129571 12873 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:07:16.047699 14823 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:16.141013 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.049376 14767 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.148658 14825 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:16.149245 14877 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.150027 12726 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.150282 14840 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.151124 14840 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:16.152877 14840 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.153359 14817 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:16.154856 14840 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.127858 12627 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to <none>, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:16.119108 14575 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.010114 14561 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.022804 14757 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:16.072793 14882 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.127153 14493 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.065513 14748 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.145592 14735 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:16.145968 12733 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:16.119948 14813 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.035724 14698 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:07:16.077409 14679 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.120249 14871 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.126724 14859 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.119413 14660 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:16.137622 12730 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:16.129813 14582 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:16.166399 12627 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 2 to 3, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:16.140439 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:16.166966 14823 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:16.200443 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.173161 14690 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.209894 12627 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 2, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.173377 14575 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:16.177907 14871 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.177659 14679 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.182561 14660 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.179728 14735 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:16.172554 14882 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.228389 12729 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:16.230679 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.190889 14823 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:16.215198 14690 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:16.243654 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.242805 12627 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 3 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.241400 14823 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.227540 14668 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:16.208989 14493 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:16.225003 14871 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.218142 14715 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:07:16.275204 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 195224us
W20260709 13:07:16.273711 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 156606us
W20260709 13:07:16.296293 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.286789 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:16.298835 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 243987us
I20260709 13:07:16.302721 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.328688 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.330113 12873 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:16.338966 14908 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:07:16.340525 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.342384 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.343820 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.345676 12881 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.348326 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.348837 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:16.351508 14891 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:07:16.263644 14735 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:16.353690 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.362854 14740 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.364024 14561 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.366479 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:16.367164 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.290172 14582 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:07:16.373747 14582 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.374343 14582 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:16.376205 14673 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:16.377374 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 75203.4us
I20260709 13:07:16.378564 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.227700 14575 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.381098 14698 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.393121 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.395385 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.396876 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.396992 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.397878 12879 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:16.394161 12880 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:16.399096 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.400424 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.411172 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.418079 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.419468 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.420845 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.375941 14582 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.424430 14823 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.425439 14582 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.428138 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.430047 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.431157 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.427273 13520 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:16.441039 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.441478 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.443610 12880 raft_consensus.cc:2368] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:16.438625 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.453285 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.455767 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.434518 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.460265 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.461488 12881 raft_consensus.cc:2376] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5. Re-sending same reply.
I20260709 13:07:16.463410 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.464982 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.396106 14673 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.471532 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.462812 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.417554 14561 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.417766 14757 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.435910 14823 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.321033 14690 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:16.520972 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.502816 12881 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:16.496641 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:16.526964 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.526932 12880 raft_consensus.cc:2376] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4. Re-sending same reply.
I20260709 13:07:16.484184 14758 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.528846 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.529434 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.467075 14717 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:16.480268 14882 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.538471 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:16.479198 14813 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.539124 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:16.540253 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.541728 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.487757 14493 consensus_queue.cc:1243] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:16.533389 12880 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:16.533530 12881 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:16.545157 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.467660 14908 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.546535 12881 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:16.550676 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:16.489034 14757 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:16.555553 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:16.564510 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91121.8us
I20260709 13:07:16.495534 14866 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.590006 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.607988 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:16.609913 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54454.5us
W20260709 13:07:16.610059 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 186264us
I20260709 13:07:16.614547 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:16.616643 14673 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:16.622138 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.539036 14758 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:16.492974 14561 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:16.634382 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.634872 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58699us
I20260709 13:07:16.562214 14690 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.608529 14757 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.562325 14717 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:16.674522 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:16.662756 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 121092us
I20260709 13:07:16.691886 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.677264 14668 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.612056 14493 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.683790 12805 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.684176 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.670713 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.686808 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.696178 12733 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:16.679764 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.696390 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.618041 14882 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.698015 12805 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:16.705911 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.706843 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:16.707409 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:16.708362 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.668462 14840 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.004s
I20260709 13:07:16.707841 12801 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.611269 14905 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.713503 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.721303 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:16.722486 12808 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:16.722890 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.714071 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.724455 12804 raft_consensus.cc:2410] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:16.714751 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.715647 12799 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:07:16.663091 14758 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.611855 14899 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:16.553447 14898 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.167s
I20260709 13:07:16.732018 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.733110 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:16.694312 14904 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:16.681305 14764 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.607674 14748 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.743656 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.745831 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.695490 14493 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.749603 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:16.772521 12733 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.749755 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.775133 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:16.749809 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.776454 12799 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:16.750910 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.777802 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:16.776021 12808 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.753831 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 145937us
I20260709 13:07:16.781169 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:16.620342 14866 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:16.758819 12805 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:16.783701 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:16.793346 12878 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:16.793612 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.794737 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:16.796284 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:16.797037 12804 raft_consensus.cc:2376] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4. Re-sending same reply.
I20260709 13:07:16.798326 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.799429 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.798264 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:16.800941 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 126544us
I20260709 13:07:16.801486 12807 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:16.688767 14673 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.756500 14764 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:16.802127 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:16.803225 12732 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:16.803514 12804 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:16.803622 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.806030 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.807773 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.787232 14493 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.809077 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.813874 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.786494 14874 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.789851 14911 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.786294 14561 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.817363 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.815068 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.823292 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:16.796859 14840 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.824397 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:16.806819 14764 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.855281 12733 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:16.856621 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:16.802489 14880 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:16.817782 14877 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.874060 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:16.824975 14911 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:16.890705 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 94069us
I20260709 13:07:16.894155 14840 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.825577 14909 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.855913 14561 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.939461 12801 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:16.880957 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:16.900911 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:16.880851 14906 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:07:16.871670 14905 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:16.871178 14920 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.823467 14918 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:07:16.821691 14874 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:16.925524 14912 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:07:16.965159 14907 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:07:16.810458 14717 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:16.970538 14923 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:16.973798 14696 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:16.976424 14866 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:16.978365 14896 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:07:16.981698 12802 raft_consensus.cc:1217] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:16.982241 12802 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 6. Ops: [4.4-4.4]
W20260709 13:07:16.957594 14679 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.005s
W20260709 13:07:16.947371 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66501.8us
I20260709 13:07:16.988860 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:16.948256 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47454.4us
I20260709 13:07:16.990309 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:16.991290 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:16.958325 14870 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.986433 14840 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.994429 14924 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:16.994748 14840 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.995177 14924 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:16.962054 14748 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:16.996232 14924 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:16.961826 14914 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:07:16.930874 14910 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:07:16.959017 14459 consensus_meta.cc:287] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.816s	user 0.015s	sys 0.000s
W20260709 13:07:16.966053 14928 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.075s	user 0.003s	sys 0.003s
I20260709 13:07:17.014257 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:17.014118 14459 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.015172 12800 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.017021 12730 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:07:17.017396 12730 pending_rounds.cc:85] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:17.017685 12730 pending_rounds.cc:107] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:17.018016 12730 raft_consensus.cc:2889] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.000377 12727 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:16.962303 14905 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:16.945976 12808 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:16.995342 14840 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:17.007493 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 396730us
W20260709 13:07:17.025759 14660 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.001s
I20260709 13:07:17.026386 14660 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.029155 14660 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.008059 14937 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.008358 12724 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.013597 14925 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:17.029821 14871 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.003s
W20260709 13:07:17.030743 14890 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.081s	user 0.000s	sys 0.006s
I20260709 13:07:17.005607 14679 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.001271 14909 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.034474 14877 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.009791 14688 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.012187 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:17.075383 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 63268.8us
I20260709 13:07:17.014292 14696 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.080438 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.080884 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:17.098651 12627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.000s	sys 0.015s
W20260709 13:07:17.100678 12873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.003s	sys 0.020s
W20260709 13:07:17.101838 12873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.020s
I20260709 13:07:17.102288 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:17.109190 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:17.110677 12732 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:17.058696 14767 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.910s	user 0.016s	sys 0.000s
I20260709 13:07:17.074828 14871 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:17.099436 12627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.000s	sys 0.015s
I20260709 13:07:17.119501 12874 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:07:17.120235 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73510.1us
W20260709 13:07:17.123370 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 443658us
W20260709 13:07:17.126082 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 434296us
I20260709 13:07:17.126921 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.065078 14740 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.071682 14668 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:17.068418 14877 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:17.127934 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.005s	sys 0.009s
I20260709 13:07:17.065301 14925 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.071961 14937 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:17.176986 12727 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.166851 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:17.180646 12728 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:17.099340 14688 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.038512 14764 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.160485 14874 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.200397 14901 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:07:17.202828 14900 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:07:17.204252 14902 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.855s	user 0.000s	sys 0.002s
W20260709 13:07:17.206805 14893 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.797s	user 0.000s	sys 0.001s
W20260709 13:07:17.210317 14895 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.798s	user 0.002s	sys 0.006s
I20260709 13:07:17.211351 14459 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.213654 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 694) took 1097 ms. Trace:
I20260709 13:07:17.213820 14679 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:17.214236 12729 rpcz_store.cc:276] 0709 13:07:16.116852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.117817 (+   965us) service_pool.cc:224] Handling call
0709 13:07:17.213350 (+1095533us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400308c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:17.213553 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233785088}
I20260709 13:07:17.216917 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 696) took 1230 ms. Trace:
I20260709 13:07:17.217418 12800 rpcz_store.cc:276] 0709 13:07:15.986145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.987070 (+   925us) service_pool.cc:224] Handling call
0709 13:07:15.987464 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.015561 (+1028097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.216586 (+201025us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400034654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:17.216824 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363180800}
W20260709 13:07:17.219122 14765 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.067s	user 0.004s	sys 0.010s
I20260709 13:07:17.117467 14825 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.224581 14825 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.211370 14870 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:17.226143 14870 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:17.111708 14660 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.228363 14660 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:17.228987 14660 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.144701 14866 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:07:17.232985 14877 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.234987 14877 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.126792 14909 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.127969 14767 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.132387 14740 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:17.241230 14740 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.243135 14740 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.244831 14668 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.129761 14748 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.248703 14748 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:17.250056 14748 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.253059 12805 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:17.254122 14582 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.004s
I20260709 13:07:17.257300 14764 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.190845 14937 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.215912 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:17.269330 14879 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:17.268977 12729 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.274276 12727 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:17.281991 12802 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:17.282846 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.008s	sys 0.009s
W20260709 13:07:17.283214 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 787429us
I20260709 13:07:17.283761 12808 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.130168 12732 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:17.131431 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.270735 14879 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.307967 12806 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:17.308140 12732 pending_rounds.cc:85] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:17.312857 12732 pending_rounds.cc:107] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:17.227727 14825 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.313217 12732 raft_consensus.cc:2889] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:17.270766 14735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.045s	sys 0.065s
I20260709 13:07:17.122637 14899 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:17.335208 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51062us
I20260709 13:07:17.337211 12808 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 13:07:17.338402 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 217289us
I20260709 13:07:17.312206 14917 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:17.324745 14735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.045s	sys 0.066s
I20260709 13:07:17.317998 14879 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:17.358497 12729 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:17.308719 14925 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.219866 14765 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.301496 14840 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.347450 14905 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.382457 14899 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.389608 12875 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:17.358621 14870 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.393798 12730 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.365368 14767 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:17.410454 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 286280us
W20260709 13:07:17.411145 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 72122.3us
I20260709 13:07:17.406889 14870 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.427320 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 300487us
I20260709 13:07:17.428311 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.429631 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.426820 12808 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:17.434204 14918 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.367755 14917 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.434865 14764 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.435364 14924 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.435672 14764 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.437160 14917 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.437711 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:17.439157 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:17.439584 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.440646 14750 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.441071 14750 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.441411 14750 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.440311 14924 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.442142 14924 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.426384 14870 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.444199 14688 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:17.445199 14882 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.445729 14688 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.447343 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.446316 12725 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:17.451609 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:17.462292 12725 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:17.457362 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1678) took 1067 ms. Trace:
I20260709 13:07:17.465835 12801 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:17.464401 12875 rpcz_store.cc:276] 0709 13:07:16.390396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.430936 (+ 40540us) service_pool.cc:224] Handling call
0709 13:07:17.457017 (+1026081us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400139054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:17.457262 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202163584}
I20260709 13:07:17.450789 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:17.448808 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.474243 12802 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:17.474609 12730 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:17.418259 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77309.5us
I20260709 13:07:17.480374 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:17.481271 13520 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:17.410846 14866 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:17.489501 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:17.490175 12728 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.490607 12807 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:17.454784 14575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.146s	sys 0.134s
I20260709 13:07:17.416580 14859 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.484797 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:17.427817 14900 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:17.447376 14874 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:17.511319 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81770.5us
I20260709 13:07:17.512557 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.495070 12804 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:17.479153 14816 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:17.426755 14950 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:07:17.525283 14859 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.427482 14767 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:07:17.528306 14900 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.530004 14561 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.530485 14900 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.532384 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:17.527771 14582 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.533116 12729 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:17.535457 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 50739.5us
I20260709 13:07:17.542213 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.543186 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:17.520376 14575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.148s	sys 0.135s
I20260709 13:07:17.524868 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.492408 14871 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.550522 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.555823 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:17.536800 14757 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.004s
I20260709 13:07:17.515020 14917 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.601955 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 439721us
W20260709 13:07:17.590880 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.532991 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:17.532610 14918 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.535810 14830 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.596074 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.611435 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.601073 12803 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.571883 12731 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:17.523527 14878 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.472651 14920 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
W20260709 13:07:17.605252 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 96016.8us
I20260709 13:07:17.569972 14882 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.547396 14905 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.530509 14561 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.615513 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:17.620503 12729 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:17.622568 12804 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:17.508589 14897 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:07:17.622110 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:17.647436 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:17.648295 12729 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:17.569032 14859 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.594622 14881 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.506693 14866 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.642050 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:17.609266 14493 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.000s
I20260709 13:07:17.657428 12804 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.614212 14898 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.613804 14930 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.138s
I20260709 13:07:17.475659 14879 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.624830 14825 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.661162 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.663938 12728 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:17.634188 14717 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.675253 14717 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.647805 14767 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.676491 14951 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:07:17.676338 14767 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:17.677093 14919 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.677234 14765 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:17.677963 14948 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:17.678792 14767 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.665329 14935 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.679152 14936 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.682344 14717 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:17.651247 14878 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:17.676450 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:17.685243 14949 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:07:17.684887 14878 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.671902 14918 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.674100 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:17.665267 14493 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:17.687225 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:17.687958 12808 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:17.688886 12808 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.688973 14871 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.678803 14930 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.689675 14871 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:17.689500 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:17.684932 12807 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:17.690701 13520 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:17.690867 14871 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.690104 14930 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:17.671285 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:17.605453 14757 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.676379 14889 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.614424 14917 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.644268 14921 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:07:17.623641 14830 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.691571 12807 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:17.863948 13512 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:17.850574 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:17.868286 12806 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.868710 13516 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.870539 14924 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:17.852795 14911 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:17.872829 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 201778us
I20260709 13:07:17.873960 12696 leader_election.cc:400] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:17.874571 14930 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.908484 14830 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:17.853863 14943 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:07:17.651986 14905 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.917557 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 703) took 1276 ms. Trace:
W20260709 13:07:17.791967 14660 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.008s
I20260709 13:07:17.885169 14871 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.747762 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:17.666083 14898 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:17.658597 14881 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.693250 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 709) took 1046 ms. Trace:
I20260709 13:07:17.668073 14840 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:17.800393 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51976.9us
I20260709 13:07:17.889431 14866 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.890291 14889 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.719792 14920 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:17.745995 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1641) took 1062 ms. Trace:
W20260709 13:07:17.720414 14758 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.970s	user 0.009s	sys 0.006s
I20260709 13:07:17.937397 12733 rpcz_store.cc:276] 0709 13:07:16.647016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.856360 (+209344us) service_pool.cc:224] Handling call
0709 13:07:16.856855 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:16.982463 (+125608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.982501 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:16.986420 (+  3919us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.039052 (+ 52632us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:17.076810 (+ 37758us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.094013 (+ 17203us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.094240 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.249592 (+155352us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400430dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:17.249655 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.409485 (+159830us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b1800447d00. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f45ac758f 00007f0f3eb06571 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd
0709 13:07:17.692997 (+283512us) raft_consensus.cc:1685] finished
0709 13:07:17.693022 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.693187 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324353,"prepare.queue_time_us":120348,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":56308,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":34879,"spinlock_wait_cycles":239054592,"thread_start_us":39063,"threads_started":1,"wal-append.queue_time_us":326071}
I20260709 13:07:17.893049 12804 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:17.821991 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.906076 14924 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:17.720628 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:17.946305 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 225781us
I20260709 13:07:17.688896 14493 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.855450 14561 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.918241 12726 rpcz_store.cc:276] 0709 13:07:16.640745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.640887 (+   142us) service_pool.cc:224] Handling call
0709 13:07:16.678162 (+ 37275us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.124346 (+446184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.124387 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.125176 (+   789us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.233048 (+107872us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:17.547472 (+314424us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:17.600025 (+ 52553us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.600572 (+   547us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.600775 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.600893 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.917148 (+316255us) raft_consensus.cc:1685] finished
0709 13:07:17.917188 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.917446 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255873,"prepare.queue_time_us":116955,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":65394,"raft.run_cpu_time_us":3630,"raft.run_wall_time_us":512868,"spinlock_wait_cycles":76838656,"thread_start_us":867441,"threads_started":2,"wal-append.queue_time_us":533681}
I20260709 13:07:17.907343 14757 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.939813 12803 rpcz_store.cc:276] 0709 13:07:16.683255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.683412 (+   157us) service_pool.cc:224] Handling call
0709 13:07:16.716277 (+ 32865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.624636 (+908359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.745552 (+120916us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:17.745898 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005576448}
W20260709 13:07:17.942088 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 67222.3us
I20260709 13:07:17.958078 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:17.916139 14877 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.000s
I20260709 13:07:17.971397 14698 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.972123 14698 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.974857 14698 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.977993 14764 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:17.978295 14740 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.735s	user 0.013s	sys 0.000s
I20260709 13:07:17.979369 12724 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:17.857010 14870 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:17.930390 14937 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.004s
I20260709 13:07:17.950711 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:17.915720 14900 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.956216 14920 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.982107 14937 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.982509 14900 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:17.984138 14920 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:17.960384 14898 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.985201 14898 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.985499 14900 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:17.943153 14881 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.987946 13520 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:17.961627 14905 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.955742 14908 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.989773 14908 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.990221 14908 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.990267 14945 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.963155 14889 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.955883 14758 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.992461 14830 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.993095 14830 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.994025 14758 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.994783 14758 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.960427 14924 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:17.995291 14830 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.996104 14924 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:17.997252 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:17.998888 12805 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.998786 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:18.000530 14493 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.001293 14493 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.001981 14859 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:18.005095 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:18.008431 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:18.009722 12804 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:18.009991 12801 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:18.012706 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:18.019903 14905 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.020956 14905 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:18.024296 14905 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:18.039346 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.041291 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.042724 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.044286 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.044649 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.045756 12802 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:18.046126 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:18.047024 12804 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.053233 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:18.054402 14698 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.054932 14698 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.055408 14698 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.061988 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:18.064373 14816 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:18.065539 14816 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:18.080174 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 67594.6us
I20260709 13:07:18.080370 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:18.084463 12802 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:18.085529 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.088510 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.089135 12799 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:18.089316 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.087826 12801 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:18.089967 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:18.086232 12802 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:18.092559 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 470520us
I20260709 13:07:18.096158 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.097316 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:17.992532 13514 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:18.002601 14859 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:17.935299 14660 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.178470 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:18.126410 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.193400 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:18.230798 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.244794 12806 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:18.152588 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.193602 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.245633 12724 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:18.159219 12804 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:18.237200 12773 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.543s (SENT) [suppressed 45 similar messages]
I20260709 13:07:18.158413 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.076505 14740 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.247110 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.251972 13521 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:18.255615 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.265463 12729 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:18.273677 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.274022 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.274456 12799 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:18.098554 14561 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.195582 14968 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.089982 14889 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:18.284109 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:18.256240 14874 consensus_meta.cc:287] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
I20260709 13:07:18.099498 14937 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:17.995285 14758 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.099977 14840 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.289527 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:17.946476 14901 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:18.303257 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.284586 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:18.332118 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47606.9us
I20260709 13:07:18.333846 14816 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.334780 14816 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:18.314059 14874 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.336902 14874 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:18.337452 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.339457 14940 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.339962 14940 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.301781 14964 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:18.099188 14876 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.211s
I20260709 13:07:18.305490 12724 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:18.159125 14900 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:18.312803 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:18.255894 14909 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:18.321344 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.293725 14917 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:18.273224 14740 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.158002 14582 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:07:18.088358 14715 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260709 13:07:18.162765 12732 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:07:18.306442 12731 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 13:07:18.344027 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:18.325973 14925 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.005s
I20260709 13:07:18.320583 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.442080 12730 raft_consensus.cc:2368] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:18.357734 12725 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:18.356653 14869 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.360428 12803 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:18.335431 14816 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.309458 14959 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:18.429483 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.302817 14877 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:18.303293 14748 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:07:18.295444 13516 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:18.368216 14900 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:18.290541 14866 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:07:18.340308 14940 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.296905 14870 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:07:18.294811 14905 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:07:18.328447 14840 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:18.432859 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.358700 14920 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.385389 14750 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.003s
I20260709 13:07:18.446529 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.312269 14889 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:18.384462 14740 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.446972 12806 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:18.454115 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.337517 14874 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.308393 14968 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.359517 14921 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:07:18.391084 14679 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:07:18.444837 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 100890us
I20260709 13:07:18.513754 14959 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:18.530392 14951 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:07:18.466133 14930 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.005s
I20260709 13:07:18.519574 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.447878 14582 consensus_queue.cc:1243] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:07:18.474494 14911 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
W20260709 13:07:18.504755 14924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.012s	sys 0.021s
I20260709 13:07:18.531553 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.567844 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.569635 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.571101 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.452138 14876 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.572276 14876 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.572832 14876 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.476078 14816 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.521719 14840 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.453541 14925 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.547981 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:18.555390 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 318214us
I20260709 13:07:18.536746 14920 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.561884 12724 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:07:18.607594 14908 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.002s
W20260709 13:07:18.565492 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.496618 12729 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:18.697427 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.698829 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.699510 12729 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.572026 12725 raft_consensus.cc:2368] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:07:18.701015 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.583142 14859 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.583839 14660 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.602387 14879 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.530009 14750 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.589885 14874 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:18.544653 12728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.055s	sys 0.104s
I20260709 13:07:18.752285 12729 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
W20260709 13:07:18.752671 12728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.056s	sys 0.105s
I20260709 13:07:18.562420 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 724) took 1113 ms. Trace:
I20260709 13:07:18.580543 14911 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.670655 12730 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:18.670653 12773 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.627s (SENT)
I20260709 13:07:18.688478 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.690083 14869 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.577203 14924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.012s	sys 0.022s
W20260709 13:07:18.742281 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.744082 12800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.022s
I20260709 13:07:18.588024 14561 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.758664 14924 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.757356 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:18.759326 14924 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.753886 12727 rpcz_store.cc:276] 0709 13:07:17.449402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.457779 (+  8377us) service_pool.cc:224] Handling call
0709 13:07:17.458300 (+   521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.546279 (+ 87979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.546325 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.546950 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.893882 (+346932us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.893950 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.894062 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.562158 (+668096us) raft_consensus.cc:1685] finished
0709 13:07:18.562183 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.562352 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76454,"raft.queue_time_us":76670,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":31119,"thread_start_us":279190,"threads_started":1,"wal-append.queue_time_us":496974}
I20260709 13:07:18.760231 14917 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.764084 14924 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:18.749559 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.765082 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.757761 12724 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 2.
I20260709 13:07:18.766444 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:18.766692 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.544886 14830 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.767031 12724 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.758111 14869 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:18.770553 14869 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:18.673453 14698 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.002s
I20260709 13:07:18.598153 14959 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.608907 14900 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:18.758687 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:18.782694 12800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.017s	sys 0.022s
I20260709 13:07:18.767947 12727 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:07:18.782199 12726 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:18.795462 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.796489 12730 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:18.779778 12724 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:18.797681 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.799377 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:18.771801 14951 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:18.577732 14930 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:18.803414 14679 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.804234 14679 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.753283 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.606557 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.605037 14889 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:18.810145 12729 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:18.745626 14859 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:18.760497 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89923.5us
I20260709 13:07:18.783771 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.840997 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.842505 13520 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:18.844349 12730 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:18.846678 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.767632 14830 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.851243 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:18.722708 14908 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:18.863353 12773 leader_election.cc:336] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.736s (SENT)
I20260709 13:07:18.863952 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:18.867506 12727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:18.868578 12727 raft_consensus.cc:606] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:18.869098 12727 raft_consensus.cc:614] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.781553 14698 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:18.885943 14898 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.004s
I20260709 13:07:18.887331 12805 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:18.889757 14750 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.870096 14889 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:18.891407 14972 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.282s	user 0.001s	sys 0.002s
I20260709 13:07:18.877547 14878 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.892359 14878 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:18.893910 14871 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.956s	user 0.011s	sys 0.003s
I20260709 13:07:18.893666 14878 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.895610 14878 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.897148 14740 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:18.899544 14968 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:18.900961 14977 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:07:18.901402 14971 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.461s	user 0.006s	sys 0.012s
I20260709 13:07:18.902364 14688 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.904803 12726 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:07:18.909487 14764 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.910069 14930 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.941025 12802 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:18.912367 14908 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:18.913043 12808 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:18.942620 12803 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:18.943792 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:18.850855 14859 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:18.921729 14970 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.466s	user 0.004s	sys 0.000s
I20260709 13:07:18.923106 14925 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:18.924793 14920 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:18.911334 14698 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:18.939662 14764 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:18.948925 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.039s	sys 0.059s
I20260709 13:07:18.873867 14679 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:18.923743 14758 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:18.970832 12773 leader_election.cc:336] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.024s (SENT)
I20260709 13:07:18.914848 14830 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:18.964622 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.039s	sys 0.059s
I20260709 13:07:18.976397 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:18.977849 12877 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:18.978248 12874 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:07:18.980299 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:18.976703 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:18.952802 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:18.940143 14688 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:18.995370 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:18.995793 12877 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:07:18.996348 12873 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:18.958813 12848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.019s	sys 0.018s
W20260709 13:07:18.997512 12848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.020s	sys 0.018s
W20260709 13:07:18.971495 12697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.007s
I20260709 13:07:18.996358 12879 raft_consensus.cc:2410] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:19.000504 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.001055 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.003965 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.005857 12877 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:18.999286 12697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.010s	sys 0.008s
W20260709 13:07:18.980351 12731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.030s
I20260709 13:07:18.957818 13514 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.982708 12875 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:19.028935 12731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.030s
I20260709 13:07:18.984292 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.029877 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 704) took 2388 ms. Trace:
I20260709 13:07:18.988734 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.030766 12874 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
W20260709 13:07:19.031035 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.991374 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.033268 12882 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:19.030263 12731 rpcz_store.cc:276] 0709 13:07:16.641122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.641346 (+   224us) service_pool.cc:224] Handling call
0709 13:07:16.679412 (+ 38066us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.192301 (+512889us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:17.195997 (+  3696us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.491726 (+295729us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.571515 (+ 79789us) log.cc:844] Serialized 574 byte log entry
0709 13:07:17.571730 (+   215us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.386511 (+814781us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.437461 (+ 50950us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.906431 (+468970us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b18002d4000. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ead42a6 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f
0709 13:07:18.907184 (+   753us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:19.029489 (+122305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.029595 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.029647 (+    52us) raft_consensus.cc:1685] finished
0709 13:07:19.029658 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.029818 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158437,"prepare.queue_time_us":4574,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":6075,"raft.queue_time_us":525453,"raft.run_cpu_time_us":3740,"raft.run_wall_time_us":398364,"spinlock_wait_cycles":134426240,"thread_start_us":1232296,"threads_started":3,"wal-append.queue_time_us":184263}
I20260709 13:07:18.967051 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:19.047405 12727 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:18.998142 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.048938 12873 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:18.998155 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 665088us
I20260709 13:07:19.008340 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.008147 14764 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.008926 14859 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.009109 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:19.048184 14940 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.006s
I20260709 13:07:19.010456 14740 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.012678 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:18.999723 13516 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.015715 14881 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.029s	user 0.013s	sys 0.000s
I20260709 13:07:19.016454 14925 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:19.026644 14980 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:19.026825 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 144) took 1018 ms. Trace:
I20260709 13:07:18.981755 14920 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.981519 14715 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:18.981673 14930 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:19.034992 14688 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.037752 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:18.974992 14876 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:18.993351 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.090047 12881 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.034224 12878 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:19.041752 12877 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:19.002665 14735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.018s
I20260709 13:07:19.033797 14493 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.066556 14959 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:19.061362 12879 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:19.052670 13512 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.012s
I20260709 13:07:19.082495 12880 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:19.072470 14764 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.050736 14840 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.056825 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.070152 14940 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.077422 14881 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.064618 14748 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:19.076566 14859 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:07:19.092902 14735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.018s
I20260709 13:07:19.102890 14688 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.112174 13512 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.013s
I20260709 13:07:19.080415 14920 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.130100 14840 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.080499 14980 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.092468 14968 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:19.106643 14911 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.089959 14930 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.081739 14925 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.131857 14968 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:19.142688 14982 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:19.140782 14968 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.158962 14982 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.172669 14980 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.141645 14911 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.188235 14940 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.184629 14968 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.199311 14968 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.190142 14982 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.200620 14982 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.239188 12698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.010s
W20260709 13:07:19.240327 12698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.004s	sys 0.010s
I20260709 13:07:19.240985 12725 raft_consensus.cc:2368] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:19.063598 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:19.037588 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 168) took 1098 ms. Trace:
W20260709 13:07:19.246258 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.244551 12728 rpcz_store.cc:276] 0709 13:07:17.939392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.940316 (+   924us) service_pool.cc:224] Handling call
0709 13:07:17.963080 (+ 22764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.963569 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.963605 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.011228 (+ 47623us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.753393 (+742165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.753499 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.753612 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.037340 (+283728us) raft_consensus.cc:1685] finished
0709 13:07:19.037360 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.037514 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1201,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":741706,"threads_started":1,"wal-append.queue_time_us":973323}
W20260709 13:07:19.248489 12732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.005s	sys 0.014s
I20260709 13:07:19.055624 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:19.249862 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 739) took 1058 ms. Trace:
I20260709 13:07:19.251313 12727 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.250379 12733 rpcz_store.cc:276] 0709 13:07:18.191620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.191865 (+   245us) service_pool.cc:224] Handling call
0709 13:07:18.251000 (+ 59135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.251432 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.295883 (+ 44451us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.719966 (+424083us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.757784 (+ 37818us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.757969 (+   185us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.758005 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.758078 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.249288 (+491210us) raft_consensus.cc:1685] finished
0709 13:07:19.249340 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.249654 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1466,"prepare.queue_time_us":44953,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":40104,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":15237,"thread_start_us":423535,"threads_started":1,"wal-append.queue_time_us":773730}
I20260709 13:07:19.060117 12731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:19.256855 12731 raft_consensus.cc:606] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:19.257416 12731 raft_consensus.cc:614] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:19.258529 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.051528 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 80748.5us
I20260709 13:07:19.023072 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:19.262029 12773 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.180s (SENT)
I20260709 13:07:19.077026 12800 rpcz_store.cc:276] 0709 13:07:18.008715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.008867 (+   152us) service_pool.cc:224] Handling call
0709 13:07:18.090387 (+ 81520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.090768 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:18.234157 (+143389us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.512123 (+277966us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b4800061158. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:18.788877 (+276754us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.789260 (+   383us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.789892 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.790058 (+   166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.790104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.790206 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.881266 (+ 91060us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4800061158. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:19.026357 (+145091us) raft_consensus.cc:1685] finished
0709 13:07:19.026395 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.026632 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143859,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":105,"raft.queue_time_us":8569,"raft.run_cpu_time_us":3782,"raft.run_wall_time_us":500744,"spinlock_wait_cycles":168317312,"thread_start_us":550461,"threads_started":1,"wal-append.queue_time_us":789009}
I20260709 13:07:19.264413 12727 pending_rounds.cc:85] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:19.264986 12727 pending_rounds.cc:107] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:07:19.249051 12732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.006s	sys 0.014s
I20260709 13:07:19.265386 12727 raft_consensus.cc:2889] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.265061 12733 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:07:19.062752 12845 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:19.268146 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 246712us
W20260709 13:07:19.281478 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 218700us
I20260709 13:07:19.281701 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:19.283114 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:19.269981 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.057233 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:19.288663 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 231410us
I20260709 13:07:19.290050 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:19.273644 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:19.293721 12733 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:07:19.295526 12733 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:19.295553 12848 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:19.301371 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 143) took 1440 ms. Trace:
W20260709 13:07:19.296195 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.302378 13512 rpcz_store.cc:276] 0709 13:07:17.860808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.860994 (+   186us) service_pool.cc:224] Handling call
0709 13:07:17.863594 (+  2600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.863812 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:18.076963 (+213151us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.298542 (+1221579us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.299849 (+  1307us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.300187 (+   338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.300266 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.300454 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.300604 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.300859 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10029,"prepare.queue_time_us":128336,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":11937,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":944195,"threads_started":2,"wal-append.queue_time_us":681695}
I20260709 13:07:19.263767 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1419) took 1013 ms. Trace:
I20260709 13:07:19.308493 12728 rpcz_store.cc:276] 0709 13:07:18.249797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.247475 (+997678us) service_pool.cc:224] Handling call
0709 13:07:19.262613 (+ 15138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.263232 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.263270 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.263361 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:19.263422 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.263502 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.263671 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.311622 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:19.316365 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:19.318202 14582 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.319293 14582 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.323081 14582 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.313190 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:19.354272 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:19.360509 14830 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.361104 14869 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.361692 14869 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:19.362363 14869 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.361881 14830 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.364346 14740 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.365057 14740 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.365527 14740 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.367154 14871 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:19.197086 14930 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.369366 14930 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.369762 14748 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:19.369977 14930 raft_consensus.cc:697] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.370538 14748 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.372488 14932 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:19.373278 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 60227.2us
I20260709 13:07:19.373580 14932 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.376544 14925 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.378257 14924 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.378836 14924 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.379369 14924 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.380247 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 54948.9us
I20260709 13:07:19.380481 14980 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:19.381140 14905 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.381999 14905 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:19.382671 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.379308 14940 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.384589 14940 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:19.386518 14940 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.185200 14881 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.388622 14920 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:19.389045 14991 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.389446 14877 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.390298 14877 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.182565 14876 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.393262 14889 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.391789 14877 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.394207 14889 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.323808 14582 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.398298 14582 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.360718 14750 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.400892 14750 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.401249 14750 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.406539 14758 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.443320 14991 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:19.451437 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 140105us
I20260709 13:07:19.456429 12879 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:19.464915 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.464226 12730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.018s
W20260709 13:07:19.465965 12730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.019s
I20260709 13:07:19.468408 14879 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:19.469511 14879 consensus_queue.cc:1243] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:19.473868 12881 raft_consensus.cc:2410] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:19.474735 14932 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.553278 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1427) took 1207 ms. Trace:
I20260709 13:07:19.551597 14688 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:19.647066 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 155960us
I20260709 13:07:19.543149 12724 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:19.630419 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 737) took 1524 ms. Trace:
W20260709 13:07:19.526134 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 111157us
I20260709 13:07:19.563174 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1443) took 1039 ms. Trace:
I20260709 13:07:19.656373 12733 rpcz_store.cc:276] 0709 13:07:18.496318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.345657 (+849339us) service_pool.cc:224] Handling call
0709 13:07:19.449453 (+103796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.535131 (+ 85678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.535190 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.535268 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.535323 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.535436 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.535638 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.481328 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:19.650108 12725 rpcz_store.cc:276] 0709 13:07:18.346155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.700729 (+354574us) service_pool.cc:224] Handling call
0709 13:07:19.552873 (+852144us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540038e354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:19.553154 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236731264}
I20260709 13:07:19.543396 14859 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:19.433794 14748 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.674510 14859 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:19.674305 14688 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.676249 14859 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.677048 14688 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.677690 14859 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:19.681882 13514 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.005s
I20260709 13:07:19.682642 13514 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:19.684113 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.687502 12875 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.559502 14758 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:19.689070 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.689075 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:19.689781 12881 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.552174 14493 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:19.628522 14905 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.692575 14493 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.694934 12878 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.697536 12731 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.683781 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.654943 12732 rpcz_store.cc:276] 0709 13:07:18.107063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.107208 (+   145us) service_pool.cc:224] Handling call
0709 13:07:18.107593 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.108086 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:18.339134 (+231048us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:18.521044 (+181910us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.409542 (+888498us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.449875 (+ 40333us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.548782 (+ 98907us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.549084 (+   302us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.574584 (+ 25500us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.583993 (+  9409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.629934 (+ 45941us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.630035 (+   101us) raft_consensus.cc:1685] finished
0709 13:07:19.630053 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.630318 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9065,"prepare.queue_time_us":344066,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":124957,"raft.run_cpu_time_us":4743,"raft.run_wall_time_us":180403,"spinlock_wait_cycles":65107712,"thread_start_us":810736,"threads_started":2,"wal-append.queue_time_us":644414}
I20260709 13:07:19.625058 14925 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:19.619190 14889 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.665064 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1446) took 1112 ms. Trace:
I20260709 13:07:19.698452 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1444) took 1196 ms. Trace:
I20260709 13:07:19.710624 12731 rpcz_store.cc:276] 0709 13:07:18.501934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.540774 (+1038840us) service_pool.cc:224] Handling call
0709 13:07:19.696521 (+155747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.698150 (+  1629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.698369 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:19.699903 13516 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.621s	user 0.001s	sys 0.018s
I20260709 13:07:19.640427 14735 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:19.712294 13516 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:19.712620 14735 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:19.712884 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.700454 14764 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.714449 14764 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:19.704782 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:19.715029 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.718019 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:19.714936 14764 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.715855 14982 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.729599 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.729768 14982 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:19.730540 14982 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.730584 12881 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.714438 14735 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.705605 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 743) took 1470 ms. Trace:
I20260709 13:07:19.731554 14735 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.674695 14911 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.709985 12724 rpcz_store.cc:276] 0709 13:07:18.547142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.541794 (+994652us) service_pool.cc:224] Handling call
0709 13:07:19.542492 (+   698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.654500 (+112008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.659063 (+  4563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.731863 14878 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.731904 12730 rpcz_store.cc:276] 0709 13:07:18.235190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.861710 (+626520us) service_pool.cc:224] Handling call
0709 13:07:18.864170 (+  2460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:18.864581 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.864618 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.868080 (+  3462us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.466715 (+598635us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.556027 (+ 89312us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.612572 (+ 56545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.612744 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.705312 (+ 92568us) raft_consensus.cc:1685] finished
0709 13:07:19.705344 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.705524 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8540,"prepare.queue_time_us":209849,"raft.queue_time_us":41199,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":2752,"spinlock_wait_cycles":51341568,"thread_start_us":663250,"threads_started":2,"wal-append.queue_time_us":787211}
I20260709 13:07:19.734771 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:19.748476 14740 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.750077 12730 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.708772 14925 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.752624 14740 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.721130 14493 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.724491 14869 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:19.691839 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:19.757416 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 65893.6us
I20260709 13:07:19.730851 12878 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:07:19.759611 14889 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:19.760753 14889 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:19.762179 14889 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:19.737735 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.691793 14758 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.702992 14830 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:19.733395 12724 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:19.746608 14991 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:19.747653 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:19.757767 14878 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.762905 14735 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:19.736667 14750 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:19.666878 12873 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.012s
I20260709 13:07:19.825438 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1458) took 1046 ms. Trace:
I20260709 13:07:19.768651 12729 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:19.837424 12878 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:19.863659 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.838559 12724 rpcz_store.cc:276] 0709 13:07:18.779395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.732507 (+953112us) service_pool.cc:224] Handling call
0709 13:07:19.733071 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.825129 (+ 92058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.825370 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.888252 12880 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:19.899515 12879 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.904009 12873 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:19.831516 14878 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:19.914526 12875 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:19.920694 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.889480 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:19.935456 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.935570 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.955086 12876 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:19.957827 12733 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:19.958638 12733 pending_rounds.cc:85] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:19.958964 12733 pending_rounds.cc:107] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:07:19.961622 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.920471 14878 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.965397 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:19.523240 14930 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:20.000869 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 162919us
I20260709 13:07:19.963174 12733 raft_consensus.cc:2889] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.955945 14582 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:20.007203 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 272614us
I20260709 13:07:20.006003 12880 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:20.010396 14750 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:20.012260 14911 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.012434 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1437) took 1533 ms. Trace:
I20260709 13:07:20.013010 14911 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.012974 12727 rpcz_store.cc:276] 0709 13:07:18.479473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.262980 (+783507us) service_pool.cc:224] Handling call
0709 13:07:19.263723 (+   743us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.267484 (+  3761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.267524 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.274137 (+  6613us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.413261 (+139124us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:19.854199 (+440938us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.011815 (+157616us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.012073 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.012160 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.012198 (+    38us) raft_consensus.cc:1685] finished
0709 13:07:20.012210 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.012366 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175332,"prepare.queue_time_us":253921,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":234721,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":350,"thread_start_us":496307,"threads_started":2,"wal-append.queue_time_us":189855}
I20260709 13:07:20.015497 14911 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.011266 12875 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:20.022797 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.029798 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.006888 14991 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:20.043861 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.037585 14924 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.000s
I20260709 13:07:20.069943 14660 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.070226 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.073603 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1449) took 1513 ms. Trace:
I20260709 13:07:20.076263 12881 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:20.077678 12873 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.082079 12875 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:20.027226 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:20.092648 13516 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:20.098110 15008 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:20.105140 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.106846 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.107872 12875 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:20.109042 14982 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.110960 14924 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.116276 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:20.074576 12732 rpcz_store.cc:276] 0709 13:07:18.560526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.702694 (+1142168us) service_pool.cc:224] Handling call
0709 13:07:19.703177 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.703614 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:19.705579 (+  1965us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.045939 (+340360us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.047594 (+  1655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.047666 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.073021 (+ 25355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.073149 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.073342 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169991,"prepare.queue_time_us":33782,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":141876,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":25646,"spinlock_wait_cycles":7440128,"thread_start_us":169110,"threads_started":1,"wal-append.queue_time_us":246521}
I20260709 13:07:20.128696 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1448) took 1575 ms. Trace:
I20260709 13:07:20.144475 12733 rpcz_store.cc:276] 0709 13:07:18.553556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.827109 (+1273553us) service_pool.cc:224] Handling call
0709 13:07:19.957307 (+130198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.128350 (+171043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.128609 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.129550 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.128716 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.167191 12880 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
W20260709 13:07:20.171896 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 122353us
I20260709 13:07:20.173861 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:20.175143 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.176363 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1433) took 1719 ms. Trace:
I20260709 13:07:20.182695 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.187252 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.196552 12876 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:20.197389 12873 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:20.181828 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.181885 14982 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:20.189508 14830 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.207567 14830 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.189199 14758 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:20.208961 12875 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:20.149454 14991 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.195364 12726 rpcz_store.cc:276] 0709 13:07:18.456387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.250729 (+794342us) service_pool.cc:224] Handling call
0709 13:07:19.251391 (+   662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.266448 (+ 15057us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.434580 (+168132us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.004920 (+570340us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.028425 (+ 23505us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.028609 (+   184us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.048353 (+ 19744us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.048621 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.048715 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.175843 (+127128us) raft_consensus.cc:1685] finished
0709 13:07:20.175874 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.176120 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121620,"prepare.queue_time_us":337406,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":19593,"raft.queue_time_us":145504,"raft.run_cpu_time_us":616,"raft.run_wall_time_us":81907,"thread_start_us":593403,"threads_started":2,"wal-append.queue_time_us":684680}
I20260709 13:07:20.240693 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:20.205809 15008 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:07:20.208020 14830 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.175983 14924 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.263028 14898 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.264200 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.278486 12880 raft_consensus.cc:2376] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4. Re-sending same reply.
I20260709 13:07:20.278715 12882 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:20.208609 14758 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.265964 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:20.271839 14698 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:20.272547 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 45419.8us
I20260709 13:07:20.192932 14764 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.286198 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.295796 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.268498 14925 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:20.301745 14660 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.302445 14660 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.305856 14932 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.306615 14932 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:20.283108 14758 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.313423 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.310328 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.312969 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:20.323750 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.326040 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.326273 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:20.323762 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 155035us
I20260709 13:07:20.318964 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1442) took 1838 ms. Trace:
I20260709 13:07:20.334164 14991 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.335035 12877 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.337458 14898 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.339097 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.322072 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:20.307998 14932 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.343459 14932 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.327744 12728 rpcz_store.cc:276] 0709 13:07:18.480931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.309677 (+828746us) service_pool.cc:224] Handling call
0709 13:07:19.310321 (+   644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.311090 (+   769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.311118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.311811 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.617504 (+305693us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.838280 (+220776us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.010039 (+171759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.010134 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.318708 (+308574us) raft_consensus.cc:1685] finished
0709 13:07:20.318728 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.318897 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168597,"prepare.queue_time_us":59483,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":242568,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":209,"thread_start_us":444674,"threads_started":2,"wal-append.queue_time_us":594348}
I20260709 13:07:20.365732 14925 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.369765 14925 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.372812 14925 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.373968 12729 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:20.347067 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:20.377758 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:20.380720 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.383080 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.387485 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:20.389129 13514 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:20.367241 14898 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.393002 14764 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:20.393273 14898 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.393797 14898 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.394958 14898 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:20.397728 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.380666 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.391729 14869 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:20.332121 14878 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.404839 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.405982 12728 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:20.406158 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.410404 12729 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:20.417539 14878 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:20.422601 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:20.425115 14925 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.426275 14925 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:20.429335 14925 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.438441 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:20.440550 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 198024us
I20260709 13:07:20.451479 14925 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.453078 15022 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.453353 14924 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.457273 14925 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.478595 14924 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.489084 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 180) took 1057 ms. Trace:
I20260709 13:07:20.489820 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:20.489670 12727 rpcz_store.cc:276] 0709 13:07:19.433419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.014910 (+581491us) service_pool.cc:224] Handling call
0709 13:07:20.015315 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.015620 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:20.046291 (+ 30671us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.488705 (+442414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.488762 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.488818 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.488905 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.489022 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154196,"prepare.queue_time_us":30341,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3181,"thread_start_us":249888,"threads_started":1}
W20260709 13:07:20.493391 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.494206 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.492190 14698 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:20.503099 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 158194us
I20260709 13:07:20.453177 12628 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.509464 12628 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 5, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 5 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.511782 12628 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.513757 12628 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:20.520147 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.504371 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.514031 14830 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:20.525616 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.568316 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.577217 12724 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.592295 13516 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.595323 14878 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.596828 15028 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.597869 15028 consensus_queue.cc:1243] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:20.597615 15029 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.598528 15028 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.599004 15028 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.575505 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:20.535380 14698 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.625564 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:20.497648 15022 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.600576 15028 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.648887 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.650467 15028 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.651262 12728 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:20.670993 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 153324us
I20260709 13:07:20.626616 14924 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.522197 12628 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.674181 12729 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:20.676182 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 245693us
I20260709 13:07:20.677996 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.655507 14830 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.685930 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:20.660993 15031 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:20.691793 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.663317 14991 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.687631 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:20.696236 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.684306 14925 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.710783 14758 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.716159 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:20.716254 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.724291 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48148us
I20260709 13:07:20.725000 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:20.727397 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:20.728272 14925 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.692108 14924 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.707238 14740 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.707904 14991 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.764000 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.764961 12877 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.766086 14991 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.744333 14660 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.770560 14660 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:20.772624 12803 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:20.773674 12877 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:20.774276 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.774631 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.775274 12877 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.777407 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.778458 12878 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:20.779402 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.780519 12875 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:20.780658 14758 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.763811 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.792721 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.793777 12880 raft_consensus.cc:2376] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6. Re-sending same reply.
I20260709 13:07:20.794929 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.796691 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:20.798821 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.798842 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.799983 12881 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:20.797679 12876 raft_consensus.cc:2376] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5. Re-sending same reply.
I20260709 13:07:20.803725 12724 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:20.807394 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.808202 12873 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:20.808722 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.809427 12879 raft_consensus.cc:2376] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6. Re-sending same reply.
I20260709 13:07:20.813335 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.817829 12808 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:20.818048 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.818821 12801 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.821805 14991 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.824604 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.825800 12802 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:20.826740 12877 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:20.828783 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.829185 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.829782 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:20.830634 12799 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:20.814399 12874 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:20.783396 15031 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.746626 14925 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.842552 12728 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:20.845567 13521 raft_consensus.cc:2410] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:20.847957 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 172804us
W20260709 13:07:20.860749 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.832792 15037 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.783751 14924 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.835222 14740 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.876013 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.878443 14740 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:20.879201 14740 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.879410 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:20.881067 15028 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:20.881742 15028 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.843093 15031 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.842551 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:20.887873 12801 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:20.890833 15042 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.891495 15042 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.893855 15042 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.894375 15042 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.894853 15042 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.897045 15022 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.898284 15043 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.899330 15043 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.900056 14925 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.900739 14925 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:20.901432 14925 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.902820 15043 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:20.906899 15027 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.378s	user 0.005s	sys 0.001s
I20260709 13:07:20.908123 15029 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.909391 15029 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.909848 15029 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.910962 15029 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.920648 13514 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.922014 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.887914 15031 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.936808 14924 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.879839 14740 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:20.883865 15028 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:20.949074 12628 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 3, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.955073 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:20.956490 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.956691 14932 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:20.957521 14932 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:20.883718 14889 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:07:20.957435 13516 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:20.959141 15039 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.960209 14889 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:20.961244 12800 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:20.962256 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:20.963231 12773 leader_election.cc:400] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:20.963558 14932 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:20.964313 14991 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.965214 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.963593 12773 leader_election.cc:403] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.967018 12800 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:20.963747 14830 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.968350 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.968845 12805 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:20.969345 12807 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.969600 15037 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.970115 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:20.957440 14764 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:20.971216 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.967058 12808 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.973704 12808 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.967607 12800 pending_rounds.cc:85] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:20.975250 12800 pending_rounds.cc:107] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:20.975579 12800 raft_consensus.cc:2889] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.967549 14991 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:07:20.959950 15039 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:20.973968 15029 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.024964 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 325100us
I20260709 13:07:21.036221 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:21.036020 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:20.968375 14830 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:21.024147 12628 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.044178 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:21.046427 12729 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:20.959205 14758 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 13:07:21.050784 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.054199 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:21.049207 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:21.062877 12874 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.008582 14869 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.073828 12882 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.021274 14924 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.010079 14925 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.084632 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:21.088953 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.090651 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:21.095515 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.096372 12877 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:21.098658 12628 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 3, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.015659 15028 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:07:21.073695 15043 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:21.111038 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.039760 14764 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:21.116108 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.116254 12728 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:20.984556 14898 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 13:07:21.125108 12731 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:21.135159 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:21.140542 12728 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.140513 15043 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.104290 14925 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:21.100979 15048 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:21.093653 14924 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.107204 14869 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.585680 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:21.586686 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:21.245149 14830 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:21.587515 12728 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:21.285669 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 315067us
W20260709 13:07:21.404101 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.387328 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.568892 14764 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:21.449795 14889 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:07:21.321722 14991 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:21.321336 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 235234us
I20260709 13:07:21.592485 15048 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.222352 12628 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.321385 12874 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:21.290226 12807 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:21.233686 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:21.169072 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:21.521003 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.142458 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:21.317409 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:21.613889 12879 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.310985 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 275852us
I20260709 13:07:21.597119 12728 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:21.416214 12730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:21.615346 12730 raft_consensus.cc:606] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:21.198418 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:21.386198 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.617017 12732 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.408880 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.357167 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.358870 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.234489 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.169476 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.384960 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 161) took 10784 ms. Trace:
I20260709 13:07:21.581645 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:21.207108 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 132368us
I20260709 13:07:21.623047 12724 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:21.389390 12727 pending_rounds.cc:85] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:21.624239 12727 pending_rounds.cc:107] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 13:07:21.624629 12727 raft_consensus.cc:2889] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.355772 12882 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:21.625895 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.619169 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.628686 12874 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7. Re-sending same reply.
I20260709 13:07:21.594045 14898 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.439205 15047 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.639333 15047 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:21.640003 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:21.637710 14898 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:21.638361 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:21.645557 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:21.648686 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.648845 12882 raft_consensus.cc:2368] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6.
I20260709 13:07:21.638741 14830 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.641135 15029 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.010s
I20260709 13:07:21.233973 14740 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.636364 12724 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:21.653687 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.130954 15045 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:21.392480 15043 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:21.644279 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.675923 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.677577 12882 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:21.652820 12881 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:21.653375 15063 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.678139 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 75820us
I20260709 13:07:21.657498 12880 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:07:21.654239 15037 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.001s
I20260709 13:07:21.658478 14740 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.659773 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.653945 15049 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:21.143112 14698 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.523s
I20260709 13:07:21.674831 12728 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.650804 12628 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.631995 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:21.659498 15031 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.004s
I20260709 13:07:21.655514 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.680013 12877 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:21.694052 12873 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:21.626730 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:21.678951 12880 pending_rounds.cc:85] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:21.699072 12880 pending_rounds.cc:107] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:21.699440 12880 raft_consensus.cc:2889] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.688635 12874 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:21.681001 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:21.694795 14740 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.701539 14750 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.708860 14750 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:21.709623 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77748.8us
I20260709 13:07:21.710687 14898 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.711946 15059 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.712411 14898 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.712802 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:21.713425 15060 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:21.714383 15060 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.714511 15067 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.715368 15060 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:21.715739 15067 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.716504 15067 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.713006 15059 consensus_queue.cc:1243] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:21.682518 15047 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.680960 14982 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.650995 14925 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.717057 15060 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.770375 12725 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:21.778650 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.794387 12726 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.766830 15029 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.642228 15039 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:07:21.801765 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 119867us
I20260709 13:07:21.729373 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:21.684341 14878 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.684875 15037 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:21.650269 14991 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:21.729519 12879 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:21.803821 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.802976 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81412.3us
W20260709 13:07:21.802708 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 117488us
I20260709 13:07:21.807253 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:21.696245 15063 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.692999 15045 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.834264 12804 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:21.813580 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:21.702688 15031 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.782075 14982 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.819654 12808 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.836272 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:21.850448 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:21.806823 15043 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.792647 14930 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:21.717564 15049 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.853644 12728 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:21.817236 15060 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.621853 12627 rpcz_store.cc:276] 0709 13:07:10.397883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.398094 (+   211us) service_pool.cc:224] Handling call
0709 13:07:21.143232 (+10745138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:17.342324 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:17.506349 (+164025us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:17.516970 (+ 10621us) write_op.cc:435] Acquired schema lock
0709 13:07:17.524170 (+  7200us) tablet.cc:662] Decoding operations
0709 13:07:17.682348 (+158178us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:17.682426 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:17.682458 (+    32us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:07:17.684020 (+  1562us) tablet.cc:701] Row locks acquired
0709 13:07:17.724710 (+ 40690us) write_op.cc:260] PREPARE: finished
0709 13:07:17.809177 (+ 84467us) write_op.cc:270] Start()
0709 13:07:17.916255 (+107078us) write_op.cc:276] Timestamp: P: 1783602437772874 usec, L: 0
0709 13:07:17.916301 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:07:17.954011 (+ 37710us) log.cc:844] Serialized 8104 byte log entry
0709 13:07:19.188879 (+1234868us) op_driver.cc:464] REPLICATION: finished
0709 13:07:19.199179 (+ 10300us) write_op.cc:301] APPLY: starting
0709 13:07:19.199256 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:19.199727 (+   471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:19.199845 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:19.202047 (+  2202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:19.202337 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:07:19.202388 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:19.202785 (+   397us) log.cc:844] Serialized 138 byte log entry
0709 13:07:19.203191 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.203469 (+   278us) write_op.cc:454] Released schema lock
0709 13:07:19.203665 (+   196us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:19.204169 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.204205 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2274,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":10002,"apply.run_cpu_time_us":4662,"apply.run_wall_time_us":4916,"num_ops":20,"prepare.queue_time_us":879822,"prepare.run_cpu_time_us":16330,"prepare.run_wall_time_us":848793,"raft.queue_time_us":295443,"raft.run_cpu_time_us":3270,"raft.run_wall_time_us":4382,"replication_time_us":1259052,"thread_start_us":1113126,"threads_started":4,"wal-append.queue_time_us":622793,"wal-append.run_cpu_time_us":37482,"wal-append.run_wall_time_us":1626322}]]}
I20260709 13:07:21.874184 12801 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:21.802927 15029 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.883090 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:21.886138 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:21.820924 14878 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:21.895810 15074 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.896878 15063 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.897792 15048 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.884001 15039 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.918665 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:21.921262 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 70961.3us
I20260709 13:07:21.922437 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:21.922520 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:21.925457 12807 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:21.891368 14924 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:21.893994 14869 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:21.899189 14991 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:21.941721 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 212397us
W20260709 13:07:21.951848 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 115670us
I20260709 13:07:21.890475 15043 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:21.976156 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.985618 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63258us
I20260709 13:07:21.987604 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:21.988831 15057 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:21.990597 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:21.986482 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 43695.2us
I20260709 13:07:21.991719 12804 raft_consensus.cc:2410] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:07:21.962314 14869 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.961031 14764 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:22.002781 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.999802 12806 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.979493 14740 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.012336 15075 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:22.013935 15071 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:07:22.039831 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52322.7us
I20260709 13:07:22.054911 12732 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:22.005862 14925 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.072661 12729 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:22.079901 12806 raft_consensus.cc:1217] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-5.3]   Dedup: 2.2->[5.3-5.3]
W20260709 13:07:22.080411 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 389205us
I20260709 13:07:22.080669 12806 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:07:22.082876 15031 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:22.084764 15069 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.261s	user 0.000s	sys 0.009s
I20260709 13:07:22.088002 14878 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:22.089547 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.091038 12771 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.017282 15057 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:22.091818 15037 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.092269 14758 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.092775 15079 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.093068 15057 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.095255 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:21.999912 15048 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:07:22.096285 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.100016 12771 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:22.096171 15079 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.099359 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.105762 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 758) took 1135 ms. Trace:
I20260709 13:07:22.106063 12806 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.020713 15075 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:22.103536 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:22.028590 14750 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:22.021337 15065 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.016795 15084 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.024958 15045 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.092869 15037 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.131174 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.136153 15031 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.149470 15061 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.152974 15049 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.150871 15061 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:22.126499 14878 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:22.153729 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53805.5us
I20260709 13:07:22.154688 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:22.141180 15037 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:22.155741 15061 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:22.163074 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 260374us
I20260709 13:07:22.233115 15037 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.234555 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:22.234870 15037 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.235661 15061 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.141938 15029 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.236110 15061 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.236526 15061 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.113288 15075 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:22.236826 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82237.7us
I20260709 13:07:22.167301 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.118145 15079 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:22.238998 15079 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.168478 15031 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:22.240993 15031 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.169239 12808 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.243011 15029 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.243491 15029 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:22.243952 15029 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.245150 15061 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:22.170152 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 762) took 1048 ms. Trace:
W20260709 13:07:22.174995 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.175294 12806 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:22.177490 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.248931 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.178308 15042 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.248273 12727 rpcz_store.cc:276] 0709 13:07:21.121799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.121971 (+   172us) service_pool.cc:224] Handling call
0709 13:07:21.140159 (+ 18188us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:21.795918 (+655759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.795948 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:21.801524 (+  5576us) log.cc:844] Serialized 78 byte log entry
0709 13:07:21.926455 (+124931us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:21.926496 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.926569 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.169781 (+243212us) raft_consensus.cc:1685] finished
0709 13:07:22.169814 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.170069 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43030,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6477,"thread_start_us":221469,"threads_started":2,"wal-append.queue_time_us":156545}
I20260709 13:07:22.175294 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.259658 15061 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.260154 12799 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.175688 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.265233 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.266203 12805 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:07:22.267150 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:22.185073 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81648.6us
I20260709 13:07:22.268340 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.268865 15042 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:22.186517 14830 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 13:07:22.193964 14982 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:22.196102 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 760) took 1234 ms. Trace:
I20260709 13:07:22.271039 12805 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:22.271827 12808 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:22.202536 12804 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:22.106240 12803 rpcz_store.cc:276] 0709 13:07:20.960758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.976234 (+ 15476us) service_pool.cc:224] Handling call
0709 13:07:21.010885 (+ 34651us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:21.336982 (+326097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.337037 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:21.432902 (+ 95865us) log.cc:844] Serialized 52 byte log entry
0709 13:07:21.594454 (+161552us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:21.818199 (+223745us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.891717 (+ 73518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.891848 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.096381 (+204533us) raft_consensus.cc:1685] finished
0709 13:07:22.096404 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.096580 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14851,"prepare.queue_time_us":345239,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":7936,"raft.queue_time_us":252653,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":10205,"thread_start_us":528659,"threads_started":4,"wal-append.queue_time_us":197186}
I20260709 13:07:22.215178 15046 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.270959 12801 rpcz_store.cc:276] 0709 13:07:20.961381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.961958 (+   577us) service_pool.cc:224] Handling call
0709 13:07:22.195726 (+1233768us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54001b6054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:22.195942 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095018368}
I20260709 13:07:22.275880 12802 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:22.276332 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.217437 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:22.221941 15067 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
I20260709 13:07:22.167181 15043 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.231236 15074 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.254071 12726 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:22.258303 15084 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.249979 12724 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:22.269708 12800 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:22.269870 15042 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:22.198467 15085 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
I20260709 13:07:22.270081 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:22.282342 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 768) took 1316 ms. Trace:
I20260709 13:07:22.289077 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.314106 12801 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:07:22.315198 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.315938 12800 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:22.290135 12806 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.295871 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:22.300972 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52132.1us
I20260709 13:07:22.312145 12808 rpcz_store.cc:276] 0709 13:07:20.966237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.966356 (+   119us) service_pool.cc:224] Handling call
0709 13:07:20.966685 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.780819 (+814134us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000ea220. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b7106f 00007f0f41be9f60 00007f0f41beb7de 00007f0f41bf5b49 00007f0f41bf6416 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62
0709 13:07:22.168766 (+387947us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b58006f23d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b4f0aa 00007f0f41bd1447 00007f0f41be9fe7 00007f0f41beb7de 00007f0f41bf5b49 00007f0f41bf6416 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4
0709 13:07:22.281981 (+113215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.282265 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293231104}
I20260709 13:07:22.323004 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.325074 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.326346 12800 raft_consensus.cc:2393] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:22.327163 12801 raft_consensus.cc:2410] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:07:22.319155 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:22.294095 14878 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.267437 15075 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.330837 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:22.331646 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61654.7us
I20260709 13:07:22.335341 12801 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7. Re-sending same reply.
I20260709 13:07:22.332957 12799 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:22.314363 15049 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:22.341101 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 123840us
I20260709 13:07:22.343709 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.360728 12803 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:22.344637 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.339725 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.362139 12807 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:22.337306 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.347556 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 768) took 1223 ms. Trace:
I20260709 13:07:22.354409 12806 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:22.355409 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.357045 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:22.357143 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.365201 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.365950 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.366457 12806 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:22.358189 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 769) took 1206 ms. Trace:
I20260709 13:07:22.367791 12726 rpcz_store.cc:276] 0709 13:07:21.130329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.137561 (+  7232us) service_pool.cc:224] Handling call
0709 13:07:21.586499 (+448938us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:22.336364 (+749865us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540040ef54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:22.336486 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460771456}
I20260709 13:07:22.357998 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:22.369789 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.371268 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.362905 12799 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:22.372547 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.375138 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.339859 15076 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.308496 15042 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:22.367267 12805 raft_consensus.cc:2376] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5. Re-sending same reply.
I20260709 13:07:22.380338 12806 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:22.387346 12801 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:22.390383 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54510.8us
I20260709 13:07:22.385799 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:22.392616 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:22.392776 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.400669 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.401084 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.401598 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.333709 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:22.402688 12803 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:22.405367 12807 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:22.411044 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:22.406451 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.412225 12799 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:22.402313 12804 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:22.339334 15075 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:22.358655 15028 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.414469 13516 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:22.414997 15089 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.356699 14982 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.363324 12731 rpcz_store.cc:276] 0709 13:07:21.123953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.139016 (+ 15063us) service_pool.cc:224] Handling call
0709 13:07:21.140607 (+  1591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.880898 (+740291us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:21.962884 (+ 81986us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.291162 (+328278us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.293704 (+  2542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.293774 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:22.293954 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.341090 (+ 47136us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b18003f79c0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:22.346160 (+  5070us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003f79c0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ead42a6 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419
0709 13:07:22.347306 (+  1146us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540040ea54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:22.347352 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.347491 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278,"prepare.queue_time_us":50874,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":111,"raft.queue_time_us":9543,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":3526,"spinlock_wait_cycles":1741077248,"thread_start_us":313374,"threads_started":2}
I20260709 13:07:22.424798 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.413964 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.425868 12800 raft_consensus.cc:2376] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
W20260709 13:07:22.426308 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.419023 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:22.358906 14898 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:22.430287 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.431630 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.306916 15067 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.288961 15046 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:22.435128 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.432339 12804 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:22.435794 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.436697 12801 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:22.437145 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.439002 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.441164 15089 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:22.439863 14869 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.429168 15028 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.440955 14930 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.442235 15089 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:22.443358 14930 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.443790 14930 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:22.444553 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.445075 14898 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.445334 14930 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.446111 12696 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:22.446435 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.446856 14930 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.444383 15076 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:07:22.447214 14898 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.377202 15065 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:07:22.448431 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.448766 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.449226 12808 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:22.449653 12800 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:22.423792 15084 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.450506 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.450690 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.450953 15084 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.451517 15084 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.452526 14982 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:22.446915 15074 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.453743 14982 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.452540 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.456180 15021 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.456785 15028 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.448823 15042 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.457094 15021 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.457625 15021 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.457955 15042 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.458352 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.459298 15048 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.459851 15048 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:22.460116 15043 consensus_queue.cc:1175] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45825bb09c34201b13ddcec07c4b3f1" responder_term: 5 status { last_received { term: 4 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 2 } }
I20260709 13:07:22.460225 15049 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:22.460808 15048 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.461393 15029 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.462183 15049 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.360252 14878 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.456439 12806 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:22.415839 15047 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.433662 14750 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.463989 15029 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.479110 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.480247 15074 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.465211 14878 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:22.465919 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 129544us
I20260709 13:07:22.482419 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:22.451812 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.484189 12808 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:22.467226 15046 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.447860 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.468101 12800 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.485675 12805 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:22.469434 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.489475 12807 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 3: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:22.473601 14750 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:22.491693 14750 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.492595 14764 raft_consensus.cc:2764] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:22.494902 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.467628 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.474485 12801 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:22.500674 12802 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:22.477214 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 51421us
I20260709 13:07:22.499563 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:22.505211 12800 raft_consensus.cc:2410] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:22.507913 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.508216 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.510857 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.475576 15067 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:22.516462 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.472594 15047 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:22.510210 15074 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.512835 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:22.512215 14878 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.505295 15029 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:22.554574 15045 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.555358 15045 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:22.530493 15047 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.557055 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:22.529557 15042 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.535998 15075 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.542992 15074 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:22.569216 15074 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.569947 14878 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:07:22.567992 14925 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.581697 14925 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:22.568289 15045 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.582681 14925 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.560173 15067 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.585005 15067 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.589357 14982 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:22.589932 14982 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:22.594208 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.595651 15067 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:22.559922 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 119333us
I20260709 13:07:22.633481 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:22.639918 15075 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:22.618037 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0369534220000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 13:07:22.642799 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.643908 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.659938 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.640700 15075 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:22.666246 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.674384 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:22.675304 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 125734us
I20260709 13:07:22.676224 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:22.677666 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 120719us
I20260709 13:07:22.682618 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:22.684180 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:22.686550 12724 raft_consensus.cc:2410] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:22.699720 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:22.720166 14750 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.692653 15042 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.712580 14869 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.732689 15042 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:22.748306 12726 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:22.770458 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:22.768620 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 84040.8us
I20260709 13:07:22.772136 12731 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:22.769706 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:22.776676 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 112813us
W20260709 13:07:22.780076 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.774703 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73678.2us
I20260709 13:07:22.779629 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.755345 14869 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.784925 12802 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:22.786325 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:22.790266 12727 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.724207 14982 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.772778 15042 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.761775 14764 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:22.792091 12724 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:22.792454 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:22.800175 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:22.801827 15101 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
W20260709 13:07:22.804627 15093 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 13:07:22.791510 14878 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.785593 14925 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.772182 15075 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.792171 14869 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.816823 12731 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:22.818718 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:22.800658 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 87205.3us
I20260709 13:07:22.819911 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.825225 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:22.822391 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:22.826967 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.833539 12724 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:22.847113 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.853893 12804 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:22.855778 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.826694 15048 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.854907 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.860491 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.860752 12801 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:22.861294 12724 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:22.858343 12802 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:22.861979 12808 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:22.844446 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:22.832134 15049 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.822299 14925 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:22.839139 15067 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.869367 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.826634 15103 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:22.864688 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 184468us
I20260709 13:07:22.842444 15037 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.866904 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:22.879119 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.879901 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:22.848513 14878 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.881966 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:22.892095 12724 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:22.839915 15084 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:22.864114 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:22.860371 15048 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.895666 12803 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:22.868161 15045 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:22.908010 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44029.2us
I20260709 13:07:22.909694 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:22.911432 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:22.916189 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48313.7us
I20260709 13:07:22.909037 15048 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.895587 15103 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:22.971674 15102 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 13:07:22.884356 15067 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:22.911386 15045 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:22.896247 15037 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:23.006187 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.995204 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 112399us
W20260709 13:07:23.048498 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.066545 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:22.914062 15043 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:23.170607 14930 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.717s	user 0.015s	sys 0.011s
I20260709 13:07:23.144948 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:23.208766 12726 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.145498 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:23.148002 12728 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [6.2-6.2]
I20260709 13:07:23.147987 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:23.150506 15021 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.692s	user 0.014s	sys 0.014s
I20260709 13:07:23.151022 12725 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:22.887687 15109 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.901685 14764 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:07:23.168440 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 257081us
I20260709 13:07:23.172791 12727 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:07:23.184532 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.166217 15074 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.563s	user 0.019s	sys 0.006s
I20260709 13:07:23.195335 12724 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.182673 15045 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.237280 12727 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:22.915692 14925 raft_consensus.cc:2764] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:23.155583 15049 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.221956 12732 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.225131 12730 raft_consensus.cc:2393] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:23.226277 14930 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:23.252672 14930 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:23.225666 15021 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:23.255245 14930 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:23.256376 13520 raft_consensus.cc:2368] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:23.256816 15122 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:23.260538 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 94623us
I20260709 13:07:23.209069 15043 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:23.251822 15084 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:23.233011 13514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.001s	sys 0.023s
I20260709 13:07:23.234653 15110 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:23.322605 12730 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:23.309597 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 145743us
I20260709 13:07:23.244266 15049 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:23.247918 15109 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:23.281095 15043 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.245253 15074 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:23.337997 15021 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:23.339586 15042 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
I20260709 13:07:23.339339 15109 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:23.340368 15042 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.341770 12731 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:23.344313 14869 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.534s	user 0.014s	sys 0.007s
I20260709 13:07:23.344976 14869 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:23.346436 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.276906 12726 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
W20260709 13:07:23.368978 12773 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.543s (SENT)
I20260709 13:07:23.369668 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:23.329151 15049 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.302785 14878 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:23.329676 15110 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.339380 15074 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:23.377561 14925 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:23.374099 15103 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.402959 14925 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:23.406387 13484 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.686s (SENT) [suppressed 53 similar messages]
I20260709 13:07:23.436787 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:23.446557 12724 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:23.439917 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.441480 13484 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.209s (SENT)
W20260709 13:07:23.454968 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 193124us
I20260709 13:07:23.452648 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:23.427695 14982 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.468289 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:23.469449 12732 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:23.526073 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 191897us
W20260709 13:07:23.464694 15047 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.894s	user 0.019s	sys 0.014s
I20260709 13:07:23.516482 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:23.454227 15067 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:07:23.572075 12726 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.576151 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 202) took 1158 ms. Trace:
W20260709 13:07:23.577199 12773 leader_election.cc:336] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.573s (SENT)
W20260709 13:07:23.577843 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 127311us
I20260709 13:07:23.576606 13520 rpcz_store.cc:276] 0709 13:07:22.406495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.418577 (+ 12082us) service_pool.cc:224] Handling call
0709 13:07:23.564436 (+1145859us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54005febd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:23.564579 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906677120}
I20260709 13:07:23.577754 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:23.583025 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 141598us
W20260709 13:07:23.575742 15116 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.002s
W20260709 13:07:23.585378 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 358402us
I20260709 13:07:23.480427 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:23.592660 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 414191us
I20260709 13:07:23.593273 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:23.481182 14930 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.600786 12727 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:23.610726 12724 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:23.577404 14878 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.612911 14930 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.614154 15136 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.614609 15110 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:23.615617 15136 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.616344 14930 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:23.616302 15136 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.620639 15133 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.606333 15042 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:23.635711 12771 leader_election.cc:400] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:23.636600 12771 leader_election.cc:403] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:23.635674 12726 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:23.643086 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:23.649032 15137 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.579784 15047 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:23.654033 15074 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:23.656338 15075 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.658206 12874 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:23.658308 12873 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.659083 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.671644 12882 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.606056 14869 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:23.661511 12877 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.633615 15079 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.602494 15037 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:23.664536 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.690048 12879 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:23.676520 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.691921 12878 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:23.679010 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.662117 15042 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.679051 13520 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 5 LEARNER]: Advancing to term 6
W20260709 13:07:23.679901 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 79667.6us
I20260709 13:07:23.678272 15075 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.680120 14764 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:23.682276 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.811710 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:23.684559 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.686978 12881 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:23.688863 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.679239 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.815024 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:23.815551 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.813834 12876 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:23.789337 12873 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:23.692737 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:23.819413 12727 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:23.792568 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.820873 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:23.824635 12882 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:23.661882 15045 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.831477 12878 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:23.833294 15140 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.834075 15140 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:23.836287 15118 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:07:23.838326 12879 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.840946 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.843164 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.827265 14869 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.852684 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.859647 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.858884 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.829823 14925 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:23.864312 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.865695 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.867028 15075 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:23.869128 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.869792 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.693317 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.711117 15079 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.863834 14869 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:23.881554 12879 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:23.885388 12875 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:23.835327 15140 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:23.900908 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.903370 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.912364 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.913432 12882 raft_consensus.cc:2410] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:23.919310 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.920115 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.926826 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.929692 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.928360 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.931435 12875 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:23.930395 12873 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:23.933334 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.936866 12882 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:23.937315 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.937767 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.938344 12876 raft_consensus.cc:2376] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
I20260709 13:07:23.946576 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:23.948563 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:23.949350 12875 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:23.951005 12873 raft_consensus.cc:2410] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:23.956869 15131 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.958009 15131 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:23.958735 15094 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.959416 15094 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:23.961055 15094 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:24.009271 14982 consensus_meta.cc:287] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 13:07:24.009392 15113 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.013378 12728 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.013605 12873 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.014022 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.013084 15113 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.015303 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:24.016115 12807 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:24.016165 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.016861 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.023808 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:24.025024 12801 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:23.973519 12881 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:24.028155 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.028218 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.028367 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:24.029628 12733 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:24.032068 12802 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:07:24.034761 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:24.036947 12802 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:24.039352 12875 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.048943 12874 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:24.051323 12876 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:24.053439 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 128046us
W20260709 13:07:24.055583 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4423904570001014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:07:24.063457 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3802904570001147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:07:24.063933 12877 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
W20260709 13:07:24.064179 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3653217040000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2604s for a response
I20260709 13:07:24.066232 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:24.067862 12728 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.068665 12725 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:24.069569 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.070670 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.063388 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.074049 12731 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:24.066983 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:24.072695 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.070608 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:24.078399 12874 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:24.057360 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.081530 12728 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:24.085177 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.092113 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.063256 15106 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.093669 12733 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:24.076946 15075 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.079483 15074 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.099620 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.105913 12833 heartbeater.cc:646] Failed to heartbeat to 127.11.78.62:43083 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.78.62:43083 timed out after 15.000s (SENT)
I20260709 13:07:24.097605 15045 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.109249 15075 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.110426 15133 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.111999 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.113719 15144 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:24.115139 13514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 204) took 1479 ms. Trace:
I20260709 13:07:24.115583 13514 rpcz_store.cc:276] 0709 13:07:22.635636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.636418 (+   782us) service_pool.cc:224] Handling call
0709 13:07:22.669285 (+ 32867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.805181 (+135896us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800325900. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:23.020997 (+215816us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f3eae90ac 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060
0709 13:07:23.333066 (+312069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.355835 (+ 22769us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.575167 (+219332us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.829856 (+254689us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.840105 (+ 10249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.850463 (+ 10358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.114858 (+264395us) raft_consensus.cc:1685] finished
0709 13:07:24.114887 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.115059 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48645,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"spinlock_wait_cycles":10531968,"thread_start_us":797662,"threads_started":2,"wal-append.queue_time_us":289864}
I20260709 13:07:24.116400 13520 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:24.118490 15131 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.092020 15139 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.133522 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 76261.6us
I20260709 13:07:24.095765 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:24.154321 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.155400 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.132623 15136 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.161783 12875 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:24.063593 14869 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.132594 15131 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.186641 12875 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:07:24.188632 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53448.7us
I20260709 13:07:24.192585 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:24.193389 12877 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7. Re-sending same reply.
I20260709 13:07:24.202951 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.129555 15074 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.225687 15135 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.248535 12729 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.216475 15136 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:24.251086 15136 consensus_queue.cc:1243] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:24.251720 15136 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:24.252148 15136 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:24.253247 15136 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.254683 15136 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.217021 15037 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:24.257395 15037 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.257817 15037 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:24.259095 15113 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:24.212263 15029 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.259989 15029 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.262012 15075 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:24.262635 15029 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:24.263865 15147 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:07:24.266348 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:24.267932 15047 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.268857 14764 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.270648 14764 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.271075 14764 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.271482 14764 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.272724 14982 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:24.274763 12848 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:24.275683 14982 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:24.276158 14982 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.276592 14982 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.278231 12724 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:24.280751 15153 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:24.258736 15037 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.288021 12882 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:24.293964 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:24.294798 12879 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.296717 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:24.278606 15074 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.195739 15133 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:07:24.312996 15048 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.136s	user 0.008s	sys 0.008s
I20260709 13:07:24.336743 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:24.188251 15139 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.312052 15075 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.317462 15037 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.353789 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.364286 12724 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:24.361833 12730 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:24.349767 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:24.371402 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.372253 12727 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:24.383138 15118 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.370532 15075 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.387214 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:24.428748 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 225934us
I20260709 13:07:24.389917 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:24.390894 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.404418 12729 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.434405 12879 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:24.404837 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.401381 15049 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.017s	user 0.007s	sys 0.006s
W20260709 13:07:24.384123 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 319269us
W20260709 13:07:24.457562 12696 leader_election.cc:336] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.539s (SENT)
I20260709 13:07:24.439555 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.460988 12725 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
W20260709 13:07:24.468642 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.484512 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.413614 15113 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:24.492863 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0229904570001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:07:24.493713 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0049904570000763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:07:24.502446 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65200.2us
I20260709 13:07:24.349722 15048 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.514003 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:24.516633 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.518755 12725 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:24.401363 15118 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.531968 12725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:24.533689 12725 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.534551 12725 raft_consensus.cc:614] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:24.540184 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 190779us
I20260709 13:07:24.540524 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.542090 12731 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:24.508055 15113 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.458798 15135 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:07:24.547477 12725 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:24.459036 15029 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:07:24.552340 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.473996 15049 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.555382 12733 raft_consensus.cc:2410] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:24.543623 15137 consensus_meta.cc:287] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.004s
W20260709 13:07:24.572065 12773 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.674s (SENT)
I20260709 13:07:24.573423 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:24.578375 12698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.017s
W20260709 13:07:24.580120 12698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.018s
W20260709 13:07:24.580971 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.545676 15141 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.550143 15113 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.585301 12733 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:24.588094 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.536378 15133 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:07:24.578349 13484 leader_election.cc:336] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.558s (SENT)
I20260709 13:07:24.575229 15137 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
W20260709 13:07:24.587852 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 73980.1us
I20260709 13:07:24.616132 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.593206 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.619001 12733 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.619087 12881 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:24.623113 12696 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.635s (SENT)
I20260709 13:07:24.627825 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:24.618872 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:24.632283 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53981us
W20260709 13:07:24.641974 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.575831 15089 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.657157 12725 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.588572 15141 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.675393 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.680680 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.684233 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.645933 15046 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.664484 15122 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.659499 15029 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.651114 15135 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:24.663612 15141 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:24.698995 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 157787us
I20260709 13:07:24.682216 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:24.689011 15137 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.716111 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:24.694762 15074 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:24.668859 15089 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.741830 12725 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:24.728868 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.760736 15166 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:24.761987 15137 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.701468 15162 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:24.766906 12881 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:24.778154 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 220545us
W20260709 13:07:24.779181 12773 leader_election.cc:336] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.682s (SENT)
W20260709 13:07:24.782213 15161 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 13:07:24.710992 15135 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:24.779654 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:24.853802 15170 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:24.791733 15162 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.854506 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.855208 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.872431 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 103946us
I20260709 13:07:24.701818 15123 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:07:24.856458 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 141516us
I20260709 13:07:24.694034 15103 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:07:24.780375 15074 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.865839 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:24.880587 12728 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:24.862192 15043 consensus_meta.cc:287] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.484s	user 0.015s	sys 0.001s
I20260709 13:07:24.884435 15043 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.793931 15155 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.864735 15179 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:24.869120 15148 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.700s	user 0.007s	sys 0.000s
I20260709 13:07:24.789922 15061 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:24.766309 13516 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:24.909801 15061 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.702236 15094 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:24.712569 15122 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.857522 15048 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:24.860221 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 176128us
W20260709 13:07:24.896124 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.915302 15168 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
I20260709 13:07:24.916262 12696 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.917562 15048 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.917024 15135 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:24.918591 15135 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.918818 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.919893 15048 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.920444 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.921622 15103 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.922331 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.923026 15137 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:24.923415 15157 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.923843 15049 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.925109 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.926826 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:24.927757 15157 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.928247 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.928572 15157 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.929174 15157 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:24.929589 15157 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.930263 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:24.931600 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:24.936275 15079 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.875070 15118 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:24.977632 15049 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.939069 15157 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:24.978466 15049 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.956475 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 177351us
I20260709 13:07:24.979274 15049 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.959406 15180 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.976915 15155 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.985265 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:24.986289 12881 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:24.987284 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:24.960685 15131 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.766s	user 0.003s	sys 0.010s
I20260709 13:07:24.867419 15141 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:24.991209 15141 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:07:24.940707 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62453.1us
I20260709 13:07:24.947690 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1744) took 1069 ms. Trace:
I20260709 13:07:24.992771 12878 rpcz_store.cc:276] 0709 13:07:23.878559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.914921 (+ 36362us) service_pool.cc:224] Handling call
0709 13:07:24.947385 (+1032464us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54000c85d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:24.947574 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420353792}
I20260709 13:07:24.993901 15184 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.994571 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.960193 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.995566 12878 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:24.996464 12732 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:24.958691 15089 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.000674 15157 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:24.973629 15074 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:24.971906 15162 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:24.941054 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:25.023572 12733 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:24.987923 12881 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:25.026144 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.899544 12728 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:25.048834 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:24.976225 14982 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.699s	user 0.015s	sys 0.000s
I20260709 13:07:25.050529 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.062741 12733 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:25.051306 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:25.055905 12879 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:25.068123 12803 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:25.070947 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:25.046602 15170 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:07:25.057351 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:25.058729 15061 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.072016 12807 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:25.076449 12878 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:25.072926 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:25.075697 12801 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:25.104202 12806 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:25.056017 12808 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:25.100411 12881 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:25.107820 12799 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:25.111521 12879 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:25.120319 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 214320us
I20260709 13:07:25.046969 15139 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.123705 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:25.126153 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:25.134341 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.135521 12806 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:25.135808 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 155282us
I20260709 13:07:25.137125 12878 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:25.127599 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.107499 15037 consensus_meta.cc:287] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.002s
W20260709 13:07:25.142076 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 210587us
I20260709 13:07:25.046381 15049 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.147785 12696 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.148433 12802 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:25.107856 15074 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:25.149245 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:25.156976 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.068940 14982 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:25.165509 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.167248 12773 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.720s (SENT)
W20260709 13:07:25.178360 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.167783 12773 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.155913 15131 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.148590 15094 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.190511 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:25.171025 15167 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:07:25.198858 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:25.200057 12881 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:25.217859 12696 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.900s (SENT)
I20260709 13:07:25.218436 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.171171 15123 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.170452 15157 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:25.187613 15180 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.221956 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:25.227437 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:25.190830 14764 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.919s	user 0.016s	sys 0.000s
I20260709 13:07:25.187922 15155 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:25.218164 15037 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.234017 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:25.235617 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1757) took 1063 ms. Trace:
I20260709 13:07:25.238842 12879 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:25.229954 12878 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:25.238901 12882 rpcz_store.cc:276] 0709 13:07:24.170455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.170689 (+   234us) service_pool.cc:224] Handling call
0709 13:07:24.281890 (+111201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.293820 (+ 11930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.233128 (+939308us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540006aed0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:25.233290 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254667648}
I20260709 13:07:25.173666 15046 consensus_queue.cc:1059] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:25.166249 15074 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.237558 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 204) took 1584 ms. Trace:
I20260709 13:07:25.247231 12726 rpcz_store.cc:276] 0709 13:07:23.653716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.025465 (+371749us) service_pool.cc:224] Handling call
0709 13:07:25.236710 (+1211245us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:25.236923 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.237148 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.237193 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.237240 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.237273 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.237338 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.237477 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7718656}
I20260709 13:07:25.249610 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.250581 12726 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 3.
I20260709 13:07:25.252241 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.228436 15157 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.243084 15136 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.008s
I20260709 13:07:25.241616 14764 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.234457 15123 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:25.222927 15131 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:07:25.215600 15094 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.243407 15180 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:25.265494 12799 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:25.254381 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115621us
I20260709 13:07:25.294462 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.306402 12726 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:25.260011 15157 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.307909 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 77905.4us
W20260709 13:07:25.322634 15203 log.cc:927] Time spent T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:25.325187 15194 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:25.243855 15155 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:25.328009 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 190992us
W20260709 13:07:25.329262 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.332443 12729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:07:25.333345 12729 raft_consensus.cc:606] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:25.340726 12773 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.727s (SENT)
I20260709 13:07:25.341493 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:25.342574 15113 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.005s
W20260709 13:07:25.387693 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 72668.4us
I20260709 13:07:25.333266 14764 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:25.394466 15152 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.046s	user 0.004s	sys 0.000s
I20260709 13:07:25.394721 14764 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:25.395329 14764 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.341835 15190 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.389766 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:25.416157 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:25.423599 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.423641 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:25.431339 15165 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.410800 15139 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.387024 15113 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.425195 14982 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.432745 15118 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:25.439788 15049 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.456625 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 787) took 1494 ms. Trace:
W20260709 13:07:25.457571 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 127968us
W20260709 13:07:25.465582 12773 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.783s (SENT)
I20260709 13:07:25.454775 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:25.448916 15201 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.474870 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.461899 12804 rpcz_store.cc:276] 0709 13:07:23.961959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.962155 (+   196us) service_pool.cc:224] Handling call
0709 13:07:23.962605 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.963035 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:23.963344 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.076723 (+113379us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.076937 (+   214us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.077402 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.077530 (+   128us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.077564 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.077638 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.239415 (+161777us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180033e800. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:24.243410 (+  3995us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b180033e800. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:25.393645 (+1150235us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:25.456330 (+ 62685us) raft_consensus.cc:1685] finished
0709 13:07:25.456354 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.456552 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26202,"prepare.queue_time_us":30010,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":96,"raft.queue_time_us":12580,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":15529,"spinlock_wait_cycles":126087680,"thread_start_us":90376,"threads_started":1,"wal-append.queue_time_us":324297}
I20260709 13:07:25.472767 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:25.432148 15165 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.456332 15118 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.488835 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:25.460623 15155 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.408736 15123 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:25.497659 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 147779us
I20260709 13:07:25.476953 15139 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.474200 15190 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.513000 15204 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:25.514258 15074 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.543244 15206 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:25.549052 15210 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:25.549862 15208 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:25.550431 15206 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:25.480350 15201 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.550999 15206 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:25.485136 15120 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:07:25.486984 15049 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:07:25.545938 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:25.546681 15204 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:25.554625 15120 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.560411 15113 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.553280 15206 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.547734 15165 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.561022 15120 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:25.560006 15204 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.561993 15094 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.490624 15118 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.479975 14982 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:25.545490 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:25.583642 12808 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
W20260709 13:07:25.583410 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.588531 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 133994us
I20260709 13:07:25.593542 12805 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:25.594326 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.595005 12728 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:25.596299 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.596943 12728 raft_consensus.cc:2410] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:25.548151 15219 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:25.548267 15193 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:07:25.599493 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116080us
W20260709 13:07:25.602568 12773 connection.cc:256] RPC call timeout handler was delayed by -2.004355382999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:07:25.603052 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:25.603482 12773 connection.cc:256] RPC call timeout handler was delayed by -1.9962553829999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:07:25.603931 12773 connection.cc:256] RPC call timeout handler was delayed by -1.9269553829999495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 13:07:25.604166 12728 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:25.604423 12773 connection.cc:256] RPC call timeout handler was delayed by -1.9215553829999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:07:25.604912 12773 connection.cc:256] RPC call timeout handler was delayed by -1.9068309509999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:07:25.607167 12773 connection.cc:256] RPC call timeout handler was delayed by -1.906255382999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 13:07:25.607640 12773 connection.cc:256] RPC call timeout handler was delayed by -1.8783553829998709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 13:07:25.548704 15195 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:25.609205 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:25.609887 12728 raft_consensus.cc:2376] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6. Re-sending same reply.
I20260709 13:07:25.600834 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:25.553544 15201 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.585623 15180 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:25.613325 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.586918 15047 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.548616 15200 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.615895 15200 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.601266 15206 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.602166 15219 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.565673 15139 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.615206 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:25.627049 12773 leader_election.cc:336] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.900s (SENT)
I20260709 13:07:25.630487 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.630993 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:25.635036 12699 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.511s (SENT)
I20260709 13:07:25.635501 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.635775 12802 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:25.636248 12802 pending_rounds.cc:85] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:07:25.636529 12802 pending_rounds.cc:107] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:25.636757 12802 raft_consensus.cc:2889] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.629356 12728 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:25.638000 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.612358 15195 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.641752 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:25.614562 15094 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.642401 12802 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.616729 15047 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:25.626554 14764 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.626724 15165 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:25.647665 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:25.587821 15190 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.623558 15200 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.652472 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:25.629338 15219 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.655057 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:25.658416 12728 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.659636 12806 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:25.665056 12808 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.641923 15195 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.670665 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:25.671242 12807 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.645061 15136 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:25.684773 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:25.640362 15157 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.685892 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:25.689011 12806 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:25.685205 15228 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:25.695853 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 62183.7us
I20260709 13:07:25.702412 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:25.704393 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:25.699147 12802 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:25.707793 12808 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:25.710541 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.711844 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.712786 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 97942.2us
I20260709 13:07:25.725378 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:25.626097 15120 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:25.736115 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116615us
I20260709 13:07:25.706542 14764 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.682827 15165 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.741546 14764 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:07:25.747859 12773 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.956s (SENT)
I20260709 13:07:25.751896 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.734303 12728 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:25.749750 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:25.756994 12807 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:25.735376 15113 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.694166 15136 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:25.762339 12731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 787) took 1392 ms (client timeout 1517 ms). Trace:
W20260709 13:07:25.764974 12731 rpcz_store.cc:269] 0709 13:07:24.370486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.370625 (+   139us) service_pool.cc:224] Handling call
0709 13:07:25.762148 (+1391523us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002d46d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:25.762290 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249610112}
I20260709 13:07:25.767721 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:25.768353 15218 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.769141 15218 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:25.751529 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:25.782287 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:25.754873 14764 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:25.763667 15135 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.844s	user 0.016s	sys 0.003s
I20260709 13:07:25.760934 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:25.757373 15228 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.761945 15120 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:25.788676 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45227.8us
I20260709 13:07:25.736699 15220 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
W20260709 13:07:25.794660 12773 connection.cc:256] RPC call timeout handler was delayed by -1.7367582259998926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:07:25.742931 15047 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:25.795117 15113 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:25.841210 15113 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:25.842159 15113 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.843303 15113 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:25.845574 12773 connection.cc:256] RPC call timeout handler was delayed by -1.5684582259999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:07:25.846087 12773 connection.cc:256] RPC call timeout handler was delayed by -1.519858225999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:07:25.846626 12773 connection.cc:256] RPC call timeout handler was delayed by -1.4109309509999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:07:25.847054 12773 connection.cc:256] RPC call timeout handler was delayed by -1.3965309509999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:07:25.847501 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2607264170000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:07:25.847944 12773 connection.cc:256] RPC call timeout handler was delayed by -1.220455382999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2952s for a response
I20260709 13:07:25.849452 12773 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.851280 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.782754 15094 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.855489 12804 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:25.881704 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:25.883715 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 104977us
W20260709 13:07:25.862681 15223 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:07:25.856616 15135 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:25.888612 15215 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:07:25.893337 15220 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:25.858387 15118 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:25.896330 15135 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:25.898327 15118 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.898540 15135 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:25.899113 15135 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.899436 15157 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.862459 15139 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.859371 15226 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.876008 15239 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:25.885044 15094 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.906406 15075 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.905773 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:25.913144 15043 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:25.936395 15136 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.903614 15047 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.937317 15165 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:25.948077 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:25.904991 15226 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:25.929834 15239 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:25.956471 15239 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.956284 15238 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:25.938301 15190 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:25.893959 15220 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:25.968477 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.940271 15135 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:25.968400 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 186311us
W20260709 13:07:25.973764 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91885us
I20260709 13:07:25.962440 15226 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.693732 15180 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:25.972935 15230 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.962879 15136 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:07:26.002712 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 277592us
I20260709 13:07:26.011835 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:26.075620 15204 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
W20260709 13:07:26.076277 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 84595.8us
W20260709 13:07:26.077270 15241 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:07:26.078491 15218 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:26.093222 15232 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:07:26.098088 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86376.6us
W20260709 13:07:26.112002 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.120472 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 142960us
I20260709 13:07:26.007568 15243 raft_consensus.cc:2764] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:26.008088 15135 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:07:26.122192 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:26.135704 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:26.221247 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 85670.3us
I20260709 13:07:26.222098 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.222133 12876 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.171725 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.170948 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 813) took 1059 ms. Trace:
I20260709 13:07:26.164729 12726 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:07:26.178848 12771 connection.cc:256] RPC call timeout handler was delayed by -1.1791251299999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2768s for a response
I20260709 13:07:26.168794 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.164628 15220 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.170001 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.230921 12729 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.193243 15218 raft_consensus.cc:1064] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:07:26.190125 15037 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.190442 15162 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.121747 15165 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:07:26.207108 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.199362 15226 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.118947 15204 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.171955 15239 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:26.208137 15206 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.008s
I20260709 13:07:26.214563 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.214632 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.216264 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.217087 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.167023 14764 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.223641 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.163111 15225 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:26.165850 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 801) took 1370 ms. Trace:
I20260709 13:07:26.235402 15120 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.242009 12732 rpcz_store.cc:276] 0709 13:07:24.795495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.948973 (+153478us) service_pool.cc:224] Handling call
0709 13:07:24.949524 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.996947 (+ 47423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.165551 (+1168604us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b540038fc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:26.165773 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107004672}
I20260709 13:07:26.234130 15162 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:26.223891 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.243500 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.244760 15162 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:26.223953 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.245349 15162 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.248661 15226 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:26.248867 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:26.249323 15225 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.251084 15139 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:26.251374 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:26.253437 15139 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.254689 15209 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:26.255182 15209 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:26.247005 15204 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:26.238492 15135 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.258450 15135 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.225054 15067 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.226361 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.259975 15067 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:26.261552 15067 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.261776 15135 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.226680 15122 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.224609 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.223428 15243 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:26.229993 15195 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 13:07:26.001865 15230 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:26.275772 12873 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.223109 12799 rpcz_store.cc:276] 0709 13:07:25.111282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.112249 (+   967us) service_pool.cc:224] Handling call
0709 13:07:25.112554 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.301367 (+188813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.170676 (+869309us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002b34d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:26.170876 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350874368}
I20260709 13:07:26.231909 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.277356 15230 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.238381 12804 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:26.233316 15181 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.035s	user 0.003s	sys 0.003s
W20260709 13:07:26.233453 15218 raft_consensus.cc:1068] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:26.232695 15037 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.240481 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.280993 15109 raft_consensus.cc:3055] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:26.281620 15109 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:26.282938 15109 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.249984 12807 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:26.270668 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:26.284447 15109 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.285660 15214 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.286404 15131 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.286310 15214 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.287091 15131 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.289304 15214 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.275540 15195 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.254988 15139 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:26.271324 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.289979 15131 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:26.295049 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 802) took 1388 ms. Trace:
I20260709 13:07:26.281879 15037 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.112311 15219 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.296798 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 129) took 1720 ms. Trace:
I20260709 13:07:26.299031 15048 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.221252 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 99219.9us
W20260709 13:07:26.292531 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 657616us
I20260709 13:07:26.305065 12873 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:26.293412 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.307824 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.379684 12727 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.378198 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:26.376808 12877 rpcz_store.cc:276] 0709 13:07:24.576417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.576559 (+   142us) service_pool.cc:224] Handling call
0709 13:07:24.576945 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.577232 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.577257 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.589512 (+ 12255us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.031451 (+441939us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.059894 (+ 28443us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.060200 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.060310 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.229940 (+1169630us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:26.284792 (+ 54852us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b18000bdb20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:26.296568 (+ 11776us) raft_consensus.cc:1685] finished
0709 13:07:26.296592 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.296734 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28264,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1583,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8892,"spinlock_wait_cycles":86278272,"thread_start_us":355277,"threads_started":1,"wal-append.queue_time_us":484955}
W20260709 13:07:26.382797 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 111788us
W20260709 13:07:26.381234 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 110033us
W20260709 13:07:26.376935 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 128490us
I20260709 13:07:26.384788 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.384866 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:26.385965 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:26.451673 15187 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.255s	user 0.000s	sys 0.006s
W20260709 13:07:26.466676 12628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 190) took 17663 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.307996 15220 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:26.470029 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.470141 15220 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.470849 15220 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.471972 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.472615 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 807) took 1303 ms. Trace:
I20260709 13:07:26.473129 12726 rpcz_store.cc:276] 0709 13:07:25.169644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.332759 (+163115us) service_pool.cc:224] Handling call
0709 13:07:25.333416 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.223602 (+890186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.472288 (+248686us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002d55d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:26.472509 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911408000}
I20260709 13:07:26.293013 15217 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.389472 12808 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.475585 15217 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:26.392457 12732 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.393272 15213 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.476215 15217 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:26.476997 15213 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:26.400811 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 160413us
I20260709 13:07:26.401427 12727 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:26.480434 12875 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.404019 15239 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.408857 15173 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.480906 12848 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.410159 15120 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:26.413335 15210 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.413785 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 213) took 1108 ms. Trace:
I20260709 13:07:26.415518 15204 raft_consensus.cc:1064] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:07:26.486079 12729 rpcz_store.cc:276] 0709 13:07:25.304955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.406496 (+101541us) service_pool.cc:224] Handling call
0709 13:07:25.415620 (+  9124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.232204 (+816584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.413395 (+181191us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54001efd54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:26.413688 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875039616}
I20260709 13:07:26.488482 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1761) took 2168 ms. Trace:
I20260709 13:07:26.411412 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.385958 15162 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.431665 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:26.488942 12875 rpcz_store.cc:276] 0709 13:07:24.315178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.315878 (+   700us) service_pool.cc:224] Handling call
0709 13:07:25.718751 (+1402873us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eacee9c 00007f0f3eacea5b 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:25.719040 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.480924 (+761884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.483636 (+  2712us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400382a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:26.483877 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753023872}
I20260709 13:07:26.431896 15225 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.326431 15209 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:26.441527 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56840.3us
I20260709 13:07:26.441825 15224 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.443168 14764 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.444768 12629 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 1 to 4, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 4 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.391068 15048 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.446681 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:26.452049 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67286.1us
I20260709 13:07:26.486218 15120 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.454185 15226 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:26.390476 15200 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.003s
I20260709 13:07:26.379320 12725 rpcz_store.cc:276] 0709 13:07:24.906491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.998936 (+ 92445us) service_pool.cc:224] Handling call
0709 13:07:24.999267 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.999487 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:25.149628 (+150141us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.539636 (+390008us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.540008 (+   372us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.283774 (+743766us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003255a0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:26.294573 (+ 10799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.294634 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:26.294697 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.294776 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.294992 (+   216us) inbound_call.cc:177] Queueing success response
0709 13:07:26.351646 (+ 56654us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003255a0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
Metrics: {"mutex_wait_us":759970,"prepare.queue_time_us":300111,"prepare.run_cpu_time_us":3371,"prepare.run_wall_time_us":25859,"raft.queue_time_us":1521300,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":296,"spinlock_wait_cycles":85004032,"thread_start_us":469795,"threads_started":2,"wal-append.queue_time_us":399040}
I20260709 13:07:26.292663 15195 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.481905 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.274495 15136 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:26.489580 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 78283.2us
W20260709 13:07:26.482367 15199 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.145s	user 0.007s	sys 0.000s
I20260709 13:07:26.480547 15109 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:26.379810 12699 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.558s (SENT)
I20260709 13:07:26.501981 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:26.529008 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 149266us
I20260709 13:07:26.530965 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:26.533075 12728 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:26.503499 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.492851 15162 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.539909 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.506188 15226 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:26.506605 15200 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.508517 15205 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.510846 15229 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.515410 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.516026 15217 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:26.516219 15220 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.555418 12727 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:26.518882 15048 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.520471 15188 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:26.553406 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.556813 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.558837 12879 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:26.520903 15219 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.521368 15126 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:26.522125 15224 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:26.496667 15204 raft_consensus.cc:1068] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:26.493602 15173 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:26.489537 15238 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:26.532217 12731 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:26.534262 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:26.534873 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:26.535440 12733 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.621959 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.539693 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.502004 15225 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:26.541941 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:26.470089 12628 rpcz_store.cc:269] 0709 13:07:08.803429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.806916 (+  3487us) service_pool.cc:224] Handling call
0709 13:07:26.466530 (+17659614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:22.344668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:22.345548 (+   880us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:22.345616 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:07:22.345636 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:22.346922 (+  1286us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:22.347041 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:22.347080 (+    39us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:22.539081 (+192001us) tablet.cc:701] Row locks acquired
0709 13:07:22.539280 (+   199us) write_op.cc:260] PREPARE: finished
0709 13:07:22.539602 (+   322us) write_op.cc:270] Start()
0709 13:07:22.539824 (+   222us) write_op.cc:276] Timestamp: P: 1783602442539417 usec, L: 0
0709 13:07:22.539856 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.568706 (+ 28850us) log.cc:844] Serialized 3968 byte log entry
0709 13:07:23.151921 (+583215us) op_driver.cc:464] REPLICATION: finished
0709 13:07:23.625061 (+473140us) write_op.cc:301] APPLY: starting
0709 13:07:23.625221 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:23.625586 (+   365us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:23.625882 (+   296us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:23.654498 (+ 28616us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:23.654963 (+   465us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:23.655039 (+    76us) write_op.cc:312] APPLY: finished
0709 13:07:23.680640 (+ 25601us) log.cc:844] Serialized 76 byte log entry
0709 13:07:23.682110 (+  1470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.682828 (+   718us) write_op.cc:454] Released schema lock
0709 13:07:23.682949 (+   121us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:23.892684 (+209735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.900492 (+  7808us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":482671,"reported_tablets":30,"spinlock_wait_cycles":10112,"child_traces":[["op",{"apply.queue_time_us":472725,"apply.run_cpu_time_us":8192,"apply.run_wall_time_us":124632,"num_ops":10,"prepare.queue_time_us":339462,"prepare.run_cpu_time_us":17321,"prepare.run_wall_time_us":324144,"raft.queue_time_us":107123,"raft.run_cpu_time_us":47567,"raft.run_wall_time_us":368229,"replication_time_us":611459,"spinlock_wait_cycles":3456,"thread_start_us":493710,"threads_started":4,"wal-append.queue_time_us":128706,"wal-append.run_cpu_time_us":16588,"wal-append.run_wall_time_us":1988010}]]}
I20260709 13:07:26.543275 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1565) took 1341 ms. Trace:
W20260709 13:07:26.623484 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81644.5us
I20260709 13:07:26.548064 15133 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.545625 15162 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.553676 15255 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.547463 15135 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:26.554324 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.554680 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.547825 15037 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.554392 15177 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:26.557185 12873 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:26.634714 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 64593.1us
I20260709 13:07:26.553493 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.634744 12874 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:26.615455 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.615504 12726 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.605401 12629 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 3 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 5 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.558297 15220 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:26.537635 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.543414 12773 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.623963 12881 rpcz_store.cc:276] 0709 13:07:25.201375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.230670 (+ 29295us) service_pool.cc:224] Handling call
0709 13:07:25.244130 (+ 13460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:25.321862 (+ 77732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.321917 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:26.248153 (+926236us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:26.248744 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:07:26.484175 (+235431us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.520116 (+ 35941us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.521699 (+  1583us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.522917 (+  1218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.523003 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.542919 (+ 19916us) raft_consensus.cc:1685] finished
0709 13:07:26.542954 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.543183 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11265,"prepare.queue_time_us":35825,"prepare.run_cpu_time_us":199,"prepare.run_wall_time_us":204,"raft.queue_time_us":108207,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":5249,"spinlock_wait_cycles":46434560,"thread_start_us":298093,"threads_started":2,"wal-append.queue_time_us":263487}
I20260709 13:07:26.632086 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.640372 12880 raft_consensus.cc:2368] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:26.639322 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.547254 15139 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.640941 12877 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:26.642050 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.643144 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.641095 15205 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:26.646598 15205 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.556802 15229 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.653708 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.658048 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.658519 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.547714 15195 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:07:26.630209 15136 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.652738 12629 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:07:26.664537 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.664635 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.666042 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.672464 12875 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:26.633980 15255 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.674760 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.676108 12877 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:26.677240 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.648931 15139 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.639251 15037 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:26.685786 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.681820 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 139966us
I20260709 13:07:26.672183 12880 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:26.685321 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.688565 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.691676 12875 raft_consensus.cc:2376] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4. Re-sending same reply.
I20260709 13:07:26.689388 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.691834 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.657675 15229 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:26.698243 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 154924us
I20260709 13:07:26.699471 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.698035 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.701236 12881 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:26.693400 15037 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.702510 12878 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:26.702924 12880 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:07:26.671419 15136 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.708117 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.709003 15238 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:26.711374 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.712118 15249 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:07:26.711959 15238 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:26.717166 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 89558us
W20260709 13:07:26.719762 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 77040.5us
I20260709 13:07:26.695503 15139 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.721455 12629 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 6, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 6 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.717260 15228 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.729188 15228 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.729569 15228 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.730088 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.731246 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:26.732879 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.635777 15133 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.727855 12629 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.710788 15067 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.686663 15255 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.750264 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:26.718063 15136 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:26.760520 12696 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.547s (SENT)
I20260709 13:07:26.671846 15226 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.788647 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 791) took 2330 ms. Trace:
I20260709 13:07:26.795356 12724 rpcz_store.cc:276] 0709 13:07:24.448498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.448796 (+   298us) service_pool.cc:224] Handling call
0709 13:07:24.511142 (+ 62346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.511693 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.511737 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:25.106927 (+595190us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b2c000014c8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:25.142139 (+ 35212us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.207574 (+ 65435us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:25.297723 (+ 90149us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.321458 (+ 23735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.321574 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.461658 (+1140084us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b18001e0dc0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ead42a6 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db
0709 13:07:26.471057 (+  9399us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:26.778477 (+307420us) raft_consensus.cc:1685] finished
0709 13:07:26.778514 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.778744 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98339,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":137125,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":17486,"spinlock_wait_cycles":33633408,"thread_start_us":106949,"threads_started":3,"wal-append.queue_time_us":171182}
I20260709 13:07:26.790274 12729 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.738337 15217 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.697261 15173 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.756402 15135 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:26.819818 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.822045 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:26.824397 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63939.3us
I20260709 13:07:26.824784 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:26.825448 12696 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.558s (SENT)
I20260709 13:07:26.825848 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.829957 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:26.830961 12808 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:26.739617 14982 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:26.833896 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:26.834645 12804 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.777010 15213 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.831979 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:26.848271 12808 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.853653 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.855541 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.862751 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:26.868860 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.869728 12881 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:26.870066 12875 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:26.881893 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56490.6us
W20260709 13:07:26.882893 12696 leader_election.cc:336] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.572s (SENT)
I20260709 13:07:26.883348 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.883877 15131 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.884502 15213 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.822598 15135 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:26.837280 15243 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.838264 15200 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:26.888872 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 136177us
I20260709 13:07:26.904443 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.743062 15224 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.803818 15264 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:07:26.871121 15103 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:26.915228 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 193663us
I20260709 13:07:26.922422 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.915333 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.912979 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.818766 15217 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.916868 12803 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.896914 15135 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.926213 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:26.949324 12805 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.929224 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.945662 15103 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:26.946874 15133 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:26.951789 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:26.907401 13514 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:26.957757 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.966194 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.967543 12881 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.973856 15264 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.974817 15264 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.979014 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:26.980433 12881 raft_consensus.cc:2376] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8. Re-sending same reply.
I20260709 13:07:26.987434 12874 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:26.983884 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.991369 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.992189 12881 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:26.995159 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:26.996547 12874 raft_consensus.cc:2410] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:26.989753 15131 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:07:27.010627 12804 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:27.011759 12808 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:27.010627 12805 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:27.012696 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:27.013741 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:27.014853 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:26.999538 15067 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:27.027107 12847 connection.cc:256] RPC call timeout handler was delayed by -1.256312577000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:07:27.023687 15263 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:07:27.036897 12874 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.991709 15213 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:27.022852 15217 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.028425 15210 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.032178 15119 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:27.029877 15067 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:27.035449 15175 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:27.073669 15260 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:07:27.073841 15216 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:27.083935 15262 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 13:07:27.032382 15228 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.089074 15067 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:27.107264 15265 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:07:27.076462 15182 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:27.118571 15216 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.141480 12800 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.085632 15115 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:27.122510 15133 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.124115 15220 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:07:27.155575 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 204913us
I20260709 13:07:27.156756 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:27.169190 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 185437us
I20260709 13:07:27.145192 15216 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.142002 15230 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.147034 15213 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.178879 13484 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.118s (SENT)
I20260709 13:07:27.178664 15266 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:27.186618 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 111743us
I20260709 13:07:27.185544 15067 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.189776 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:27.197867 15119 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:27.208161 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 256543us
I20260709 13:07:27.198065 15210 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:27.211282 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:27.247484 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 57831.6us
I20260709 13:07:27.248636 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:27.205574 15273 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:27.212757 15103 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.271135 15267 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.288596 15294 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:27.289562 15294 consensus_queue.cc:1243] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:27.292286 15293 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:27.293998 15293 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.294488 15293 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.301285 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 832) took 1065 ms. Trace:
W20260709 13:07:27.306075 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 127240us
I20260709 13:07:27.308990 12803 rpcz_store.cc:276] 0709 13:07:26.235767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.236164 (+   397us) service_pool.cc:224] Handling call
0709 13:07:26.236490 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.927149 (+690659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.300931 (+373782us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54003999d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:27.301202 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564633472}
I20260709 13:07:27.289004 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 837) took 1049 ms. Trace:
I20260709 13:07:27.280469 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:27.311048 12880 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:27.283914 12877 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:27.275290 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68123.8us
I20260709 13:07:27.310539 12802 rpcz_store.cc:276] 0709 13:07:26.239665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.251007 (+ 11342us) service_pool.cc:224] Handling call
0709 13:07:27.288736 (+1037729us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540028bc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:27.288924 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030295424}
I20260709 13:07:27.317999 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:27.310063 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.320217 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:27.320535 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.320991 12731 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:27.321085 12727 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.321247 12733 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:27.321878 12733 pending_rounds.cc:85] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:27.322110 12733 pending_rounds.cc:107] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:27.322371 12733 raft_consensus.cc:2889] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.326104 15119 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.339429 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:27.341089 12877 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:27.256372 15266 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:27.348481 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:27.350090 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.285496 15275 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:07:27.283675 15120 consensus_meta.cc:287] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.011s
I20260709 13:07:27.365448 15047 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.366336 15047 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.366034 15120 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.366863 15047 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.230930 15213 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.354620 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:27.354261 15210 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.354303 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.432969 12729 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.355883 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:27.358512 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:27.288024 15067 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:27.322429 15136 consensus_meta.cc:287] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.004s
W20260709 13:07:27.322626 15139 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.001s
I20260709 13:07:27.457670 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 797) took 2797 ms. Trace:
I20260709 13:07:27.344004 15284 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.286278 15270 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:07:27.415584 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.343506 15227 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:07:27.285750 15280 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.284881 15239 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:27.417131 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:27.449419 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:27.452407 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94004.8us
I20260709 13:07:27.454312 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:27.450949 15229 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.000s
W20260709 13:07:27.343389 15037 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.001s
I20260709 13:07:27.496961 12724 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:27.457955 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:27.252414 15230 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:27.458127 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:27.401714 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.323694 15103 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.324379 15273 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:27.513345 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.514843 12731 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:27.476646 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:27.515717 12728 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:27.458091 12730 rpcz_store.cc:276] 0709 13:07:24.660495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.945794 (+285299us) service_pool.cc:224] Handling call
0709 13:07:24.946175 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.461166 (+1514991us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:26.560009 (+ 98843us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.750867 (+190858us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.759640 (+  8773us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.759810 (+   170us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:26.759852 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.427949 (+668097us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54002d50d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:27.428024 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.428113 (+    89us) raft_consensus.cc:1685] finished
0709 13:07:27.457430 (+ 29317us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.457610 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":217331,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4559,"raft.queue_time_us":3666,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":4502,"spinlock_wait_cycles":3483809152,"thread_start_us":213179,"threads_started":2,"wal-append.queue_time_us":258703}
I20260709 13:07:27.516633 15120 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:27.415390 15294 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:07:27.357120 15266 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:27.497488 15255 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.016s
I20260709 13:07:27.534801 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.535746 12724 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:27.538523 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 406630us
W20260709 13:07:27.542641 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.489601 12733 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:27.324199 15175 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:27.476024 15188 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.485360 12732 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:27.547480 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.516860 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:27.529165 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:27.533465 15224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.017s
I20260709 13:07:27.457607 15136 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.550644 12731 pending_rounds.cc:85] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 1
I20260709 13:07:27.478847 15139 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:27.482458 15284 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.556342 12731 pending_rounds.cc:107] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:27.562674 12731 raft_consensus.cc:2889] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:27.551777 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 340690us
I20260709 13:07:27.501266 15225 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:27.502501 15229 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.527804 15103 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:27.556327 15224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.017s
I20260709 13:07:27.513314 15037 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:27.554989 15162 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.911s	user 0.007s	sys 0.052s
I20260709 13:07:27.607002 12726 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:27.564014 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:27.612742 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48951.8us
I20260709 13:07:27.612129 12728 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:27.542965 15255 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.615393 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.617048 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.618721 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:27.624250 12807 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:27.608532 15281 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:07:27.608776 15271 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:07:27.624197 12803 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:27.559106 15219 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:27.656271 15219 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:27.657330 15139 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:27.571457 15175 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.661586 15255 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.626212 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.635550 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.650511 12879 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:27.662925 12807 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.495486 12727 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:27.654834 15136 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.577518 15293 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:27.653587 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.666395 12729 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:27.605089 15300 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.689913 13487 leader_election.cc:336] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.721s (SENT)
I20260709 13:07:27.552214 15228 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.642076 15037 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.644826 15213 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.613646 15131 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.730823 12878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.020s	sys 0.032s
W20260709 13:07:27.732672 12878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.021s	sys 0.032s
I20260709 13:07:27.736737 12802 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:27.739043 12807 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:27.741129 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:27.743052 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 494613us
I20260709 13:07:27.742949 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.746682 12802 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.748588 12877 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.746058 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.751832 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:27.623260 15162 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.754417 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:27.755679 12807 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:27.767971 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:27.760259 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:27.730389 15173 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.734524 15292 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.731271 14982 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:27.597431 15266 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.785269 12877 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.809667 12806 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:27.743305 15249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.040s	sys 0.034s
I20260709 13:07:27.774164 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:27.768867 13521 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:27.669989 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51393.9us
I20260709 13:07:27.793318 12803 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:27.794788 12882 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:27.795668 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.774962 12724 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:27.657305 15219 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.743227 15230 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:27.821877 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:27.808614 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.754166 15196 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:27.825457 15196 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:27.826413 15196 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:27.827383 15196 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.816053 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.754326 15225 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:27.802093 14982 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.571316 15273 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:27.820473 15219 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.830705 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:27.807631 15271 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:27.834712 12877 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:27.733240 15131 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:27.811705 15249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.040s	sys 0.034s
I20260709 13:07:27.836524 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:27.718176 15300 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.839636 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.841238 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.842216 12807 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:27.842590 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 353644us
I20260709 13:07:27.834079 12803 raft_consensus.cc:2376] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
I20260709 13:07:27.844004 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.845645 12803 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:27.846904 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.830948 15225 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:27.853302 12808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.004s	sys 0.010s
I20260709 13:07:27.853731 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.833035 14982 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:27.854602 12808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.004s	sys 0.010s
I20260709 13:07:27.847134 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.831697 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:27.865289 13514 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:27.865137 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.866384 12803 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:27.867369 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:27.867776 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.868403 15316 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:27.837785 15266 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.859951 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 851) took 1036 ms. Trace:
I20260709 13:07:27.869369 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.863878 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.881214 12803 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:27.881441 12807 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:27.857139 12802 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:27.882766 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.883599 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.883831 12807 raft_consensus.cc:2376] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5. Re-sending same reply.
I20260709 13:07:27.884581 12802 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:27.885241 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.810081 15173 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:27.885623 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.877360 12800 rpcz_store.cc:276] 0709 13:07:26.823875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.824094 (+   219us) service_pool.cc:224] Handling call
0709 13:07:26.846252 (+ 22158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.142157 (+295905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.859528 (+717371us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400174dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:27.859850 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678386432}
I20260709 13:07:27.889981 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:27.882732 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:27.892765 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.894639 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:27.893229 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:27.876739 15135 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.915s	user 0.008s	sys 0.016s
I20260709 13:07:27.898518 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.898991 12800 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:27.901151 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:27.901363 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.901837 12800 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.901952 12803 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:27.902406 15306 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.907526 12800 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:27.909454 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.910389 15295 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.911218 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.916666 15225 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:27.917614 15216 consensus_meta.cc:287] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.687s	user 0.022s	sys 0.000s
I20260709 13:07:27.919534 15173 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:27.919760 15300 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:27.921169 15298 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:27.922886 15312 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:27.924260 15284 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.813441 15292 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:27.929119 12803 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:27.933905 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:27.896965 15189 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:07:27.977551 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.940946 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:27.979795 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:27.899077 15293 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.953058 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1769) took 1420 ms. Trace:
I20260709 13:07:27.899173 15118 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.955377 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.984107 12802 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:27.985277 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.903512 15103 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:27.904014 15229 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:27.972558 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.936570 12800 raft_consensus.cc:2376] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
I20260709 13:07:27.976279 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:27.897531 15308 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:07:27.993525 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92481.9us
I20260709 13:07:27.983765 12873 rpcz_store.cc:276] 0709 13:07:26.532563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.535828 (+  3265us) service_pool.cc:224] Handling call
0709 13:07:26.536144 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.635226 (+ 99082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.952735 (+1317509us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5400221354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:27.952975 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47867264}
I20260709 13:07:27.935189 15135 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:27.990542 12881 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.981782 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:27.982208 15284 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.009500 12800 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.999665 15286 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.966768 15332 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:07:28.015097 13487 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.008s (SENT)
I20260709 13:07:28.015774 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:27.988615 15228 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:27.959546 15216 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.009186 12803 raft_consensus.cc:2368] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7.
I20260709 13:07:27.978245 15225 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.993489 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:27.986300 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:28.012836 12699 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:28.027894 12802 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:27.989954 15313 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.982520 15293 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:27.998958 15249 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:27.988557 15316 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.046393 15316 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:07:28.048244 15309 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:07:28.049842 15316 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:28.020695 12800 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.006724 14982 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.052811 15317 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.053428 15317 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.053839 15317 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.054037 14982 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:28.054879 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.015821 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:28.023118 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:28.025875 12804 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.013410 13521 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:28.059989 12875 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.060441 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1579) took 1207 ms. Trace:
I20260709 13:07:28.023350 15284 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:28.013789 15213 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.063972 12878 rpcz_store.cc:276] 0709 13:07:26.852583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.852700 (+   117us) service_pool.cc:224] Handling call
0709 13:07:26.880880 (+ 28180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.881314 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.881366 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.881900 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.735112 (+853212us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:27.735159 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.735234 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.060133 (+324899us) raft_consensus.cc:1685] finished
0709 13:07:28.060165 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.060362 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19615,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7111,"thread_start_us":792854,"threads_started":1,"wal-append.queue_time_us":976579}
I20260709 13:07:28.014639 15286 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.038414 12803 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:27.991842 15067 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:28.041231 12725 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:28.032666 12881 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:28.066695 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51021.8us
I20260709 13:07:28.089102 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:28.067693 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:28.090423 14764 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:28.091008 14764 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:28.091068 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:28.026590 15228 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:28.092094 15239 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.092798 15220 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:28.093624 15302 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:28.093815 15220 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:28.094255 15302 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:28.094836 15220 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.096519 15330 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.097172 15330 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:28.097643 15330 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.043486 15293 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.086126 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.092875 15228 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.081123 15268 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:28.111466 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.111786 15268 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:28.113978 15209 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.114154 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 862) took 1262 ms. Trace:
I20260709 13:07:28.113523 15268 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.086346 15067 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.084949 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1775) took 1550 ms. Trace:
I20260709 13:07:28.096796 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 846) took 1652 ms. Trace:
I20260709 13:07:28.095188 15302 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.102195 14764 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.125653 15067 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:28.133065 15322 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:28.132519 15067 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.116658 12882 rpcz_store.cc:276] 0709 13:07:26.534428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.536222 (+  1794us) service_pool.cc:224] Handling call
0709 13:07:26.536540 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.814820 (+1278280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.084576 (+269756us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002f58d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:28.084852 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870343424}
I20260709 13:07:28.116717 12806 rpcz_store.cc:276] 0709 13:07:26.444419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.447198 (+  2779us) service_pool.cc:224] Handling call
0709 13:07:26.447478 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.810118 (+1362640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.096528 (+286410us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540028d054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:28.096724 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3132974848}
I20260709 13:07:28.070329 15316 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:28.119091 15324 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:28.120204 15204 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.121675 15135 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.132144 15317 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.114533 12808 rpcz_store.cc:276] 0709 13:07:26.852076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.261841 (+409765us) service_pool.cc:224] Handling call
0709 13:07:27.291658 (+ 29817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.304890 (+ 13232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.304925 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.305607 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.862614 (+557007us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:27.862667 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.862753 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.113895 (+251142us) raft_consensus.cc:1685] finished
0709 13:07:28.113919 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.114073 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12580,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":556320,"threads_started":1,"wal-append.queue_time_us":758358}
I20260709 13:07:28.140432 15204 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:28.080291 15286 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.154815 12807 raft_consensus.cc:2410] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:28.117010 15131 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:28.134155 15067 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.092746 15239 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.173009 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 860) took 1321 ms. Trace:
W20260709 13:07:28.175977 15319 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:28.180622 12805 rpcz_store.cc:276] 0709 13:07:26.851477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.194813 (+343336us) service_pool.cc:224] Handling call
0709 13:07:27.195522 (+   709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.650664 (+455142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.650700 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.662589 (+ 11889us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.878472 (+215883us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:27.878513 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.878609 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.172701 (+294092us) raft_consensus.cc:1685] finished
0709 13:07:28.172729 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.172919 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39420,"raft.queue_time_us":77488,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":537883,"threads_started":2,"wal-append.queue_time_us":289315}
W20260709 13:07:28.192636 15047 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.821s	user 0.015s	sys 0.009s
I20260709 13:07:28.193423 15047 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.152614 15332 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.078636 15313 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.141391 15316 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.226966 15133 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.213948 15293 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.215744 15165 raft_consensus.cc:1064] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:07:28.216853 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.192451 15282 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.227988 15133 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.308490 15293 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:28.314394 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 301717us
I20260709 13:07:28.315770 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:28.299618 13518 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.198136 15284 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.331200 15249 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.320554 15216 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:28.352813 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.296388 15282 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.293582 15204 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:28.467973 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.742434 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.591660 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.531354 15047 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:28.497225 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.564483 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:28.459067 15313 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:28.758489 15165 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.764201 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 831) took 1315 ms. Trace:
I20260709 13:07:28.764837 12725 rpcz_store.cc:276] 0709 13:07:27.448916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.449067 (+   151us) service_pool.cc:224] Handling call
0709 13:07:28.763928 (+1314861us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400411754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:28.764109 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271365504}
I20260709 13:07:28.599741 15316 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.766335 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:28.767167 12728 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:28.769042 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:28.770462 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 755531us
W20260709 13:07:28.771764 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 456234us
I20260709 13:07:28.472571 15330 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.773839 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.785300 12805 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
W20260709 13:07:28.707643 12847 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.732s (SENT) [suppressed 43 similar messages]
I20260709 13:07:28.478637 15210 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:28.776242 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:28.783183 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:28.360261 15131 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:28.636741 14764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.009s
I20260709 13:07:28.740252 15317 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:28.779608 15266 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.779366 15332 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.785560 15047 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:28.777624 15226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.571s	user 0.009s	sys 0.012s
W20260709 13:07:28.795917 15213 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.717s	user 0.015s	sys 0.000s
I20260709 13:07:28.806488 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:28.799469 15286 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.005s
I20260709 13:07:28.812623 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:28.814941 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.821309 12806 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.797441 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:28.820058 12801 raft_consensus.cc:2410] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:28.797834 15216 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:28.798305 15273 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.794559 15131 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:28.821815 12803 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:28.832348 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.833137 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:28.820451 15226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.660s	user 0.010s	sys 0.012s
W20260709 13:07:28.803278 14764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.006s	sys 0.014s
I20260709 13:07:28.779425 15249 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:28.816670 15047 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:28.825377 15196 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.006s
I20260709 13:07:28.821112 15286 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.799888 15316 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:28.822959 15213 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.857479 12806 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:28.827771 15317 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.799280 15210 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.817832 15266 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.844374 15131 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.841560 15228 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.854267 15047 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.845110 15216 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:28.817490 15335 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:07:28.869534 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.844682 15273 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:28.885655 15302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.028s	sys 0.060s
I20260709 13:07:28.824536 15332 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.886722 15286 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.871902 15213 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.897349 15302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.028s	sys 0.060s
I20260709 13:07:28.870877 15317 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.910029 15330 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:28.910435 15210 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:28.910435 15317 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.912139 15273 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.912555 15266 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.913926 15216 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.894459 15228 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:28.917797 15333 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:28.930346 15332 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:28.931389 13484 leader_election.cc:336] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.862s (SENT)
I20260709 13:07:28.931922 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:28.932888 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:28.931416 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.933558 12733 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:28.934020 12802 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:28.944645 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 237091us
I20260709 13:07:28.949635 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.950990 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:28.950326 12802 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:28.953441 12802 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.902277 15213 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.954427 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:28.956307 12806 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.955049 12800 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:28.956863 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.957700 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.958369 12803 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:28.958714 14764 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:28.959362 14764 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:28.960536 12808 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.961866 14764 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:28.952343 15302 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.935931 15301 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.937273 15332 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.954905 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:28.965801 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:28.969771 13516 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:28.972930 15238 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.974058 15282 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:28.978242 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:28.979137 15204 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.979444 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.980386 12803 raft_consensus.cc:2410] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:28.981304 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:28.953999 15341 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:28.982214 12845 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:28.958140 15340 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.084s	user 0.003s	sys 0.001s
I20260709 13:07:28.963898 15302 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:28.984405 15286 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.992869 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.993597 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:28.993788 15249 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.004902 12803 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:28.981367 15303 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:28.995186 15239 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:28.995846 15067 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.000s
W20260709 13:07:28.996253 12876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1772) took 2462 ms (client timeout 1845 ms). Trace:
I20260709 13:07:29.000481 15344 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.970297 15266 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.004997 12805 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:29.038679 12802 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:29.017305 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.040004 12800 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.020802 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:28.969340 15301 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:28.993798 15228 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.024472 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.047447 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.048345 12806 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:29.025858 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.049394 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:29.029040 12876 rpcz_store.cc:269] 0709 13:07:26.533488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.533620 (+   132us) service_pool.cc:224] Handling call
0709 13:07:28.995904 (+2462284us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54000717d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:28.996128 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221984640}
I20260709 13:07:28.990623 15229 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.041400 12803 raft_consensus.cc:2376] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4. Re-sending same reply.
I20260709 13:07:29.022850 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.027568 15210 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.057276 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.058261 12805 raft_consensus.cc:2368] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:29.013893 15286 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.039649 15217 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.065251 13514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 181) took 1165 ms. Trace:
I20260709 13:07:29.044443 15266 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.068094 15273 consensus_queue.cc:1059] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.042212 15067 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:29.051630 15229 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:29.047636 15172 raft_consensus.cc:1027] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: attempt to promote peer a865487bf1854df8a5619d42465bb36c: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:29.028470 15303 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.074352 12800 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:29.061363 15348 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.071970 15217 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:29.039324 15344 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.072145 15210 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.093535 15303 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.080189 15229 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.072817 13514 rpcz_store.cc:276] 0709 13:07:27.899662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.905186 (+  5524us) service_pool.cc:224] Handling call
0709 13:07:29.001288 (+1096102us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:29.013836 (+ 12548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.033319 (+ 19483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.037466 (+  4147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.039338 (+  1872us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.045094 (+  5756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.051442 (+  6348us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.065157 (+ 13715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5243264}
I20260709 13:07:29.082737 15067 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.100445 15067 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.104588 15210 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:29.108271 15217 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.109229 15286 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.119257 15266 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.120877 15302 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.103555 15131 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:29.124655 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.131875 12799 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:29.115904 15238 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.089726 15348 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.144812 12730 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.125027 15216 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:29.151868 15316 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.152562 15316 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:29.153539 15316 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.154704 15316 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.133899 15217 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.157464 15344 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.167133 15292 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.138706 15348 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:29.179494 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.192837 13514 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:29.194299 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:29.198596 12881 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:29.198886 15348 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.207039 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 146) took 2233 ms. Trace:
I20260709 13:07:29.208483 12874 rpcz_store.cc:276] 0709 13:07:26.973975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.118125 (+144150us) service_pool.cc:224] Handling call
0709 13:07:27.129833 (+ 11708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.130163 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.130192 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.130659 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.199414 (+ 68755us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.199465 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.199541 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.139380 (+1939839us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b1800090280. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:29.200999 (+ 61619us) raft_consensus.cc:1685] finished
0709 13:07:29.201020 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.206926 (+  5906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124996,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3000,"spinlock_wait_cycles":108875520,"thread_start_us":68444,"threads_started":1,"wal-append.queue_time_us":160362}
I20260709 13:07:29.200783 15048 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.213027 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 841) took 1663 ms. Trace:
I20260709 13:07:29.214262 12731 rpcz_store.cc:276] 0709 13:07:27.549522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.549951 (+   429us) service_pool.cc:224] Handling call
0709 13:07:27.550398 (+   447us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:27.613519 (+ 63121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.613562 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:27.614389 (+   827us) log.cc:844] Serialized 78 byte log entry
0709 13:07:27.835517 (+221128us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.031661 (+196144us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.064253 (+ 32592us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.064721 (+   468us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.165615 (+1100894us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b18002da540. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:29.209022 (+ 43407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.212140 (+  3118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.212778 (+   638us) raft_consensus.cc:1685] finished
0709 13:07:29.212797 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.212956 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":164947,"prepare.run_cpu_time_us":181,"prepare.run_wall_time_us":189,"raft.queue_time_us":216483,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":20450,"spinlock_wait_cycles":57160192,"thread_start_us":354302,"threads_started":4,"wal-append.queue_time_us":264174,"wal-append.run_cpu_time_us":5202,"wal-append.run_wall_time_us":1226865}
I20260709 13:07:29.179057 15216 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:07:29.220952 15352 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:29.214130 15048 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.224345 15048 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:29.226831 15338 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:07:29.205190 15047 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.134828 15301 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:29.232141 12696 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.845s (SENT)
I20260709 13:07:29.232726 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.234277 15131 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.234781 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 859) took 2383 ms. Trace:
I20260709 13:07:29.235258 12804 rpcz_store.cc:276] 0709 13:07:26.851160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.019834 (+168674us) service_pool.cc:224] Handling call
0709 13:07:27.020335 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.055969 (+1035634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.234464 (+1178495us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001a2a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:29.234704 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312529664}
I20260709 13:07:29.215896 15225 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.236428 15225 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.239872 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.241670 15282 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.242087 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.243400 12696 leader_election.cc:400] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:29.243698 12696 leader_election.cc:403] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.243863 15301 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.245335 15131 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.246097 15131 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 3. Current term is 4.
I20260709 13:07:29.250128 15047 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:29.250787 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.250970 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:29.251674 12732 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.252151 15204 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.252913 15216 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.252723 15204 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.240723 12731 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:29.256371 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.259243 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1764) took 1437 ms. Trace:
I20260709 13:07:29.260402 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.260591 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:29.261274 12804 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.264916 12725 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:29.259708 12807 rpcz_store.cc:276] 0709 13:07:27.822102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.884888 (+ 62786us) service_pool.cc:224] Handling call
0709 13:07:29.259036 (+1374148us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400398ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:29.259165 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612458240}
I20260709 13:07:29.269749 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:29.270329 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.272796 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.273602 12804 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:29.274261 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.279409 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.277518 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:29.280768 12731 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.280956 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.282312 12725 raft_consensus.cc:2410] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:29.293768 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:29.294423 12725 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.296767 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.298620 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:29.300967 12732 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:29.302366 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:29.295619 15048 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.303239 15216 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.304162 15188 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.304718 15188 raft_consensus.cc:697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:29.305544 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 824) took 1989 ms (client timeout 1732 ms). Trace:
W20260709 13:07:29.306048 12726 rpcz_store.cc:269] 0709 13:07:27.316579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.316767 (+   188us) service_pool.cc:224] Handling call
0709 13:07:29.305316 (+1988549us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000b4fd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:29.305460 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273597312}
I20260709 13:07:29.307125 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.308758 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.295593 15229 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.275274 15264 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:29.277134 15347 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.312613 12696 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:29.282989 15047 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.291098 15358 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.296250 15225 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.312408 15216 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.316298 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:29.317956 15264 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.349056 15264 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.344237 15216 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.350063 15216 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.320346 15282 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.352463 15282 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:29.312911 15048 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.352949 15282 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.315341 15047 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.355429 15229 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.305581 15188 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.355448 15047 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.264997 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:29.364707 15355 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:07:29.366638 15204 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:29.368592 12879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1777) took 2831 ms (client timeout 1750 ms). Trace:
W20260709 13:07:29.369243 12879 rpcz_store.cc:269] 0709 13:07:26.537239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.559615 (+ 22376us) service_pool.cc:224] Handling call
0709 13:07:29.368273 (+2808658us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004204d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:29.368483 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363467136}
I20260709 13:07:29.373454 15047 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:29.374276 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.375222 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.355866 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.376227 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89160.1us
I20260709 13:07:29.384979 13518 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.385465 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:29.386170 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:29.393519 15229 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:29.396000 13521 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:29.375993 15047 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.401744 12845 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:29.402138 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 85970.6us
I20260709 13:07:29.403105 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.381656 12725 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:29.407509 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:29.408445 12725 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:29.409415 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.410102 12725 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:29.411062 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.416457 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:29.417519 13487 leader_election.cc:336] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.862s (SENT)
I20260709 13:07:29.414453 15204 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.458324 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.419899 15358 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.414323 15335 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.466003 12724 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:29.426148 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.411733 12725 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:29.468144 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:29.471822 12725 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.467978 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:29.473973 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.479146 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53095us
I20260709 13:07:29.480192 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.458033 15131 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.488468 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.501724 12725 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:29.503494 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:29.505627 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.506114 12725 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:29.465938 15284 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:29.510486 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 123244us
I20260709 13:07:29.506367 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.512259 12724 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:29.492136 15048 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.457871 15317 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:29.493988 15204 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:29.500820 15047 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:29.511500 15225 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.523387 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.507052 15335 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:29.532470 15047 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.534050 15335 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.537755 15216 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.545137 15162 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:29.537776 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.535774 15047 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.543817 15213 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.552152 15225 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:29.562775 15216 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.563025 15225 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.559634 15131 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.566461 15282 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.567109 15131 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:29.568097 15131 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.568950 15282 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.569483 15228 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.569555 15131 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.570022 15228 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:29.569751 15204 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.570894 15228 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.571998 15228 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.578529 15133 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.633754 12727 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.636308 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:29.637246 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 133784us
I20260709 13:07:29.642941 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.648365 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:29.658028 12732 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:29.661190 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.670128 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.671172 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.672696 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 126819us
I20260709 13:07:29.672775 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.680945 12727 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.683754 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:29.685936 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.686921 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:29.692463 15067 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:29.693709 12807 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:07:29.693506 15047 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:29.697769 12804 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:29.669886 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1597) took 1754 ms. Trace:
I20260709 13:07:29.699667 12875 rpcz_store.cc:276] 0709 13:07:27.915607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.915832 (+   225us) service_pool.cc:224] Handling call
0709 13:07:27.916299 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.069677 (+153378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.668784 (+1599107us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400139f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:29.669487 (+   703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329897344}
I20260709 13:07:29.693908 15067 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.702919 12724 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:29.703476 12724 pending_rounds.cc:85] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:29.703841 12724 pending_rounds.cc:107] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:29.706717 12724 raft_consensus.cc:2889] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.707301 15067 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.808764 15209 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:29.712705 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.773186 12876 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:29.776288 12882 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:29.748622 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:29.759343 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.732504 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:29.675724 12731 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:29.758051 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.697824 15047 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.739470 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:29.739542 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.740818 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.826323 12879 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:29.766520 15135 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.712423 15103 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.807474 15188 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:29.707432 15089 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.838222 15089 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.840265 15213 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:29.841223 15358 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.744486 15133 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:29.750085 15131 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.836350 15188 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.752494 15120 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:29.826891 15047 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:29.841106 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.842423 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:29.863293 15133 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.876850 15120 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.886404 15133 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:29.872978 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.888368 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.889566 12874 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:29.889822 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.893594 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:29.880097 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.897711 15135 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.895279 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.900307 12800 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:29.900585 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.896271 12875 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:29.901029 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.878237 15131 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.902172 15131 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:29.896739 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:29.877774 12873 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:29.897408 12808 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.900585 12799 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.884346 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.880314 15089 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:29.906253 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:29.905313 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:29.908190 12878 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:29.910046 15196 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.910686 15196 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:29.911267 15196 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.878906 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:29.877158 15047 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:29.915978 15131 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:29.918530 15131 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.920703 12805 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:29.924474 15135 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:29.926857 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.883353 15188 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:29.887589 15120 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:29.928198 15209 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.939625 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.947885 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:29.950829 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.952499 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.963114 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:29.967245 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.972824 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.976588 12878 raft_consensus.cc:2410] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:29.978948 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:29.981738 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:29.988580 12726 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:29.985473 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 253247us
I20260709 13:07:29.994341 12724 raft_consensus.cc:2368] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5.
I20260709 13:07:29.999955 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.003291 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.006089 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:30.008726 12728 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:30.021404 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:30.022054 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:30.023663 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:30.024447 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:30.024646 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:30.025241 12875 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:30.025570 12882 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.023859 12880 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.028251 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:30.031150 12629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 72) took 14431 ms (client timeout 15000 ms). Trace:
I20260709 13:07:30.024636 12881 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:30.037889 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:30.043228 12726 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:30.031332 15047 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.045856 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.047120 12728 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:30.047629 12730 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:30.049933 12726 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:30.051532 12724 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.053225 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:30.054260 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.055595 12730 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
W20260709 13:07:30.057174 15381 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:30.063997 12882 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:30.064684 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.065264 12627 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 2 to 3, term changed from 4 to 6, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:30.071465 13514 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:30.067888 12627 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.074388 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:30.073896 12627 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.076387 15135 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.077018 15135 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:30.077559 15135 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.081030 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.075588 12627 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 2 to 4, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:30.083033 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.084858 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:30.085992 12882 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:30.086046 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:30.100473 12627 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.102454 12627 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:30.112447 12729 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:30.113494 12874 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
W20260709 13:07:30.114825 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 112066us
I20260709 13:07:30.123622 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:30.126030 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 105939us
W20260709 13:07:30.141180 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 74070.6us
W20260709 13:07:30.032179 12629 rpcz_store.cc:269] 0709 13:07:15.599644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.599963 (+   319us) service_pool.cc:224] Handling call
0709 13:07:30.030909 (+14430946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.282007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.282741 (+   734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.282786 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:07:27.282808 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:27.283596 (+   788us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.283649 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.283678 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:27.286037 (+  2359us) tablet.cc:701] Row locks acquired
0709 13:07:27.286067 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:07:27.286221 (+   154us) write_op.cc:270] Start()
0709 13:07:27.286351 (+   130us) write_op.cc:276] Timestamp: P: 1783602447286172 usec, L: 0
0709 13:07:27.286386 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.366908 (+ 80522us) log.cc:844] Serialized 2099 byte log entry
0709 13:07:28.874509 (+1507601us) op_driver.cc:464] REPLICATION: finished
0709 13:07:29.180171 (+305662us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f3eae90ac 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f45629ef0
0709 13:07:29.239290 (+ 59119us) write_op.cc:301] APPLY: starting
0709 13:07:29.239392 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:29.239589 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:29.239606 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:29.241428 (+  1822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:29.241666 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:07:29.241717 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:29.241999 (+   282us) log.cc:844] Serialized 46 byte log entry
0709 13:07:29.242200 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.242321 (+   121us) write_op.cc:454] Released schema lock
0709 13:07:29.242384 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:29.305088 (+ 62704us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:07:29.305304 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.305334 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2046957,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":351934,"apply.run_cpu_time_us":2792,"apply.run_wall_time_us":3484,"num_ops":5,"prepare.queue_time_us":279365,"prepare.run_cpu_time_us":92848,"prepare.run_wall_time_us":2023286,"raft.queue_time_us":801005,"raft.run_cpu_time_us":21239,"raft.run_wall_time_us":378843,"replication_time_us":1559917,"spinlock_wait_cycles":66683520,"thread_start_us":1301987,"threads_started":4,"wal-append.queue_time_us":439740}]]}
I20260709 13:07:30.179471 12732 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.181731 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.177845 15089 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:30.140383 15386 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:30.207752 12726 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.202230 12627 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.210048 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.216241 12724 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:30.218650 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.219391 12727 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.220320 15294 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:30.219945 12627 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 4, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.220899 15294 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:30.240226 12727 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:30.245639 12725 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:30.245968 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 160153us
W20260709 13:07:30.249766 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70096.3us
I20260709 13:07:30.250624 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:30.250917 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:30.251956 15204 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:30.252458 15310 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:30.253221 15310 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.254613 15385 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:30.257138 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.254603 15310 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.261524 14764 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.267776 12729 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:30.270572 15229 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.271288 15229 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.274005 15120 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.274657 15120 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.276908 15120 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.228677 15294 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:30.283394 15133 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:30.270236 14764 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.280906 15135 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:30.264115 12627 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 4, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 4 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.284113 15133 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:30.293426 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 162558us
I20260709 13:07:30.294564 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:30.299404 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47497.7us
I20260709 13:07:30.303046 15196 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:30.305902 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.291405 15229 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.307602 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.304471 12627 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.310988 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:30.305960 14764 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.310698 15382 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:07:30.323604 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.323354 15229 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:30.326637 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.332157 15133 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:30.332741 12731 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:30.334903 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:30.335176 15210 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.335815 15210 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:30.336391 15210 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.337998 15386 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:30.341353 12729 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:07:30.344277 15229 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.344794 15229 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.344888 12728 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:07:30.345440 12728 pending_rounds.cc:85] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:30.345790 12728 pending_rounds.cc:107] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:30.346098 12728 raft_consensus.cc:2889] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.346503 12728 pending_rounds.cc:107] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:30.346258 15238 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:30.346870 12728 raft_consensus.cc:2889] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.334942 12732 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.341938 12729 pending_rounds.cc:85] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:30.350407 12627 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 4, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.356124 12725 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:30.358397 12729 pending_rounds.cc:107] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:30.358825 12729 raft_consensus.cc:2889] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.360787 12729 pending_rounds.cc:107] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:30.361102 12729 raft_consensus.cc:2889] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.362735 12731 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:30.365613 15220 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.366218 15220 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.345808 15229 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.372552 15229 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.372931 13514 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:30.374228 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.374527 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.375442 12724 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:30.364761 15120 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:07:30.367429 15220 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.378237 15293 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:30.378661 15293 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.379120 15220 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.375713 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.380844 12727 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:30.369648 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.396435 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:30.402772 12732 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:30.403759 15292 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.406934 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.407723 12731 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.407285 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.405124 12627 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 5 to 6, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 6 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:30.418367 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70118.2us
W20260709 13:07:30.425441 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 98843.7us
W20260709 13:07:30.428828 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45418.7us
I20260709 13:07:30.432799 12727 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:30.440891 12727 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:30.447105 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:30.435411 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:30.449976 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 99954.5us
I20260709 13:07:30.404327 15292 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.431453 15135 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:30.434406 12627 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.379732 15293 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:30.465662 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.467278 12724 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:30.458508 12732 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.470553 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.472011 12729 raft_consensus.cc:2410] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:30.477928 15238 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.480600 15293 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.489737 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:30.497182 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.499382 12727 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.506167 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:30.507544 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 72313.8us
I20260709 13:07:30.488431 15310 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:30.519685 12627 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:30.526366 15216 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.525157 12627 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 5, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 5 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.535444 12729 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:30.539354 15196 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:30.540246 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.542654 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.543399 12725 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:30.548964 13521 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:30.552598 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:30.550704 12627 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:30.556286 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:30.559294 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.561292 12727 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:30.561369 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.566819 12725 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:30.569391 15216 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.570138 15216 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:30.570535 15216 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.576778 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:30.577934 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.588826 12727 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:30.589064 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:30.603184 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73440.7us
I20260709 13:07:30.603614 12731 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:30.606298 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.607002 12725 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:30.561872 15294 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:30.612540 15227 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.613051 15227 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:30.613449 15227 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.616225 15399 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:07:30.617434 15399 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.617828 15399 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.618744 15399 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:30.620148 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 78931.4us
I20260709 13:07:30.597716 15135 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:30.636541 15402 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:07:30.639497 15406 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:07:30.635438 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.622565 15399 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.621443 15292 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.609797 15210 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:30.672381 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 93741.6us
I20260709 13:07:30.673286 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:30.674103 15294 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.674515 15294 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.674844 15294 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.677364 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:30.678668 12730 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:30.682693 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.682698 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.686529 14764 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.687533 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:30.697654 15135 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:30.699666 15135 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:30.691468 12773 connection.cc:256] RPC call timeout handler was delayed by -1.0596384990000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 13:07:30.724627 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.705955 15131 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:30.732697 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.734229 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56952.4us
I20260709 13:07:30.749643 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.750917 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:30.733398 15131 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:30.764987 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.677583 15292 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:30.675652 15089 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.780462 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.784911 12727 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:30.780857 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.781291 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.782171 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:30.786302 12724 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:30.782935 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.793596 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.795223 15294 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.797997 15294 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.799211 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:30.784791 15358 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.776582 14764 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:30.811215 15120 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.810878 15227 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.811627 15120 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.812003 15120 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.799234 15310 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.817054 15310 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.818005 15310 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.818889 15210 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.819437 15310 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:30.820706 15408 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:07:30.821439 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 86660.3us
I20260709 13:07:30.822271 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:30.824250 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 69381.8us
I20260709 13:07:30.825001 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:30.826627 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:30.827198 12731 raft_consensus.cc:2376] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:30.830250 12728 raft_consensus.cc:2393] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 4: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:30.772337 15131 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.839761 15238 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:30.837446 15358 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.868265 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:30.887845 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:30.888960 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.854611 15229 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:30.873106 14764 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.865782 15135 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.891234 15358 raft_consensus.cc:2764] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:30.932715 15135 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:30.936192 12773 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.915s (SENT)
I20260709 13:07:30.936929 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:30.937786 15227 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:30.938082 15133 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.944464 15397 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:07:30.945940 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.929539 15089 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.930091 14764 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:30.951362 14764 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:30.961122 15358 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.962599 15358 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:30.945787 15410 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.974763 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 118532us
W20260709 13:07:30.976060 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 97670.6us
W20260709 13:07:30.986275 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 160841us
I20260709 13:07:30.919147 15216 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:30.989399 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 58044.7us
W20260709 13:07:31.024346 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47204us
I20260709 13:07:31.029331 15396 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.032881 15358 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:31.034098 15135 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.034140 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:31.037192 12805 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:30.969347 15120 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.043820 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:31.046808 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:31.056492 15294 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.057860 15216 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.042217 15238 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:31.067245 13484 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:31.047640 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.075479 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.039881 15089 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.081224 12805 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:31.086180 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.087390 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.098366 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.099387 12802 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:31.099386 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80948.4us
I20260709 13:07:31.083285 15216 raft_consensus.cc:2764] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:07:30.986359 15410 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.101316 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:31.107177 15422 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.107887 15422 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.108327 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:31.110739 15422 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.101497 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.112239 15410 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:31.098426 12808 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:31.098014 15421 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:07:31.083539 15385 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:31.114130 15385 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:31.114176 15421 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.114632 15385 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.115391 12699 leader_election.cc:400] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:31.115726 12699 leader_election.cc:403] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.116334 15382 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:31.118115 15382 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.119926 12804 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.120478 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.120783 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.121999 15229 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:31.122589 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.122509 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.122128 12806 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:31.122923 15229 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.123039 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.124224 12873 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:31.124624 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.126477 12873 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.127449 12881 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:31.128405 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.128535 15310 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.129189 12873 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:31.129088 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.130299 12800 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:31.124250 12874 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.135056 12873 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.136785 12880 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.136998 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.138351 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.123499 15229 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.144138 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.144290 15216 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:31.126542 12878 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.189553 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.083804 15089 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:31.197180 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.191423 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 68447.9us
I20260709 13:07:31.144163 15229 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.216961 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.220443 13521 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:31.221903 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.222939 12874 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:31.223997 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:31.225077 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 109907us
I20260709 13:07:31.185192 15358 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.187045 15422 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.188943 15421 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.187716 15133 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:31.240202 12808 raft_consensus.cc:2410] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:31.190299 15135 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.249948 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.214057 15204 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:31.255944 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:31.256561 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70041.7us
I20260709 13:07:31.259280 13487 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:31.190748 15188 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:31.214993 15410 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:31.234350 15216 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.245523 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:31.298821 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81956.9us
I20260709 13:07:31.305400 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.299513 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.240025 15133 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.282814 15358 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:31.318625 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73869.6us
I20260709 13:07:31.319288 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:31.263674 15419 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:31.332517 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.335218 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:31.336197 12725 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
W20260709 13:07:31.339438 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80273.5us
I20260709 13:07:31.340700 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:31.317529 15422 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.307004 15421 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.307377 15292 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.297180 15089 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.324239 13514 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:31.266593 15204 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.307864 15216 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.385922 15133 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:31.386109 15216 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.387212 15120 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:31.387298 15188 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.369784 12880 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.391614 12808 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.392261 12808 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:31.392398 12879 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.393260 12808 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.394348 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.394659 12808 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.269441 15385 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.395828 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.396689 12876 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:31.304117 15410 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.370095 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.393689 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.369719 15292 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:31.294366 15135 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.380487 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.423964 12874 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:31.380625 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:31.408394 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 83466.8us
I20260709 13:07:31.412885 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:31.421054 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80447.9us
I20260709 13:07:31.429071 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.430979 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.431162 15204 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:31.432760 12882 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.433665 15432 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.434345 15133 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.434257 15432 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.435083 15133 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.361516 15358 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.378512 15210 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.455078 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:31.465996 12880 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:31.466485 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.467823 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:31.472682 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 71577us
I20260709 13:07:31.498549 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.499902 12801 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:07:31.498554 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:31.501734 15427 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:31.502287 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.504194 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.505724 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.509207 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.506858 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.516495 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:31.509918 12878 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:31.523602 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:31.523833 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 189881us
I20260709 13:07:31.503945 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:31.524647 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.524739 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:31.522876 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.453866 15358 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.453118 15431 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.455350 15421 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.531868 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.533026 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.538295 12878 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:31.538614 12880 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:31.423087 15422 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:07:31.540103 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.456097 15382 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.535859 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.536140 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.341107 15419 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.507355 15089 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.540364 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.535545 13520 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:31.542109 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.543025 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.534726 15358 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:31.555748 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.574252 12806 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.574630 12874 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:31.549700 15216 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.548826 15385 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.535172 15210 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.614331 15210 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:31.582305 12880 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:31.579425 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54811.5us
I20260709 13:07:31.584709 12874 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.593291 12808 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:31.617280 12808 pending_rounds.cc:85] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:07:31.594091 15292 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:31.596024 15443 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.596782 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.597457 15433 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:31.600160 15135 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.600551 15438 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.608253 15410 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.654668 15216 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.655292 15422 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:31.554739 15421 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.616789 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.617938 12808 pending_rounds.cc:107] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:31.595436 15133 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:31.626780 12879 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:31.658080 12808 raft_consensus.cc:2889] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.659966 15436 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.666293 15436 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.656004 15422 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.676012 15410 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:31.676591 15410 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:31.677856 15410 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.682224 15435 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:31.629199 15432 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.641767 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:31.630831 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56502.4us
W20260709 13:07:31.582674 15131 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.002s
I20260709 13:07:31.648249 12878 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:31.653272 15419 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:31.701283 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.717356 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.718809 12880 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.724026 15422 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.723658 15131 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.734412 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:31.734041 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 117351us
W20260709 13:07:31.740352 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 190511us
I20260709 13:07:31.741612 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.739287 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:31.721583 15433 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:31.743609 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 198122us
I20260709 13:07:31.727914 15131 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.750088 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:31.756273 12801 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.755662 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:31.736164 15432 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.762058 12807 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:31.773607 15229 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.007s
I20260709 13:07:31.789098 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.789927 12801 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:31.779338 12873 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:31.792342 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:31.794288 12880 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:31.759184 15419 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:07:31.795470 13484 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:31.791457 15089 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.758430 15421 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.756071 15135 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:31.759788 15133 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.801637 12876 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:31.799717 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:31.797312 15292 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.807889 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:31.797266 15433 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.822535 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.823431 12801 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.797863 15447 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:31.824894 15444 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.825690 15444 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:31.826984 15444 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:31.831763 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.832494 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.836764 12879 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:31.788832 15229 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.805179 15436 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:31.840641 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.840520 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.793725 15432 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.841243 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.848405 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.841543 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:31.841284 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.841681 12699 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.842594 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.850122 12882 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:31.849215 12875 raft_consensus.cc:2376] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:31.843200 15396 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.802599 15133 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:31.819943 12771 leader_election.cc:336] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.687s (SENT)
I20260709 13:07:31.851662 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:31.853652 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.854269 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.839706 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:31.855751 12801 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:31.819339 15421 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.858081 15133 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.802490 15089 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.846235 15433 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:31.861234 15433 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.862254 15089 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:31.867059 12803 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.868325 15131 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.868588 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.869359 12879 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:31.859628 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:31.878068 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:31.882014 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 139053us
I20260709 13:07:31.888435 15449 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.882875 15436 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:31.889026 15449 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:31.889168 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:31.889449 15449 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.889941 15229 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:31.890161 12801 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:31.880124 15421 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:31.898888 15421 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:31.903668 15450 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:07:31.904801 15429 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:31.905731 15429 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:31.910462 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.855983 15445 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:31.902336 15410 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.907188 15429 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:31.941190 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116496us
W20260709 13:07:31.942519 13486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.024s	sys 0.023s
W20260709 13:07:31.943010 13486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.024s	sys 0.023s
W20260709 13:07:31.943310 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 607788us
W20260709 13:07:31.978367 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.940773 15438 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:07:31.990396 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 98482.4us
I20260709 13:07:31.991600 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:31.995364 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.025904 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:32.040792 15419 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:32.041461 15450 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:32.043118 15450 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.043195 15445 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.044504 15445 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.049687 15445 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.051095 15445 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.051216 15443 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.051786 15445 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.052464 12806 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:32.052932 12806 pending_rounds.cc:85] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
W20260709 13:07:32.053076 15458 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:32.054544 15445 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.055218 15445 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.055859 15445 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.056571 12806 pending_rounds.cc:107] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:32.056934 12806 raft_consensus.cc:2889] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.058386 15445 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.059129 15445 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.060292 15445 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.063666 15445 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:32.077915 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50701.3us
I20260709 13:07:32.036751 15432 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:32.092873 15456 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:07:32.118774 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:32.032423 15447 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:07:32.097088 15358 consensus_meta.cc:287] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.520s	user 0.015s	sys 0.002s
I20260709 13:07:32.129805 12806 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:31.990681 15446 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 13:07:32.141571 15446 consensus_queue.cc:1243] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:32.143976 15445 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.145097 15131 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.145881 15131 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.148700 12725 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:32.144843 15445 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.151798 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.154332 12806 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:07:32.154815 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 79577.4us
I20260709 13:07:32.159227 12729 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:32.159381 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 319883us
I20260709 13:07:32.157320 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.162595 12725 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:32.127101 15358 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.167106 12730 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.196110 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.210338 15470 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.211017 15470 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:32.151897 15443 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.213297 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.152360 15435 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.215292 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.221593 12730 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:32.215803 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.224231 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.224370 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.224834 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.222911 12724 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:32.224206 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.226308 12873 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:32.227917 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:32.228684 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.230641 12874 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:32.233021 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.188267 15210 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.189451 15131 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.241087 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:32.239471 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59012.5us
I20260709 13:07:32.251161 15446 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 13:07:32.297932 15454 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:07:32.298475 15133 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:32.299108 15460 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:32.299883 12808 raft_consensus.cc:2368] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
I20260709 13:07:32.211958 15470 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.302423 15470 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.305020 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.305806 12880 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:32.306675 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 219620us
I20260709 13:07:32.308023 12724 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:07:32.301477 15463 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:07:32.237160 15453 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.327s	user 0.003s	sys 0.000s
I20260709 13:07:32.236881 15468 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.320514 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:32.329113 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.339017 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:32.340052 12806 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.343770 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.344830 12730 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:32.345966 15459 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:32.232810 15435 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:32.328121 15431 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.005s
I20260709 13:07:32.254889 15210 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.255290 15443 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:32.370354 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 119547us
I20260709 13:07:32.379967 12730 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:32.376933 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59696.6us
I20260709 13:07:32.354250 15447 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.387141 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.362689 15431 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.401384 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:32.334491 15468 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.409413 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.410197 12724 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.414961 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:32.359881 15449 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:32.428659 15429 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:32.418720 15455 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.418s	user 0.005s	sys 0.000s
I20260709 13:07:32.405009 15131 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.432544 15131 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.433911 15475 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.434494 15475 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.434886 15475 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.434934 15131 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.435508 15131 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.439934 15433 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.440419 15433 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:32.440599 15419 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.441021 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:32.441594 15292 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.441403 15433 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.441900 15419 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:32.442041 15292 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:32.442384 15419 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.442776 15419 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.443120 15292 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.444427 15292 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.411988 15358 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:32.450001 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.453680 12727 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:32.454326 12727 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:32.441998 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:32.460095 15358 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.462165 15358 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.466920 12806 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:32.468312 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2226e1c2db5f441197fe25690778db23"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:32.469202 12876 raft_consensus.cc:606] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:32.473471 15133 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:32.474068 15432 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:32.475637 15435 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:32.477330 15468 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.479490 15449 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.480607 15473 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.481050 15473 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:32.482010 15473 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.483078 15473 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.485492 15436 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.486093 15436 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:32.486953 15436 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:32.488270 15436 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.480643 15210 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:32.489270 12727 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:32.490272 12727 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.491566 12726 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:32.492823 12732 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.493728 15445 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:32.493993 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52087.5us
I20260709 13:07:32.494525 15450 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.495035 15450 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.495411 15450 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.494582 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.500691 12728 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.504781 12732 pending_rounds.cc:85] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 3
I20260709 13:07:32.505172 12732 pending_rounds.cc:107] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:32.505475 12732 raft_consensus.cc:2889] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.500005 15442 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.506409 15442 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:32.503796 12724 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:32.521320 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.523972 12724 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:32.488643 15410 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 13:07:32.535035 15442 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.449527 15131 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.537084 15442 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.538271 15131 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.543164 12804 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:32.479429 15443 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:32.547060 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 162086us
I20260709 13:07:32.561113 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.562762 12724 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:32.545405 15467 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.581112 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:32.547869 15445 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.597573 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.599629 12724 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:32.603794 15470 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.604468 15470 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.604946 15470 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.582437 15467 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.560484 15358 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.633260 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:32.647408 13486 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:32.653337 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.659353 15188 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.674566 15188 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.675053 15188 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.679416 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.680663 12724 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:32.685602 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.690598 12727 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:32.691623 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.704118 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.709681 12875 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:32.701120 12728 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:32.713052 12729 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:32.713115 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 218088us
I20260709 13:07:32.717983 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:32.718844 12875 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.718941 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.721840 12729 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:32.723802 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.724961 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.736728 12725 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:32.729708 15196 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:32.730280 15435 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:32.731019 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52423.8us
I20260709 13:07:32.732025 12731 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.633894 15445 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:32.730280 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.739778 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.737655 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:32.733973 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 136064us
I20260709 13:07:32.744645 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.748885 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:32.751756 12731 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:07:32.735239 15472 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:07:32.756933 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.757273 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.760901 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.761910 12728 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:32.763454 15482 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.768496 15482 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.764314 15467 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.764791 15474 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.788561 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:32.788903 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44389.6us
I20260709 13:07:32.770124 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.770067 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.746698 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:32.763583 12874 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:32.746523 15461 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:07:32.735627 15479 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.777138 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:32.735486 15485 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.735760 15480 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.790350 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.793588 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:32.813815 12879 raft_consensus.cc:2410] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:32.735284 15481 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:32.798951 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.737655 15196 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:32.810139 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:32.757943 15436 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.772562 15492 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.819672 12881 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:32.828830 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51651us
I20260709 13:07:32.788251 15438 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:32.840968 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.844540 15469 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.839143 15492 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.852149 15475 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.855080 15475 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.856719 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.857760 15292 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.858623 15292 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.859405 12880 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:32.860710 15133 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.861399 15410 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:32.772111 15431 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:07:32.865824 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67016.9us
I20260709 13:07:32.888254 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:32.867449 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.870627 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.883752 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 915) took 1021 ms. Trace:
I20260709 13:07:32.890635 12805 rpcz_store.cc:276] 0709 13:07:31.862422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.864129 (+  1707us) service_pool.cc:224] Handling call
0709 13:07:31.864502 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.908258 (+ 43756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.908298 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.909022 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:07:31.997942 (+ 88920us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:32.028539 (+ 30597us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.029483 (+   944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.029556 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.502126 (+472570us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800232ba0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:32.838349 (+336223us) raft_consensus.cc:1685] finished
0709 13:07:32.883397 (+ 45048us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.883642 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46123,"prepare.queue_time_us":27196,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":99492,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":33595,"spinlock_wait_cycles":22409856,"thread_start_us":88411,"threads_started":1,"wal-append.queue_time_us":174552}
I20260709 13:07:32.847499 15196 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.823876 15436 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.901902 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:32.826110 15467 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.818972 15481 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.830212 15443 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:32.907128 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.902654 12729 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:32.908486 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 135046us
W20260709 13:07:32.910689 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 173112us
I20260709 13:07:32.851845 15492 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:32.924944 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 178443us
I20260709 13:07:32.895900 15480 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:32.934953 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46925.8us
I20260709 13:07:32.907405 15436 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.905537 15433 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.826844 15135 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:07:32.938244 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:32.912344 15443 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:32.905500 15467 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:32.944315 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.912832 15481 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.823721 15485 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:32.933069 15480 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.975039 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:32.939277 15475 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.823239 15479 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:32.940507 15432 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.940127 15492 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.931020 15450 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:32.971721 15443 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:32.997380 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53226.6us
I20260709 13:07:32.978561 15445 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:32.924310 15133 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:33.012492 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:32.930382 15131 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:32.950580 15469 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:07:33.009461 15480 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.027853 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:33.010591 12726 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:32.982031 15485 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:32.969934 15459 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:33.044399 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 123998us
I20260709 13:07:33.023172 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:33.045763 15476 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.046173 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.046454 15476 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.047621 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:33.011931 15447 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.048928 15133 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.049561 15410 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.050151 15410 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.050681 15410 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.012094 15438 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:07:33.033401 15432 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.036604 15445 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.052100 15475 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.109131 15475 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.095630 15292 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.096355 15482 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.043561 15442 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.506s	user 0.017s	sys 0.003s
I20260709 13:07:33.110764 15442 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:33.111130 15470 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.506s	user 0.019s	sys 0.004s
I20260709 13:07:33.111271 15442 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.055298 15447 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.112339 15447 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.022907 15492 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.115985 15471 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.188s
W20260709 13:07:33.120234 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.097972 15467 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.122596 15467 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:33.124853 15489 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:07:33.125216 15450 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.132207 15497 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:33.133033 15497 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.080330 12875 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:33.104059 15485 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.107005 15493 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:33.137812 15479 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:33.049576 15133 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.138581 15133 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.090893 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.133131 15475 consensus_queue.cc:1243] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:33.134334 15497 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:33.151679 15473 consensus_meta.cc:287] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.666s	user 0.015s	sys 0.009s
W20260709 13:07:33.152967 15419 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.007s
I20260709 13:07:33.153744 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:33.112349 15442 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.111619 15470 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:33.161379 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 112592us
W20260709 13:07:33.094431 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 144343us
I20260709 13:07:33.097472 15432 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:33.176720 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 202170us
I20260709 13:07:33.178870 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.180415 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:33.180341 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 295091us
W20260709 13:07:33.182225 12699 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.466s (SENT)
I20260709 13:07:33.182616 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.172435 13518 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:33.163481 15188 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.171295 15476 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.192986 15474 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.205747 15470 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:33.208326 15436 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.210556 15436 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.211374 15492 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.212849 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.213877 12728 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.194569 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:33.167665 15419 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.220467 15492 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.220983 15492 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.221328 15492 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.222074 15419 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.220517 15450 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:33.200266 15510 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.225410 15510 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:33.225754 15510 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.226625 15510 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.198652 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.219477 15432 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.229032 15432 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.203599 15188 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.233698 15135 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.234598 15443 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:33.241007 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.246512 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.252444 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70246.7us
I20260709 13:07:33.259536 12728 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:33.227890 15510 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.263082 13486 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:33.231468 15480 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:33.264571 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 93578.3us
I20260709 13:07:33.268800 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:33.269033 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.269910 12728 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:33.270709 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.284276 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.286139 12727 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:33.290078 15292 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:33.292441 15505 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.293155 15505 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.283465 15358 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.294263 15505 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.294592 15358 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.297778 15509 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.298105 15358 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.298426 15509 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.298923 15509 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.231885 15133 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.300212 15506 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.300951 15506 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.301919 15133 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.303154 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.274778 12629 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 4 to 7, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:33.263249 15433 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.310748 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:33.288347 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 260608us
W20260709 13:07:33.312866 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 267523us
W20260709 13:07:33.324002 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.288095 15188 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.320513 12629 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 4 to 8, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 8 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:33.310011 15358 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.329346 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.283946 15419 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:33.334066 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.333515 15500 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:33.352496 15512 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.353150 15512 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.346498 15442 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.360057 15496 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.360651 15442 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.360776 15496 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.361335 15442 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.325384 15481 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.346673 15133 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.302170 15506 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:33.373083 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81729.5us
I20260709 13:07:33.379341 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:33.380573 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46622us
I20260709 13:07:33.386427 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:33.387032 13521 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.379635 12629 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.381031 15500 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.382265 15496 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.382351 15512 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.383255 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 153) took 9553 ms. Trace:
I20260709 13:07:33.315481 15433 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.334942 15188 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:33.396907 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:33.389767 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 72469.9us
I20260709 13:07:33.389572 12629 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.398556 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:33.393473 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:33.399324 12629 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 3 to 4, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 4 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:07:33.401095 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 113454us
I20260709 13:07:33.393127 12627 rpcz_store.cc:276] 0709 13:07:23.876651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.876912 (+   261us) service_pool.cc:224] Handling call
0709 13:07:33.383159 (+9506247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:31.044325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:31.087221 (+ 42896us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:31.185182 (+ 97961us) write_op.cc:435] Acquired schema lock
0709 13:07:31.185212 (+    30us) tablet.cc:662] Decoding operations
0709 13:07:31.580301 (+395089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:31.629373 (+ 49072us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:31.638465 (+  9092us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:31.679043 (+ 40578us) tablet.cc:701] Row locks acquired
0709 13:07:31.679108 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:07:31.679389 (+   281us) write_op.cc:270] Start()
0709 13:07:31.679607 (+   218us) write_op.cc:276] Timestamp: P: 1783602451679292 usec, L: 0
0709 13:07:31.679635 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:31.795700 (+116065us) log.cc:844] Serialized 6367 byte log entry
0709 13:07:32.602680 (+806980us) op_driver.cc:464] REPLICATION: finished
0709 13:07:32.707903 (+105223us) write_op.cc:301] APPLY: starting
0709 13:07:32.708069 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:32.708505 (+   436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:32.708675 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:32.711070 (+  2395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:32.711530 (+   460us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:07:32.711606 (+    76us) write_op.cc:312] APPLY: finished
0709 13:07:32.716527 (+  4921us) log.cc:844] Serialized 112 byte log entry
0709 13:07:32.716813 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.717058 (+   245us) write_op.cc:454] Released schema lock
0709 13:07:32.717166 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:32.720410 (+  3244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.720441 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1785965,"reported_tablets":50,"spinlock_wait_cycles":112640,"child_traces":[["op",{"apply.queue_time_us":104837,"apply.run_cpu_time_us":5546,"apply.run_wall_time_us":12488,"num_ops":16,"prepare.queue_time_us":260715,"prepare.run_cpu_time_us":14763,"prepare.run_wall_time_us":803521,"raft.queue_time_us":231753,"raft.run_cpu_time_us":12914,"raft.run_wall_time_us":127507,"replication_time_us":922701,"thread_start_us":274856,"threads_started":4,"wal-append.queue_time_us":58387}]]}
I20260709 13:07:33.407316 12629 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 2 to 4, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:33.409121 15497 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.347337 15358 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.393169 15475 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:33.413949 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:33.416375 15188 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.392976 15432 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:33.421254 15133 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.397071 15480 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.457463 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44039.4us
I20260709 13:07:33.370265 15447 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.412699 12629 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 6, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), now has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:33.474682 12629 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.476544 13521 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:33.477166 12629 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.427176 15481 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.431720 15500 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.486910 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.425920 15410 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.494349 15410 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.494952 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81130us
I20260709 13:07:33.495276 15410 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.424319 15496 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.426980 15433 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.415084 15475 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.423790 15358 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.504211 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 117110us
I20260709 13:07:33.463330 15474 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.423414 15442 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.512531 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.506254 15475 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.426050 15509 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:07:33.530447 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.499109 15410 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.534402 15520 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:33.511528 15494 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:33.540994 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44006.4us
I20260709 13:07:33.544183 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.545078 13518 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:33.528385 15512 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.507972 15485 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:07:33.567358 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 62303.8us
I20260709 13:07:33.568919 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.511741 15474 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.572955 15527 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.585584 15527 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.585970 15527 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.535794 15492 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.577112 15509 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.581135 15474 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:33.588346 15505 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:07:33.596827 15447 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.579330 15525 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:33.616940 15442 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.611830 15517 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.619197 15492 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:33.618731 15517 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.609340 15512 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.630952 15410 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.634320 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:33.630985 15419 raft_consensus.cc:993] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:07:33.642750 15419 raft_consensus.cc:1081] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:07:33.652271 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.653752 15410 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.654438 15410 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.655464 15410 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.663082 15474 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.663842 15474 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.666352 15474 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.670771 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:33.623900 15517 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:33.625047 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:33.627084 15443 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:33.629346 15514 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.193s	user 0.000s	sys 0.002s
W20260709 13:07:33.673276 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 176199us
I20260709 13:07:33.673365 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:33.672641 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:33.679183 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:33.685883 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.675923 15512 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.692734 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:33.703065 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.711977 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.683445 15480 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.720014 15474 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.720202 15475 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.720924 15474 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:33.724323 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45825.4us
I20260709 13:07:33.675688 15442 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:33.688298 15292 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.727825 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 168582us
I20260709 13:07:33.713800 15492 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.706408 15443 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:33.735332 15475 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:33.735422 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.730089 15474 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:33.713487 15512 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.766429 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.769235 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.769589 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.737957 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.770203 12727 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.739081 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.741902 12877 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:33.742882 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.769323 12878 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:33.772832 12881 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:33.743928 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:33.744990 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.774298 12874 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:33.745956 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.749670 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.776136 12732 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:33.751578 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.707037 15532 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:07:33.756134 15509 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.735455 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.759330 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:33.736891 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:33.812961 13521 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.777501 12880 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:33.779101 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:33.770313 12728 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:33.817085 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.817857 12728 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.760399 15442 consensus_queue.cc:1243] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:33.785600 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.823976 12732 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:33.825286 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.760942 15492 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.790778 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.790990 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.782246 15474 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.791757 15475 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.791009 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.792418 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:33.791684 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56307.4us
I20260709 13:07:33.806483 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:33.826164 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.827176 12732 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.827803 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:33.829278 12729 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:33.791651 15529 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:33.851574 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:33.782855 15509 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.850720 15433 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.870123 12728 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:33.780364 15443 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.876987 12729 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:33.871510 15475 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.831529 15474 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.832960 15492 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.831768 15358 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:33.881302 15442 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.884557 12727 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:33.920640 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.865700 15467 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.890064 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:33.884590 15475 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:33.893373 15476 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.884631 15496 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:33.902663 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.885599 15534 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:33.922161 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:33.960930 12727 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.885977 15512 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.969420 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:33.971058 15496 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:33.958220 15530 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.864521 15433 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:33.874704 15509 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.887706 15474 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.962916 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.750s (SENT) [suppressed 35 similar messages]
I20260709 13:07:33.962504 15476 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:33.957523 15467 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.027303 12727 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:34.033104 12730 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:33.925060 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.041875 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:34.059475 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.059288 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.061896 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.072870 12808 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.063174 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.074385 12805 raft_consensus.cc:2410] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:34.063901 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.075104 12801 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.065057 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:34.068331 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 309142us
I20260709 13:07:34.062654 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.076735 12800 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:34.078342 12848 leader_election.cc:400] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
I20260709 13:07:34.078711 12848 leader_election.cc:403] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.011159 15496 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.085106 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.085476 12799 raft_consensus.cc:2410] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:34.090799 12807 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:34.092581 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.093914 12727 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:34.089603 12802 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:34.122414 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.005026 15530 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:34.056916 15517 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.059873 15520 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.122512 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.135260 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.147104 12806 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:34.139278 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:34.148460 12874 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:34.149505 12803 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:34.149359 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.144264 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.150246 12728 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.150182 12800 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:34.135856 15485 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:07:34.147378 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.162309 12808 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:34.177398 12878 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:34.136729 15476 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:34.177309 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.436358 12732 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
W20260709 13:07:34.373353 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.420802 12801 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:34.421070 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:34.178021 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 280140us
W20260709 13:07:34.420666 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 342585us
I20260709 13:07:34.227922 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.449334 12732 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:34.476883 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.555598 12801 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.555852 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.467715 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.556790 12806 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.558266 12727 raft_consensus.cc:2368] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:07:34.559486 12730 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:34.560536 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.561048 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.562145 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.562397 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.563167 12799 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.555320 15442 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:34.562013 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.564076 15442 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.564766 12807 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.563123 12804 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:34.565981 15521 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.566206 15442 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:34.561980 12806 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:34.566638 15521 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:34.474040 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.568161 12805 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:34.569252 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.572001 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.203186 15410 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.572914 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.579864 12808 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:34.580340 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.580585 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.582243 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:34.213353 15514 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:34.575063 12727 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.584728 12800 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:34.577450 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.578962 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.572626 12804 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:34.592783 12732 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:34.595064 12731 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.044s
W20260709 13:07:34.595489 12731 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.045s
I20260709 13:07:34.581856 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.596283 12802 raft_consensus.cc:2393] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.596503 12730 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.596829 12806 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:34.573050 15527 consensus_meta.cc:287] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.971s	user 0.012s	sys 0.003s
I20260709 13:07:34.577107 12803 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.547253 15506 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.597594 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.622201 12732 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.468699 15433 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:34.153656 15520 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.578641 15476 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:34.595180 12699 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.026s
W20260709 13:07:34.629405 12699 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.029s
W20260709 13:07:34.629905 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 667133us
I20260709 13:07:34.602639 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.620087 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.634318 12807 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.274236 15358 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:34.289767 15443 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:34.641004 15443 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:34.155503 15517 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.613435 12728 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:34.649992 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:34.650408 12727 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:34.651480 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:34.653936 12699 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.945s (SENT)
I20260709 13:07:34.654767 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:34.659896 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:34.661234 12732 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:34.665515 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.666468 12732 raft_consensus.cc:2376] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:34.642369 15358 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:34.646179 15475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.003s
I20260709 13:07:34.668752 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.594590 15292 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:07:34.594168 15410 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.683177 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.705823 12802 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:34.678974 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.635619 15467 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:34.667601 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.687646 12728 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:34.670729 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.708613 12730 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:34.708942 12727 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:34.658493 15133 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.710017 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.708655 12732 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:34.722275 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.659415 15442 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:34.624982 15527 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.732103 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:34.687548 15475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.004s
I20260709 13:07:34.724717 12727 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:34.737066 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.738224 12727 raft_consensus.cc:2410] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:34.736447 12730 raft_consensus.cc:2376] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:34.730809 15133 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.632843 15506 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.724866 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.731199 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.749203 12728 raft_consensus.cc:2410] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:34.745047 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.751060 12732 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:34.755208 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.755465 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.755887 12802 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:34.707391 15499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.009s
W20260709 13:07:34.744326 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.745450 12879 raft_consensus.cc:2368] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:34.758530 12807 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:34.760360 12724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.006s
W20260709 13:07:34.760700 12724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.006s
W20260709 13:07:34.761129 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 319600us
I20260709 13:07:34.761826 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:34.658486 15545 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.708491 15556 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.710404 15535 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.764884 12732 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.783147 12732 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:34.769567 12727 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.666652 15443 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:34.773456 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 179796us
W20260709 13:07:34.773475 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.740569 15210 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.786274 12727 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:07:34.816533 12808 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:34.732667 15467 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:07:34.836493 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.838322 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.839414 12799 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.840027 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.791452 12801 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:34.794252 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:34.765511 15499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.009s
I20260709 13:07:34.782155 15535 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.820545 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.742214 15442 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:34.980561 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.981464 12727 pending_rounds.cc:85] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:34.982098 12727 pending_rounds.cc:107] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:34.948652 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:34.982990 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.983232 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1578) took 1094 ms. Trace:
I20260709 13:07:34.983754 12808 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:34.943748 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.946467 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1854) took 1202 ms. Trace:
I20260709 13:07:34.929513 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 931) took 1061 ms. Trace:
I20260709 13:07:34.984949 12805 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:34.956184 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.935483 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:34.987360 12733 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:34.934264 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55266us
I20260709 13:07:34.840247 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:34.982455 12727 raft_consensus.cc:2889] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.990274 12806 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.990299 12807 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:34.993587 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.996088 12802 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:34.787122 15475 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.996520 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1606) took 1029 ms. Trace:
I20260709 13:07:34.984668 12879 rpcz_store.cc:276] 0709 13:07:33.743541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.743670 (+   129us) service_pool.cc:224] Handling call
0709 13:07:34.946030 (+1202360us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54002085d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:34.946306 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222528896}
I20260709 13:07:34.997066 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.983628 12728 rpcz_store.cc:276] 0709 13:07:33.889350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.764142 (+874792us) service_pool.cc:224] Handling call
0709 13:07:34.948428 (+184286us) spinlock_profiling.cc:243] Waited 937 us on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:34.983172 (+ 34744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154368}
I20260709 13:07:34.841470 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:34.998634 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:34.998051 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 260970us
W20260709 13:07:35.001119 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.996886 12733 rpcz_store.cc:276] 0709 13:07:33.967460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.703996 (+736536us) service_pool.cc:224] Handling call
0709 13:07:34.996461 (+292465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.009760 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:35.014801 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 253091us
W20260709 13:07:34.936327 15553 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:07:34.938953 15550 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:34.816959 15210 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:34.985324 12725 rpcz_store.cc:276] 0709 13:07:33.806573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.806863 (+   290us) service_pool.cc:224] Handling call
0709 13:07:33.827981 (+ 21118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.829789 (+  1808us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:34.057464 (+227675us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.867314 (+809850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.867402 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:34.867466 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.867563 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.867717 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24998,"prepare.queue_time_us":847726,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":390973,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":80071,"thread_start_us":897277,"threads_started":3,"wal-append.queue_time_us":735661}
I20260709 13:07:34.829349 15513 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:35.019907 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.016067 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:35.020380 12880 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:35.020836 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:34.936945 15541 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:07:34.977250 15433 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.980772 15521 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:34.982672 15410 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:34.943797 15566 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:34.944808 15560 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:34.786331 15556 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.026226 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.061825 12806 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
W20260709 13:07:35.169338 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.930068 15494 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:35.309118 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.023s	sys 0.064s
W20260709 13:07:35.375492 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.023s	sys 0.070s
I20260709 13:07:34.953336 15517 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:35.356139 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.354704 12804 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
W20260709 13:07:35.358664 12724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.013s	sys 0.009s
I20260709 13:07:35.062039 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:35.395305 12724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.009s
I20260709 13:07:35.060665 12728 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:35.396334 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 933) took 1585 ms. Trace:
I20260709 13:07:35.396605 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1601) took 1468 ms. Trace:
I20260709 13:07:35.397239 12728 rpcz_store.cc:276] 0709 13:07:33.928264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.060213 (+1131949us) service_pool.cc:224] Handling call
0709 13:07:35.060467 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.396245 (+335778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.396524 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:35.361392 15419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.390s	user 0.009s	sys 0.021s
I20260709 13:07:35.403908 15576 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.298425 15133 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.403877 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 938) took 1527 ms. Trace:
I20260709 13:07:35.036404 15210 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.045842 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:35.404345 15559 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
I20260709 13:07:35.141310 12803 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:35.337062 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 930) took 1547 ms. Trace:
W20260709 13:07:35.238854 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 124734us
I20260709 13:07:35.414523 12805 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:35.197192 12848 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:35.365489 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 170) took 1304 ms. Trace:
I20260709 13:07:34.930661 15563 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:35.372221 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:35.373025 12807 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:35.372910 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:34.944387 15527 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:34.997826 15535 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.374439 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:35.376428 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 716706us
W20260709 13:07:35.305348 13487 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.863s (SENT)
W20260709 13:07:35.018605 15551 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:07:35.072708 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.019173 15557 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.026172 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2226e1c2db5f441197fe25690778db23"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:07:35.334908 15568 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.401576 12730 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.092149 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:35.509502 13520 raft_consensus.cc:2410] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:35.406351 12728 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.404449 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.407845 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.023197 15512 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.405736 12729 rpcz_store.cc:276] 0709 13:07:33.876837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.879698 (+  2861us) service_pool.cc:224] Handling call
0709 13:07:33.885722 (+  6024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.886085 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.886109 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.886594 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.289129 (+402535us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:35.403041 (+1113912us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b180032f3e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c0d0bf
0709 13:07:35.403221 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.403445 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.403524 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.403562 (+    38us) raft_consensus.cc:1685] finished
0709 13:07:35.403674 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.403814 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8818,"prepare.queue_time_us":450949,"prepare.run_cpu_time_us":1743,"prepare.run_wall_time_us":3719,"raft.queue_time_us":744447,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":5630,"spinlock_wait_cycles":16503680,"thread_start_us":746383,"threads_started":2,"wal-append.queue_time_us":820484}
W20260709 13:07:35.066143 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.173272 15520 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:35.374706 15513 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:35.406634 12724 rpcz_store.cc:276] 0709 13:07:33.811247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.834953 (+ 23706us) service_pool.cc:224] Handling call
0709 13:07:33.865935 (+ 30982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.866174 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:34.232235 (+366061us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.395783 (+1163548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.395867 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:35.395933 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.396055 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.396247 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33199,"prepare.queue_time_us":836278,"prepare.run_cpu_time_us":2198,"prepare.run_wall_time_us":2858,"raft.queue_time_us":261717,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":51671,"thread_start_us":1498032,"threads_started":3,"wal-append.queue_time_us":714681}
I20260709 13:07:35.375411 15494 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:34.792182 15545 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.429529 15573 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:35.414250 15509 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.392s	user 0.009s	sys 0.005s
I20260709 13:07:35.430356 15443 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.430990 15506 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:35.407330 15419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.439s	user 0.010s	sys 0.022s
I20260709 13:07:35.380347 15433 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:35.439714 15492 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.504s	user 0.011s	sys 0.000s
I20260709 13:07:35.522194 15552 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.440591 15442 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.441452 15556 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.398599 15560 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.536312 15583 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.574656 15583 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.576013 15560 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.375865 15566 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.577245 15583 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.578130 15566 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:35.447717 15541 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:35.404632 15576 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.578253 15494 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.579638 15494 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.580655 15576 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.448443 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:35.582183 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.582983 12805 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:35.416572 15530 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.270779 15544 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
W20260709 13:07:35.453487 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 256439us
I20260709 13:07:35.456697 12806 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:35.586587 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.007s	sys 0.020s
W20260709 13:07:35.589287 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.007s	sys 0.020s
I20260709 13:07:35.457316 12880 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.521340 15512 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.020017 15475 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.455092 12726 rpcz_store.cc:276] 0709 13:07:33.806059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.806220 (+   161us) service_pool.cc:224] Handling call
0709 13:07:33.806527 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.821781 (+ 15254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.821834 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.855864 (+ 34030us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.398801 (+542937us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:34.399015 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.399115 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.336673 (+937558us) raft_consensus.cc:1685] finished
0709 13:07:35.336713 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.336968 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15249,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":23086,"thread_start_us":463464,"threads_started":1,"wal-append.queue_time_us":764478}
I20260709 13:07:35.495100 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.597072 12807 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:35.503912 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.504470 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:35.597524 12726 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:35.505793 13487 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:35.598979 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 293724us
I20260709 13:07:35.507544 12733 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.599880 12733 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:35.510998 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 495139us
I20260709 13:07:35.600883 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:35.495162 15485 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.342s	user 0.012s	sys 0.001s
W20260709 13:07:35.494822 15476 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.004s
I20260709 13:07:35.515586 12881 raft_consensus.cc:2368] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:07:35.515883 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:35.602146 12803 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:35.523150 12699 leader_election.cc:336] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.155s (SENT)
I20260709 13:07:35.533607 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:35.541831 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.602617 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:35.603012 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.523743 15513 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.522024 15547 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:35.526600 15292 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.440083 15569 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.566918 15443 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.572744 12729 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:35.660566 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 137489us
I20260709 13:07:35.660615 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 282) took 1686 ms. Trace:
I20260709 13:07:35.661346 12729 rpcz_store.cc:276] 0709 13:07:33.974305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.537820 (+1563515us) service_pool.cc:224] Handling call
0709 13:07:35.567916 (+ 30096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.660293 (+ 92377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.660539 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.514366 15557 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:35.510000 12731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.014s	sys 0.015s
W20260709 13:07:35.670533 12731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.015s
I20260709 13:07:35.420603 12877 rpcz_store.cc:276] 0709 13:07:34.060806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.060957 (+   151us) service_pool.cc:224] Handling call
0709 13:07:34.089776 (+ 28819us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.131631 (+ 41855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.131677 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.428421 (+296744us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.787560 (+359139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:35.325252 (+537692us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.365034 (+ 39782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.365144 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.365208 (+    64us) raft_consensus.cc:1685] finished
0709 13:07:35.365229 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.365409 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80799,"raft.queue_time_us":81782,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":34709,"thread_start_us":807612,"threads_started":2,"wal-append.queue_time_us":838399}
I20260709 13:07:35.591948 12728 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:35.671641 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1607) took 1703 ms. Trace:
I20260709 13:07:35.671983 12728 rpcz_store.cc:276] 0709 13:07:33.967732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.405897 (+1438165us) service_pool.cc:224] Handling call
0709 13:07:35.406192 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.671403 (+265211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.671585 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.595932 12806 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:35.501797 15510 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:35.545521 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 283) took 1125 ms. Trace:
I20260709 13:07:35.639161 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:35.604643 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:35.605957 12807 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:35.536552 15509 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:35.587236 15474 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.568s	user 0.013s	sys 0.001s
I20260709 13:07:35.638974 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:35.646555 12804 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:35.647310 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1850) took 1907 ms. Trace:
I20260709 13:07:35.676259 12875 rpcz_store.cc:276] 0709 13:07:33.739796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.739945 (+   149us) service_pool.cc:224] Handling call
0709 13:07:33.740350 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.784272 (+ 43922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.784319 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.875738 (+ 91419us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:33.876184 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.177653 (+301469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:34.177710 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.177791 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.604826 (+1427035us) raft_consensus.cc:1685] finished
0709 13:07:35.604847 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.647239 (+ 42392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43408,"raft.queue_time_us":51304,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":148,"spinlock_wait_cycles":10805632,"thread_start_us":283203,"threads_started":1,"wal-append.queue_time_us":858727}
I20260709 13:07:35.679184 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.584491 15492 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.638967 12808 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:35.652681 12800 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.657500 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:35.658802 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 154503us
I20260709 13:07:35.659174 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1826) took 1085 ms. Trace:
W20260709 13:07:35.659514 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68738.2us
I20260709 13:07:35.506145 15210 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.669230 13520 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:35.517118 15568 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.604458 15587 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.605825 15442 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.537009 15573 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.604586 15500 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.639559 15485 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
I20260709 13:07:35.673971 12724 rpcz_store.cc:276] 0709 13:07:34.420733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.544361 (+1123628us) service_pool.cc:224] Handling call
0709 13:07:35.544815 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.545065 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.545102 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.545161 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.545217 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.545295 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.545445 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.686288 12847 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:35.686465 12801 rpcz_store.cc:276] 0709 13:07:34.571679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.576150 (+  4471us) service_pool.cc:224] Handling call
0709 13:07:35.656456 (+1080306us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003093d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:35.656620 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261512960}
I20260709 13:07:35.680341 15475 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.654863 15476 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.693418 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.681638 15530 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:35.694192 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 55343.5us
I20260709 13:07:35.694646 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.695132 12806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:07:35.733816 12806 raft_consensus.cc:606] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:35.734234 12806 raft_consensus.cc:614] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:35.654757 15569 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.640319 15588 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.707059 12880 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:35.586181 15552 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.718201 12873 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:35.673909 15133 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.673683 15576 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:35.720894 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63426.8us
I20260709 13:07:35.727794 12881 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.639936 15582 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.729194 12878 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.674469 15443 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.729171 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:35.681391 15419 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.673817 15510 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:35.693805 15496 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.738195 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.673426 15499 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:35.661406 15292 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.697384 15506 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:35.741981 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.745082 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:35.712128 12879 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:35.690026 15474 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:35.783283 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54254.1us
I20260709 13:07:35.781351 15583 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.790576 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:35.736018 15475 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.794320 12724 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:35.857942 12724 pending_rounds.cc:85] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 3
I20260709 13:07:35.858255 12724 pending_rounds.cc:107] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:35.858466 12724 raft_consensus.cc:2889] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:35.787472 15580 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:35.744335 15588 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.745848 15569 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.748075 15530 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:35.804258 12847 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:35.864984 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 60851.4us
I20260709 13:07:35.866464 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:35.743268 15537 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:35.714324 15587 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.717442 15442 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.840628 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:35.829525 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.790535 15510 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.793833 15485 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:35.735440 15476 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.859802 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:35.781817 15133 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.865226 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 945) took 1154 ms. Trace:
I20260709 13:07:35.894011 12881 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:35.786047 15582 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.790082 15419 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.864560 15588 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:35.875514 15594 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:35.877251 15474 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.879853 15512 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.807816 15506 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.880676 15210 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:35.881006 15573 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.799376 15496 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.881592 15509 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:35.862810 15475 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.881417 15552 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:35.900480 12874 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:35.862982 15433 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:35.911427 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.916536 12724 rpcz_store.cc:276] 0709 13:07:34.711204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.748917 (+1037713us) service_pool.cc:224] Handling call
0709 13:07:35.788023 (+ 39106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.864928 (+ 76905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.865160 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:35.804967 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 70899.7us
I20260709 13:07:35.846155 15583 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:35.918330 12877 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:35.907912 12733 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.882395 15521 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:35.987063 15521 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:35.870254 15545 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:35.934909 12881 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:35.988736 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:35.989074 12733 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:35.989609 15584 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:07:35.989775 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52116 (request call id 939) took 2065 ms. Trace:
I20260709 13:07:35.990181 12733 rpcz_store.cc:276] 0709 13:07:33.924101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.020626 (+1096525us) service_pool.cc:224] Handling call
0709 13:07:35.989647 (+969021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.991413 15419 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.990195 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:35.993243 15506 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.993870 15530 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:35.994577 15521 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:35.996706 15292 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:35.916563 15537 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:35.964716 15485 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:35.970063 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.983073 12728 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:35.987305 15585 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:35.988781 15442 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:35.991534 12733 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.918190 15517 raft_consensus.cc:2764] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:07:35.952807 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 206683us
W20260709 13:07:36.001422 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.013206 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 946) took 1301 ms. Trace:
I20260709 13:07:36.016057 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.022078 12724 rpcz_store.cc:276] 0709 13:07:34.711598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.977862 (+1266264us) service_pool.cc:224] Handling call
0709 13:07:36.012457 (+ 34595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.012731 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.012769 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.012826 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.012873 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.012943 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.013115 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.018811 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 947) took 1307 ms. Trace:
I20260709 13:07:36.023424 12877 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:36.023525 12733 rpcz_store.cc:276] 0709 13:07:34.711879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.990977 (+1279098us) service_pool.cc:224] Handling call
0709 13:07:35.991329 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.018501 (+ 27172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.018752 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.082283 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 949) took 1298 ms. Trace:
I20260709 13:07:36.083583 12733 rpcz_store.cc:276] 0709 13:07:34.783796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.081448 (+1297652us) service_pool.cc:224] Handling call
0709 13:07:36.081744 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.081927 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.081952 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.081995 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.082030 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.082096 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.082225 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.071995 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1590) took 2167 ms. Trace:
I20260709 13:07:36.086794 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1598) took 2177 ms. Trace:
I20260709 13:07:36.087491 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 950) took 1261 ms. Trace:
W20260709 13:07:36.088006 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.079155 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 932) took 2272 ms. Trace:
I20260709 13:07:36.088012 12733 rpcz_store.cc:276] 0709 13:07:34.825909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.086676 (+1260767us) service_pool.cc:224] Handling call
0709 13:07:36.086977 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.087170 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.087197 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.087241 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.087274 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.087329 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.087440 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.092422 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 951) took 1215 ms. Trace:
I20260709 13:07:36.094834 12733 rpcz_store.cc:276] 0709 13:07:34.876817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.091545 (+1214728us) service_pool.cc:224] Handling call
0709 13:07:36.091870 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.092093 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.092122 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.092164 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.092200 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.092252 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.092367 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.087191 12727 rpcz_store.cc:276] 0709 13:07:33.909171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.799040 (+889869us) service_pool.cc:224] Handling call
0709 13:07:34.981263 (+182223us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.074745 (+ 93482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.074799 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.075452 (+   653us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.506117 (+430665us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:35.516420 (+ 10303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.516529 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.086575 (+570046us) raft_consensus.cc:1685] finished
0709 13:07:36.086596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.086739 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18340,"raft.queue_time_us":327340,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":11647,"thread_start_us":223318,"threads_started":1,"wal-append.queue_time_us":550833}
I20260709 13:07:36.085538 12730 rpcz_store.cc:276] 0709 13:07:33.904412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.765707 (+861295us) service_pool.cc:224] Handling call
0709 13:07:34.766071 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.508798 (+742727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.071594 (+562796us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400308c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.071891 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461265280}
I20260709 13:07:36.099743 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.100306 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 285) took 1084 ms. Trace:
I20260709 13:07:36.100721 12727 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:36.100912 12730 rpcz_store.cc:276] 0709 13:07:35.015621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.099275 (+1083654us) service_pool.cc:224] Handling call
0709 13:07:36.099768 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.099933 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.099957 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.099998 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:36.100026 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.100106 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.100237 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32000}
I20260709 13:07:36.104449 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1656) took 1085 ms. Trace:
W20260709 13:07:36.107717 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.108557 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 284) took 1093 ms. Trace:
I20260709 13:07:36.110785 12733 rpcz_store.cc:276] 0709 13:07:35.015372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.097013 (+1081641us) service_pool.cc:224] Handling call
0709 13:07:36.097326 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.107956 (+ 10630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.108003 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.108102 (+    99us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.108157 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.108255 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.108463 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:36.113440 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 242226us
I20260709 13:07:36.016503 15587 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.089983 12731 rpcz_store.cc:276] 0709 13:07:33.810299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.810505 (+   206us) service_pool.cc:224] Handling call
0709 13:07:33.810961 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.929112 (+118151us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:34.596086 (+666974us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.953404 (+357318us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18004128a0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a
0709 13:07:34.954124 (+   720us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.670906 (+716782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.670958 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.671000 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.078792 (+407792us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002d46d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.078856 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.079050 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31365,"prepare.queue_time_us":797070,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":103,"raft.queue_time_us":809609,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":26354,"spinlock_wait_cycles":315366400,"thread_start_us":1539397,"threads_started":3,"wal-append.queue_time_us":351191,"wal-append.run_cpu_time_us":2144,"wal-append.run_wall_time_us":1068103}
I20260709 13:07:36.130524 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.106559 12882 rpcz_store.cc:276] 0709 13:07:35.019267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.021643 (+  2376us) service_pool.cc:224] Handling call
0709 13:07:35.091486 (+ 69843us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.173834 (+ 82348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.173883 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.679518 (+505635us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:35.680247 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.868842 (+188595us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:35.918821 (+ 49979us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.102911 (+184090us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.103349 (+   438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.103705 (+   356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.104020 (+   315us) raft_consensus.cc:1685] finished
0709 13:07:36.104098 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.104380 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10864,"prepare.queue_time_us":48084,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":4181,"raft.queue_time_us":29369,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8130,"spinlock_wait_cycles":14187392,"thread_start_us":369275,"threads_started":2,"wal-append.queue_time_us":334341}
I20260709 13:07:36.068876 15496 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.070426 15475 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.131378 12877 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:36.079145 15568 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.109086 15527 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.019153 15557 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.078315 15582 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.137854 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:36.182029 15476 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:36.179049 15608 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:36.134663 15443 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.204053 15583 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.205225 15569 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:36.207134 15594 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:36.222249 15569 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.208905 15588 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:36.077152 15485 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.129914 15513 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.225199 15513 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:36.217115 15499 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.226887 15499 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.227334 15499 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.231287 12876 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:07:36.076509 15537 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.233883 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1654) took 1222 ms. Trace:
I20260709 13:07:36.234460 12876 rpcz_store.cc:276] 0709 13:07:35.011428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.012987 (+  1559us) service_pool.cc:224] Handling call
0709 13:07:35.013351 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.231816 (+1218465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.233467 (+  1651us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540006ccd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.233792 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800837376}
I20260709 13:07:36.222718 15547 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:36.236140 15547 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.237705 15517 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.238517 15517 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:36.244787 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 529965us
I20260709 13:07:36.246297 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:36.248221 15617 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.250007 15618 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.250507 15618 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.250857 15618 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.251809 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:36.256178 15555 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 1.009s	user 0.005s	sys 0.011s
I20260709 13:07:36.256803 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.264871 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:36.280845 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 301478us
W20260709 13:07:36.305065 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 666063us
I20260709 13:07:36.306727 12696 leader_election.cc:400] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:36.307096 12696 leader_election.cc:403] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.304436 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:36.317140 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 179410us
I20260709 13:07:36.251154 15499 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:36.324460 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 206518us
I20260709 13:07:36.299114 15618 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:36.277760 15513 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:36.344527 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 942) took 1634 ms. Trace:
I20260709 13:07:36.345018 12726 rpcz_store.cc:276] 0709 13:07:34.710132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.598563 (+888431us) service_pool.cc:224] Handling call
0709 13:07:35.598820 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.599024 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:35.678100 (+ 79076us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.344144 (+666044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.344205 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.344253 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.344328 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.344459 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592245,"prepare.queue_time_us":94876,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":147245,"threads_started":2,"wal-append.queue_time_us":190633}
I20260709 13:07:36.355190 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.277741 15496 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:07:36.277594 15617 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:07:36.342386 15133 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.383504 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1652) took 1373 ms. Trace:
I20260709 13:07:36.359287 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:36.377233 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70691.7us
I20260709 13:07:36.377956 15358 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.378492 15443 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.378661 15492 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:36.381677 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1592) took 2474 ms. Trace:
I20260709 13:07:36.384802 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.384698 13520 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:36.383982 12874 rpcz_store.cc:276] 0709 13:07:35.010062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.010727 (+   665us) service_pool.cc:224] Handling call
0709 13:07:36.383031 (+1372304us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540006b8d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:36.383432 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901756800}
W20260709 13:07:36.388279 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 95775.9us
I20260709 13:07:36.392434 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.393530 12874 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:36.395896 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.396843 12874 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:36.399812 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.400965 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.404594 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.404814 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.409467 12879 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:36.385361 12732 rpcz_store.cc:276] 0709 13:07:33.907055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.783915 (+876860us) service_pool.cc:224] Handling call
0709 13:07:34.784246 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.239161 (+454915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.239238 (+    77us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.356915 (+117677us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.565850 (+208935us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:35.631379 (+ 65529us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.253627 (+622248us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b1800460ba0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:36.253824 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.253901 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.379479 (+125578us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b1800460ba0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:36.381349 (+  1870us) raft_consensus.cc:1685] finished
0709 13:07:36.381383 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.381601 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95557,"prepare.queue_time_us":72213,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":1167328,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":86756,"spinlock_wait_cycles":19798144,"thread_start_us":604909,"threads_started":2,"wal-append.queue_time_us":242611}
I20260709 13:07:36.409433 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 948) took 1664 ms. Trace:
I20260709 13:07:36.419188 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.419883 12731 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.420483 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.422863 12731 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:36.425019 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.426035 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.427129 12732 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:36.428181 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.428982 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.429630 12726 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:36.429836 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.430619 12882 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:36.432734 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.433645 12732 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:36.436365 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.436867 13520 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:36.437436 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.438133 12727 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:36.439054 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.439695 12727 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:36.450369 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:36.462213 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.356094 15494 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:07:36.417887 15433 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.519194 15570 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.524217 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.529616 15570 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:36.518841 15500 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.515899 15535 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.994s	user 0.017s	sys 0.000s
W20260709 13:07:36.513952 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.533247 15535 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.536361 15433 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.517951 15581 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:36.519752 15589 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.531620 15500 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:36.466598 15517 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:36.513774 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 162580us
I20260709 13:07:36.534449 15547 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:36.536756 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.410740 15358 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.524984 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 198) took 1017 ms. Trace:
I20260709 13:07:36.526296 15588 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.538241 12726 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:36.544198 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:36.606498 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.641381 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97299.3us
I20260709 13:07:36.642325 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.637662 12806 rpcz_store.cc:276] 0709 13:07:35.507895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.783972 (+276077us) service_pool.cc:224] Handling call
0709 13:07:35.784244 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.916781 (+132537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.916813 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.916857 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:35.916892 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.524711 (+607819us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002b2ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.524761 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.524915 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304344320}
W20260709 13:07:36.642326 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.644758 12882 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:36.531728 15615 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
I20260709 13:07:36.646837 12882 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:36.646901 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:36.527245 15510 consensus_meta.cc:287] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.002s
I20260709 13:07:36.623529 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.578130 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.658327 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.659176 12876 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.622967 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.659687 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:36.574726 15603 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:36.654784 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.647543 12696 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:36.519145 15519 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.660300 13520 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.684901 12696 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.660564 12727 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:36.649838 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.672308 15590 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.520740 15520 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:07:36.674626 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:36.647795 15467 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.700688 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.676365 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1665) took 1654 ms. Trace:
I20260709 13:07:36.704713 12879 rpcz_store.cc:276] 0709 13:07:35.021533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.910780 (+889247us) service_pool.cc:224] Handling call
0709 13:07:35.935597 (+ 24817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.410176 (+474579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.676056 (+265880us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54003ef8d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.676274 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089161088}
I20260709 13:07:36.677325 15606 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:36.677759 15512 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:36.678494 15600 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.688s	user 0.006s	sys 0.000s
I20260709 13:07:36.678777 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 191) took 1641 ms. Trace:
I20260709 13:07:36.680809 15618 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:36.647358 15589 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.681479 15510 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.682384 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:36.682662 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.692459 15519 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:36.741385 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.684141 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 962) took 1632 ms. Trace:
I20260709 13:07:36.743147 15547 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.673213 15535 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:36.695355 12877 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:36.751439 12881 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.747953 15603 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:36.753948 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1672) took 1714 ms. Trace:
I20260709 13:07:36.686282 12732 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:36.730611 15623 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.007s
I20260709 13:07:36.651336 12882 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.755357 15443 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:36.704747 12806 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:36.755791 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 961) took 1715 ms. Trace:
I20260709 13:07:36.756836 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:36.679914 15610 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.477s	user 0.000s	sys 0.005s
I20260709 13:07:36.711583 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.680728 15500 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.701927 15576 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.412945 12724 rpcz_store.cc:276] 0709 13:07:34.744893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.079134 (+1334241us) service_pool.cc:224] Handling call
0709 13:07:36.079489 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.079715 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:36.083196 (+  3481us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.408874 (+325678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.409002 (+   128us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.409121 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.409222 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.409364 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61367,"prepare.queue_time_us":3029,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":64592,"thread_start_us":263715,"threads_started":1}
I20260709 13:07:36.758498 15570 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.743382 12804 rpcz_store.cc:276] 0709 13:07:35.051324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.731315 (+679991us) service_pool.cc:224] Handling call
0709 13:07:35.731642 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.731852 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:35.954847 (+222995us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.683718 (+728871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.683784 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.683832 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.683922 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.684079 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":611206,"prepare.queue_time_us":139981,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":582506,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":13551,"thread_start_us":320104,"threads_started":2,"wal-append.queue_time_us":210024}
I20260709 13:07:36.755048 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.756407 12808 rpcz_store.cc:276] 0709 13:07:35.040236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.685305 (+645069us) service_pool.cc:224] Handling call
0709 13:07:35.715487 (+ 30182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.954795 (+239308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.954985 (+   190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.955977 (+   992us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.280575 (+324598us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.280613 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.280689 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.755545 (+474856us) raft_consensus.cc:1685] finished
0709 13:07:36.755568 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.755706 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78165,"raft.queue_time_us":908788,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11492,"thread_start_us":501920,"threads_started":2,"wal-append.queue_time_us":385528}
W20260709 13:07:36.758882 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.856228 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.723084 15569 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.856887 12808 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:36.600663 15513 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:36.707789 12876 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:36.734344 15583 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
I20260709 13:07:36.878775 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.524295 15572 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.199s
I20260709 13:07:36.879446 15512 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:36.879628 12808 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:36.719381 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.880270 15512 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:36.880959 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.828632 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.879829 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.882001 12876 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:36.882185 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.881227 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.882799 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.882875 12808 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.883679 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.883751 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.884567 12879 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:36.885264 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.828998 15510 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:36.829463 15557 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:36.881206 15512 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.886693 15512 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.831508 15499 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.755880 12882 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.885321 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.734095 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 964) took 1679 ms. Trace:
I20260709 13:07:36.836333 15588 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:36.903045 15588 consensus_queue.cc:1243] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:36.743355 13521 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.840265 12733 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:36.840509 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1653) took 1829 ms. Trace:
I20260709 13:07:36.754787 12731 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:36.841274 15632 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:07:36.841166 15576 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:36.755244 12881 rpcz_store.cc:276] 0709 13:07:35.039426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.993377 (+953951us) service_pool.cc:224] Handling call
0709 13:07:36.751185 (+757808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.752454 (+  1269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.753712 (+  1258us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400047750. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:36.753868 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742150528}
W20260709 13:07:36.760718 12875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1668) took 1722 ms (client timeout 2077 ms). Trace:
I20260709 13:07:36.758286 12727 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.844671 15433 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.846451 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:36.847749 15620 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.912897 12875 rpcz_store.cc:269] 0709 13:07:35.038318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.736874 (+698556us) service_pool.cc:224] Handling call
0709 13:07:36.760462 (+1023588us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003a0cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:36.760643 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305091328}
I20260709 13:07:36.895893 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:36.914268 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.914832 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 960) took 1899 ms. Trace:
I20260709 13:07:36.741564 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 944) took 2030 ms. Trace:
I20260709 13:07:36.916749 12728 rpcz_store.cc:276] 0709 13:07:34.710704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.677178 (+966474us) service_pool.cc:224] Handling call
0709 13:07:35.677497 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.012410 (+334913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.741314 (+728904us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540040e554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.741497 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702341376}
I20260709 13:07:36.853474 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.763581 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 953) took 1769 ms. Trace:
W20260709 13:07:36.733315 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 385026us
I20260709 13:07:36.718313 12800 rpcz_store.cc:276] 0709 13:07:35.037813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.684006 (+646193us) service_pool.cc:224] Handling call
0709 13:07:35.705303 (+ 21297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.802727 (+ 97424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.802758 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.838341 (+ 35583us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.959273 (+120932us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.964186 (+  4913us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.678390 (+714204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.678504 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.678556 (+    52us) raft_consensus.cc:1685] finished
0709 13:07:36.678574 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.678716 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713871,"prepare.queue_time_us":4726,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":1584907,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":52657,"thread_start_us":155795,"threads_started":2,"wal-append.queue_time_us":275938}
W20260709 13:07:36.751269 12873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1849) took 3012 ms (client timeout 3202 ms). Trace:
I20260709 13:07:36.758350 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:36.761034 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 49954.3us
I20260709 13:07:36.921739 12806 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:36.915679 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:36.774984 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57032us
I20260709 13:07:36.924278 12875 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:36.924963 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:36.708902 15537 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.877920 12732 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:36.709406 15467 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.701555 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 940) took 2740 ms. Trace:
I20260709 13:07:36.931651 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.926306 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1661) took 1905 ms. Trace:
W20260709 13:07:36.920773 12873 rpcz_store.cc:269] 0709 13:07:33.738715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.738833 (+   118us) service_pool.cc:224] Handling call
0709 13:07:36.750999 (+3012166us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400047754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:36.751175 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4477054208}
I20260709 13:07:36.882268 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.753253 15603 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.889359 12876 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:36.889657 12801 rpcz_store.cc:276] 0709 13:07:35.055152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.732051 (+676899us) service_pool.cc:224] Handling call
0709 13:07:35.732435 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.732655 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:36.013536 (+280881us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.733645 (+720109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.733706 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.733769 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.733868 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.734028 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449512,"prepare.queue_time_us":139429,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":383941,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":542469,"threads_started":2,"wal-append.queue_time_us":700622}
I20260709 13:07:36.903931 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.934067 12806 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.938019 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:36.938308 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 1.14795e+06us
I20260709 13:07:36.737540 15597 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:36.904781 12878 rpcz_store.cc:276] 0709 13:07:35.011095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.011470 (+   375us) service_pool.cc:224] Handling call
0709 13:07:35.011868 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.779051 (+767183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.840249 (+1061198us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002f5dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:36.840438 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649484672}
I20260709 13:07:36.741698 15589 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.906530 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:36.942495 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 959) took 1936 ms. Trace:
I20260709 13:07:36.950261 12731 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:36.907222 15555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.017s	sys 0.025s
I20260709 13:07:36.946105 12878 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:36.945838 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50051.8us
I20260709 13:07:36.708930 15590 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:36.949199 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.918565 12802 rpcz_store.cc:276] 0709 13:07:34.993666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.022287 (+ 28621us) service_pool.cc:224] Handling call
0709 13:07:35.022612 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.392346 (+369734us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:35.707700 (+315354us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.241642 (+533942us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180023e960. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a 00007f0f41bfda2a
0709 13:07:36.278679 (+ 37037us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4800061158. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:36.734679 (+456000us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.735257 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.735418 (+   161us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:36.735457 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.735529 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.763298 (+ 27769us) raft_consensus.cc:1685] finished
0709 13:07:36.763326 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.763519 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772433,"prepare.queue_time_us":334504,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":715789,"raft.run_cpu_time_us":8605,"raft.run_wall_time_us":874624,"spinlock_wait_cycles":45740672,"thread_start_us":683748,"threads_started":3,"wal-append.queue_time_us":913005}
I20260709 13:07:36.947366 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:36.926016 15600 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:36.966883 12882 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:36.952989 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.915406 12807 rpcz_store.cc:276] 0709 13:07:35.015045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.690592 (+675547us) service_pool.cc:224] Handling call
0709 13:07:35.690971 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.691178 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:35.805121 (+113943us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.914334 (+1109213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.914416 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.914486 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.914583 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.914745 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736863,"prepare.queue_time_us":180495,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"raft.queue_time_us":743468,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":484475,"threads_started":3,"wal-append.queue_time_us":358425}
I20260709 13:07:36.953673 12876 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:36.972098 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:36.953974 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.954335 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.934049 12880 rpcz_store.cc:276] 0709 13:07:35.020605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.837634 (+817029us) service_pool.cc:224] Handling call
0709 13:07:35.839036 (+  1402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.845234 (+  6198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.845273 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.856739 (+ 11466us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.919243 (+ 62504us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:35.919317 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.920859 (+  1542us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.531187 (+610328us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b24001ff628. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3e98c9c4 00007f0f3e98aacb 00007f0f3eb45dc9 00007f0f3eb45a55 00007f0f3eb4509d 00007f0f4177710e 00007f0f4178e88c 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221
0709 13:07:36.904708 (+373521us) raft_consensus.cc:1685] finished
0709 13:07:36.904731 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.926244 (+ 21513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6072,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5002,"spinlock_wait_cycles":9627392,"thread_start_us":61969,"threads_started":1,"wal-append.queue_time_us":253279}
I20260709 13:07:36.955825 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:36.974121 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:36.950453 12803 rpcz_store.cc:276] 0709 13:07:35.006004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.642120 (+636116us) service_pool.cc:224] Handling call
0709 13:07:35.671586 (+ 29466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.671790 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:35.716336 (+ 44546us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.679236 (+962900us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:36.942143 (+262907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.942200 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:36.942255 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.942327 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.942433 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736520,"prepare.queue_time_us":199687,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":748062,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"spinlock_wait_cycles":35850624,"thread_start_us":509527,"threads_started":3,"wal-append.queue_time_us":416387}
I20260709 13:07:36.969918 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 955) took 1975 ms. Trace:
I20260709 13:07:36.976755 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.977155 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.939605 15467 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.936384 12875 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:36.963935 15555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.017s	sys 0.027s
I20260709 13:07:36.936828 15620 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:36.984088 15589 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.984269 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.985116 15576 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.985618 15576 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:36.986027 15576 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.986403 15620 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:36.949571 15588 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:36.987196 15588 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:36.987594 15588 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:36.988927 15624 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:36.985126 12728 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:36.943298 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:36.994377 12807 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:36.966604 12848 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:36.966801 12873 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.965189 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.972553 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 946) took 2130 ms. Trace:
I20260709 13:07:36.977604 12877 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.965026 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.995653 12801 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:36.995421 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:37.002800 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.962885 12808 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:37.003646 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.002168 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.007782 12882 raft_consensus.cc:2376] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:37.008433 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.008834 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.009424 12882 raft_consensus.cc:2376] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8. Re-sending same reply.
I20260709 13:07:37.009644 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.010298 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.011335 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.014853 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:36.997605 12802 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:36.998554 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.000458 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.018607 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.000696 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.020875 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:36.968500 15433 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.025442 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.046000 12807 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:36.954248 15597 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.002888 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.030977 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.031325 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.031436 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.049125 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.049793 12807 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:37.033519 13521 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:37.036192 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.037170 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:36.968570 15521 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.042697 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.042764 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.044492 12727 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:37.055552 12808 raft_consensus.cc:2376] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
I20260709 13:07:37.047973 12878 raft_consensus.cc:2376] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:37.062525 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.073035 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:36.951228 15595 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:07:36.996151 15606 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.041348 15547 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:36.993713 15506 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.953583 15583 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:07:36.953286 15587 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:07:37.051783 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:36.996479 12799 rpcz_store.cc:276] 0709 13:07:34.841778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.025129 (+183351us) service_pool.cc:224] Handling call
0709 13:07:35.025549 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.407997 (+382448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.408065 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.417242 (+  9177us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.659879 (+242637us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.806130 (+146251us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.971836 (+1165706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.971912 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.971954 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:36.971970 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.972494 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768605,"prepare.queue_time_us":190358,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":1261233,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":17989,"thread_start_us":1044057,"threads_started":4,"wal-append.queue_time_us":211697}
I20260709 13:07:36.976260 12805 rpcz_store.cc:276] 0709 13:07:34.994135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.583538 (+589403us) service_pool.cc:224] Handling call
0709 13:07:35.583877 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.585070 (+  1193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:35.659798 (+ 74728us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.800370 (+140572us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.230561 (+430191us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b1800333e20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:36.528026 (+297465us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b1800333e20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:36.677727 (+149701us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:36.968859 (+291132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.968919 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.968988 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.969064 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.969201 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82073,"prepare.queue_time_us":667456,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":60,"raft.queue_time_us":1798070,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":42516352,"thread_start_us":584229,"threads_started":3,"wal-append.queue_time_us":311678}
I20260709 13:07:37.075489 15614 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.092621 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:37.092880 15640 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:37.075861 15476 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:07:37.093001 15442 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.178069 12802 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:37.047206 15557 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:07:37.096951 15639 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:37.076116 15535 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.157996 15606 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.100431 15599 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:07:37.057017 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.103677 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 943) took 2393 ms. Trace:
I20260709 13:07:37.125252 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:37.125914 13487 leader_election.cc:336] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.523s (SENT)
I20260709 13:07:37.076467 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.205390 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.205695 12880 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:37.137622 12699 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.583s (SENT)
I20260709 13:07:37.152197 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.102489 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:37.206295 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80448.5us
I20260709 13:07:37.133366 12806 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:36.949133 15537 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.042656 15589 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.145s
I20260709 13:07:37.162647 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:37.163858 12803 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 3.
I20260709 13:07:37.179739 15358 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.167536 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.169440 12731 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:37.203022 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.169839 12724 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:37.050032 15433 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.048753 15496 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:37.176718 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97990.5us
I20260709 13:07:37.203578 15606 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.179492 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.181092 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.228000 12879 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.228717 12802 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:37.168150 15506 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.228919 12799 raft_consensus.cc:2410] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:37.054847 15521 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.003372 15519 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.099643 15622 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:37.190932 12730 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:37.194936 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.168015 15530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.020s	sys 0.031s
I20260709 13:07:37.102176 15443 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.100172 15475 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:37.204471 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.044536 15568 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:37.207409 13487 leader_election.cc:336] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.530s (SENT)
I20260709 13:07:37.243060 12878 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:37.242993 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.206136 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.243999 13520 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.003s
W20260709 13:07:37.244760 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 107208us
I20260709 13:07:37.244694 13520 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:37.245532 12699 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.608s (SENT)
I20260709 13:07:37.245959 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.246987 12699 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.680s (SENT)
I20260709 13:07:37.208197 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.207450 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.158489 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.204016 12876 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:37.249708 12806 raft_consensus.cc:2410] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:37.250897 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.169709 15614 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.216322 12728 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.160117 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:37.252760 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92800.4us
W20260709 13:07:37.235275 15530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.021s	sys 0.031s
I20260709 13:07:37.230336 15644 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:37.254367 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.179953 15547 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:37.199684 15474 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:37.044415 15513 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.259825 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.226112 12731 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:37.047183 15582 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:37.205034 15583 consensus_queue.cc:1243] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:37.189994 15133 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:07:37.242656 15519 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.216940 15613 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.231936 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.234457 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.225239 15535 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.199129 15442 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.296388 15535 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:37.296674 12807 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:37.297784 15442 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.225867 15433 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.224503 15496 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.298725 15496 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.257804 15474 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:37.255671 15614 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.299696 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.300652 12807 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:37.301493 15613 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.301785 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.252817 12879 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:37.302946 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.274367 12802 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
I20260709 13:07:37.246237 15620 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.253311 15578 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:37.247784 12699 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.704s (SENT)
I20260709 13:07:37.230006 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.322958 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.260104 15485 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:37.328387 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80624.4us
W20260709 13:07:37.329311 12699 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.750s (SENT)
I20260709 13:07:37.329803 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.270709 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.272476 12731 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:37.277462 15530 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.283310 12724 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.283913 12726 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:36.932927 12725 rpcz_store.cc:276] 0709 13:07:33.960989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.270082 (+1309093us) service_pool.cc:224] Handling call
0709 13:07:35.307012 (+ 36930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.307266 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:35.338725 (+ 31459us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.527130 (+1188405us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800412720. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a 00007f0f41bfda2a
0709 13:07:36.700436 (+173306us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.701133 (+   697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.701198 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.701252 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.701335 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.701491 (+   156us) inbound_call.cc:177] Queueing success response
0709 13:07:36.749670 (+ 48179us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b1800412720. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
Metrics: {"mutex_wait_us":116412,"prepare.queue_time_us":31345,"prepare.run_cpu_time_us":160,"prepare.run_wall_time_us":9628,"raft.queue_time_us":1944,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10140,"spinlock_wait_cycles":55873152,"thread_start_us":166397,"threads_started":1,"wal-append.queue_time_us":1597792}
I20260709 13:07:37.290465 15506 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:37.292991 15597 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:37.345660 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.297328 15535 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.305090 12807 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:37.204448 12729 rpcz_store.cc:276] 0709 13:07:34.710399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.676124 (+965725us) service_pool.cc:224] Handling call
0709 13:07:35.712031 (+ 35907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.317412 (+605381us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:36.349941 (+ 32529us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.602156 (+252215us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.644897 (+ 42741us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.645081 (+   184us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:36.645118 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.645205 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.103359 (+458154us) raft_consensus.cc:1685] finished
0709 13:07:37.103391 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.103595 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604799,"prepare.queue_time_us":32282,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":654312,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":38371,"thread_start_us":194609,"threads_started":1,"wal-append.queue_time_us":350131}
I20260709 13:07:37.251719 12806 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
W20260709 13:07:37.313448 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.348197 12699 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.958s (SENT)
I20260709 13:07:37.348923 12699 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.252204 15443 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:37.256683 15557 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.315088 15476 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.232815 15521 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.320595 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.373863 12799 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.321429 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.374426 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.256572 15644 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.327073 12728 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:37.345156 15133 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:37.351763 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 121841us
I20260709 13:07:37.302027 15613 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.353287 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.374801 12802 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:37.256925 15569 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:37.356047 15573 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:37.355531 12699 leader_election.cc:336] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.202s (SENT)
I20260709 13:07:37.359081 12877 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:37.372805 15647 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:07:37.372957 15646 log.cc:927] Time spent T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:37.264735 12805 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:37.367187 15476 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.335156 15590 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.327608 15485 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.379959 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.341660 15568 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:37.352438 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81876us
I20260709 13:07:37.440389 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.440827 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:37.383426 15651 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:37.341301 15589 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.386756 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.388100 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.388221 15443 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.380929 15133 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.390594 15442 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.390311 15588 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.351534 15474 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.391136 15587 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:37.354569 15581 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.394965 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.396657 12807 raft_consensus.cc:2368] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:37.398026 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.401628 12726 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.402673 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.440254 15568 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.426482 15537 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:37.428128 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.464131 12725 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:37.404170 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.408689 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:37.418181 12773 connection.cc:256] RPC call timeout handler was delayed by -1.7975537109999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:07:37.375456 15506 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.442279 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:37.445971 12802 raft_consensus.cc:2410] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:37.436313 15467 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.473253 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:37.450295 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45390.7us
I20260709 13:07:37.437717 15475 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.439931 15485 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.475972 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:37.476840 13514 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:37.457427 15512 consensus_meta.cc:287] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.002s
I20260709 13:07:37.480283 15644 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.481765 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.482261 15644 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.483121 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.438333 15547 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.484915 15568 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.486517 15568 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.454936 12881 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:37.425181 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.458806 12877 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:37.494127 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51923.7us
I20260709 13:07:37.460415 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.483888 12802 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.461191 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.499037 12807 raft_consensus.cc:2410] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:37.462292 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 106827us
W20260709 13:07:37.499998 12699 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.226s (SENT)
I20260709 13:07:37.500677 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.466661 12731 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:37.502527 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.504072 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.504907 12731 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:37.467335 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:37.469492 15655 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.113s	user 0.000s	sys 0.004s
I20260709 13:07:37.455046 15442 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.534680 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.534725 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.536396 12807 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:37.467257 12773 connection.cc:256] RPC call timeout handler was delayed by -1.765153711000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 13:07:37.511755 15621 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.512485 15581 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.513913 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:37.514442 15613 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.466473 15589 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.495900 15474 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:37.519657 15576 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 13:07:37.520465 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.556440 12881 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.521766 15643 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:37.458814 15433 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.560662 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1863) took 1160 ms. Trace:
I20260709 13:07:37.523733 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.562009 12724 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:37.561152 12874 rpcz_store.cc:276] 0709 13:07:36.400194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.414684 (+ 14490us) service_pool.cc:224] Handling call
0709 13:07:36.416000 (+  1316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.519749 (+103749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.525315 (+  5566us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.488147 (+962832us) spinlock_profiling.cc:243] Waited 879 us on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:37.488735 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.540728 (+ 51993us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:37.540779 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.540861 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.543386 (+  2525us) raft_consensus.cc:1685] finished
0709 13:07:37.543408 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.560586 (+ 17178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102939,"raft.queue_time_us":103264,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":2022144,"thread_start_us":51551,"threads_started":1,"wal-append.queue_time_us":51971}
I20260709 13:07:37.525437 15617 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:37.526857 12877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:37.531191 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:37.532593 12699 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.974s (SENT)
I20260709 13:07:37.563657 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.565414 12699 leader_election.cc:336] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.978s (SENT)
I20260709 13:07:37.538455 15569 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.544708 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.547291 12802 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:37.571933 12805 raft_consensus.cc:2368] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:37.547446 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.572528 15537 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:37.550256 13487 leader_election.cc:336] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.948s (SENT)
I20260709 13:07:37.570500 15573 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.519181 15506 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.551452 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.574213 12807 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.574121 15506 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.566471 15617 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:37.576143 15617 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.576813 15506 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:37.523821 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:07:37.577426 15617 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.577756 12879 raft_consensus.cc:606] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:37.578123 12879 raft_consensus.cc:614] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:37.552282 15548 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.581025 15548 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:37.581489 15548 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.582095 12807 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:37.582808 15442 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.583089 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.583683 12807 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:37.584689 15433 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.587594 12848 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.565913 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.591030 12699 leader_election.cc:336] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.993s (SENT)
W20260709 13:07:37.592208 12699 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.009s (SENT)
W20260709 13:07:37.592669 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61631.1us
I20260709 13:07:37.592988 12699 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.589603 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:37.588454 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.589700 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:37.537261 12773 connection.cc:256] RPC call timeout handler was delayed by -1.7624537110000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 13:07:37.594841 12807 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:37.594969 12802 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
W20260709 13:07:37.595021 12773 connection.cc:256] RPC call timeout handler was delayed by -1.7444537110000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:07:37.595762 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6958537110000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:07:37.462900 15587 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.601938 12799 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:37.603317 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.604539 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 977) took 1271 ms. Trace:
I20260709 13:07:37.604967 12802 rpcz_store.cc:276] 0709 13:07:36.332824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.603065 (+1270241us) service_pool.cc:224] Handling call
0709 13:07:37.604466 (+  1401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.599640 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.608135 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.621114 12807 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:37.610215 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.562942 15643 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.612509 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 200) took 2073 ms. Trace:
W20260709 13:07:37.613060 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.615309 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.625346 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.627321 12802 rpcz_store.cc:276] 0709 13:07:35.539531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.611137 (+2071606us) service_pool.cc:224] Handling call
0709 13:07:37.611927 (+   790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.612173 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.612202 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.612249 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.612287 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.612341 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.612441 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.628772 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 968) took 1360 ms. Trace:
I20260709 13:07:37.629118 12799 rpcz_store.cc:276] 0709 13:07:36.268650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.628217 (+1359567us) service_pool.cc:224] Handling call
0709 13:07:37.628450 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.628575 (+   125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.628589 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.628617 (+    28us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.628634 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.628665 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.628733 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.631285 12807 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.632314 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 970) took 1363 ms. Trace:
I20260709 13:07:37.634622 12802 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.635502 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 974) took 1363 ms. Trace:
I20260709 13:07:37.632967 12807 rpcz_store.cc:276] 0709 13:07:36.269348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.630499 (+1361151us) service_pool.cc:224] Handling call
0709 13:07:37.630995 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.631926 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.632227 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.637380 15581 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:37.637166 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47623.7us
I20260709 13:07:37.637166 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.638478 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.638607 15581 raft_consensus.cc:2764] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:37.539526 15133 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.639051 15573 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.566057 15576 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.639910 12802 rpcz_store.cc:276] 0709 13:07:36.272237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.634114 (+1361877us) service_pool.cc:224] Handling call
0709 13:07:37.634444 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.635162 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.635426 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.641491 12802 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:37.641393 15573 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:37.642081 15573 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.642541 12805 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:37.642977 12805 pending_rounds.cc:85] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 7
I20260709 13:07:37.643144 12727 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.644230 15573 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:37.645129 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 980) took 1288 ms. Trace:
I20260709 13:07:37.597128 15433 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.640630 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.643291 12805 pending_rounds.cc:107] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:37.651319 12805 raft_consensus.cc:2889] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.645469 12802 rpcz_store.cc:276] 0709 13:07:36.356754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.640845 (+1284091us) service_pool.cc:224] Handling call
0709 13:07:37.641164 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.644876 (+  3712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.645070 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.638616 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 978) took 1295 ms. Trace:
I20260709 13:07:37.652151 12807 rpcz_store.cc:276] 0709 13:07:36.343005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.637854 (+1294849us) service_pool.cc:224] Handling call
0709 13:07:37.638159 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.638316 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.638338 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.638375 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.638401 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.638449 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.638564 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.652388 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 199) took 2137 ms. Trace:
I20260709 13:07:37.661005 12807 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.658067 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:37.609266 15520 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:37.663080 12805 rpcz_store.cc:276] 0709 13:07:35.516119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.609002 (+2092883us) service_pool.cc:224] Handling call
0709 13:07:37.642208 (+ 33206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.651985 (+  9777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.652305 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:37.663546 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.663738 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 64168us
I20260709 13:07:37.666179 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.640429 15443 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:37.664645 15621 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.660724 15133 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.660820 15513 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.642719 15576 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.686997 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.667564 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 71199.2us
I20260709 13:07:37.685433 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:37.680902 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.673053 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.594429 15569 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.668220 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.689352 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6526537109999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:07:37.701598 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6463537109999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:07:37.693414 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:37.703080 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6391537110000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:07:37.703464 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6355537110000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:07:37.705775 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.703799 12773 connection.cc:256] RPC call timeout handler was delayed by -1.6076537110000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:07:37.707381 12773 connection.cc:256] RPC call timeout handler was delayed by -1.5743537110000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:07:37.707800 12773 connection.cc:256] RPC call timeout handler was delayed by -1.5248537109999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:07:37.708197 12773 connection.cc:256] RPC call timeout handler was delayed by -1.4978537110000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:07:37.708560 12773 connection.cc:256] RPC call timeout handler was delayed by -1.4852537110000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:07:37.708914 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.709293 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.709663 12773 connection.cc:256] RPC call timeout handler was delayed by -1.1126537110000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2662s for a response
I20260709 13:07:37.704428 15485 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.711798 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.711592 15573 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.711521 15589 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.712782 15589 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.713209 15589 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.713511 15485 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:37.715689 15499 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.716116 15576 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:37.716205 15499 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:37.716691 15499 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.716758 15576 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:37.717592 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.717782 15576 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.718449 12808 raft_consensus.cc:2368] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10.
I20260709 13:07:37.719421 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.721758 15643 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.722939 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.668018 15666 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:37.724916 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.715303 15476 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.726059 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.729398 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.729743 12727 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:37.711548 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.726716 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.727195 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59056.7us
I20260709 13:07:37.683313 15520 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:37.696368 15581 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.667117 15547 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.704730 15496 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.722961 15643 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.731503 15590 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.737155 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.750646 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.751343 12803 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:37.684108 15645 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:37.738230 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.752254 15645 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.753603 15358 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.754433 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.733508 15573 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.672827 15588 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.673099 15443 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.691636 15545 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.744645 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.731375 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.748591 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:37.738617 12807 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:37.756319 12803 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:37.761238 13487 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.160s (SENT)
I20260709 13:07:37.763638 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.676237 15548 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:37.768182 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.770716 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.771502 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 976) took 1441 ms. Trace:
W20260709 13:07:37.776858 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.777340 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:37.779675 12879 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.781026 12876 raft_consensus.cc:1217] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-6.4]   Dedup: 4.3->[6.4-6.4]
W20260709 13:07:37.781575 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.746076 15595 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.746284 15547 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.740751 15666 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:37.773100 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.775291 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:37.790527 12807 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.738020 15537 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:37.758031 15476 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.783150 12876 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: [2.2-6.4]
I20260709 13:07:37.776387 12799 rpcz_store.cc:276] 0709 13:07:36.329960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.629838 (+1299878us) service_pool.cc:224] Handling call
0709 13:07:37.724644 (+ 94806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.724845 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.724871 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.724911 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:37.724940 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.724998 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.771229 (+ 46231us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b540028cb50. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:37.771408 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217426688}
I20260709 13:07:37.784598 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:37.766790 15443 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.745867 15513 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:37.805557 12799 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.807331 12799 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:37.808864 12799 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:37.789665 12808 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:37.801558 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.776863 15581 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.753253 15645 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:37.781874 15644 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.812369 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:37.813412 15520 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.814519 15645 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.818334 15499 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.790848 15547 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.818909 15589 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:37.820817 12679 auto_rebalancer.cc:893] Removing replace marker failed: Replica c45825bb09c34201b13ddcec07c4b3f1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:07:37.837265 12679 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:07:37.798027 15606 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.004s
I20260709 13:07:37.825364 15613 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:37.846047 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44586.6us
I20260709 13:07:37.849480 12807 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:37.804697 15512 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:37.811632 15573 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.837208 15599 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.835107 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:37.837682 12679 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:37.855185 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.855500 12732 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:37.803630 15607 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:37.858511 12733 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:07:37.829273 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91066.3us
I20260709 13:07:37.834792 15644 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.876400 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:37.879096 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44046.1us
I20260709 13:07:37.879851 12729 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:37.879982 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.882196 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:37.883306 12728 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:37.851284 15519 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 13:07:37.886555 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:37.886879 13486 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:37.887506 12724 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:37.893317 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:37.894312 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.851531 15496 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:37.868777 15664 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.902236 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.869314 15573 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:37.904630 13486 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.880838 15433 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.868237 15358 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:37.907652 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:37.913304 12804 raft_consensus.cc:2410] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:07:37.883376 15485 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.927345 15642 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:37.926879 15662 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:07:37.887847 15512 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.888266 15595 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.892115 15599 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:37.909355 15569 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.917935 15573 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.845088 15606 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:37.931707 12799 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:37.946460 12799 pending_rounds.cc:85] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:37.946796 12799 pending_rounds.cc:107] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:37.947047 12799 raft_consensus.cc:2889] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.949384 12875 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:37.888587 15521 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:37.951624 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44031.9us
I20260709 13:07:37.910406 15572 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:37.933923 15475 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.939073 15476 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.941800 15613 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.939772 15595 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:37.966655 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 62174.8us
I20260709 13:07:37.909155 15666 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.972645 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:37.977349 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:37.970937 12800 raft_consensus.cc:2368] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:07:37.978052 12732 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.983848 15467 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.985143 15535 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:37.986366 15589 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:37.938211 15510 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:37.952409 15664 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:37.966317 15548 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:37.952924 15644 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:37.978022 15595 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.965231 15613 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:38.017848 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63697.1us
I20260709 13:07:38.018651 12773 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.021596 12732 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:37.977798 15292 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:37.958513 15599 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.029136 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:37.997958 15617 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:38.020601 15548 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:38.039835 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.020170 15613 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.032579 12773 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:38.036224 15669 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:07:38.023715 15476 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:38.028080 15659 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:38.003024 15499 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.046320 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.057724 15582 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.058218 15582 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:38.058449 15674 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:38.058585 15582 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.034334 15671 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.987628 15512 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.064671 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.088155 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.089071 15476 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.092067 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.050578 15475 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.004951 15358 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:38.105155 15614 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.002s
W20260709 13:07:38.091181 15676 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:38.031728 15667 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.188s
I20260709 13:07:38.091450 15642 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.110524 15133 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:38.126827 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 981) took 1765 ms. Trace:
I20260709 13:07:38.127300 12802 rpcz_store.cc:276] 0709 13:07:36.361576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.652473 (+1290897us) service_pool.cc:224] Handling call
0709 13:07:37.652934 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.653407 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.653447 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.654067 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.655687 (+  1620us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.655740 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.655835 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.126608 (+470773us) raft_consensus.cc:1685] finished
0709 13:07:38.126629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.126758 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3202,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4354,"thread_start_us":1063,"threads_started":1,"wal-append.queue_time_us":1798}
I20260709 13:07:38.128407 15521 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:38.129388 12878 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.130046 12773 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.108197 15476 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.120819 15606 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:38.136428 15547 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.085377 15664 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.138703 15133 raft_consensus.cc:2764] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:38.138293 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.105641 15614 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.101631 15671 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:38.109104 15433 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.177527 12773 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.188827 15133 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.189493 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.190635 15133 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.191174 15133 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:38.191635 15133 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.191527 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.194746 12730 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.196873 12801 raft_consensus.cc:2368] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:38.200060 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.148523 15595 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.202344 12699 leader_election.cc:400] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:38.182979 15442 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.202912 15474 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.210417 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.214507 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:38.224520 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.224988 12732 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:38.225790 12727 raft_consensus.cc:2368] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:07:38.226845 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.201015 15576 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.230820 15581 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.234788 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.193531 15433 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:38.228502 15557 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.256462 15433 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:38.262676 12803 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:38.263164 12803 pending_rounds.cc:85] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:38.263402 12803 pending_rounds.cc:107] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:38.263695 12803 raft_consensus.cc:2889] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.273643 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.279969 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1846) took 1338 ms. Trace:
I20260709 13:07:38.280696 12801 rpcz_store.cc:276] 0709 13:07:36.941873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.050585 (+108712us) service_pool.cc:224] Handling call
0709 13:07:38.279696 (+1229111us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54001a2a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:38.279879 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277668736}
W20260709 13:07:38.284631 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.245765 15673 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.303465 12699 leader_election.cc:400] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:38.305761 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.308468 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:38.309873 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.310801 12802 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:38.311434 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.311944 12808 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.313316 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.314620 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.315258 12801 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.325199 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.326133 12727 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:38.330296 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.330770 12726 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.330981 12727 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.331624 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.333220 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.334784 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:38.336090 12730 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:38.338301 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.342583 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.343461 12805 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.275682 15582 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.304394 15433 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:38.329483 15557 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.272538 15573 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.355685 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.325016 15673 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:38.356458 12807 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.356773 12730 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:38.330317 15443 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.348143 15474 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.345254 15467 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.369695 12802 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:38.371282 12808 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.373246 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.352823 15433 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.280236 15671 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.355991 15557 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.391821 12877 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:38.358477 15673 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.394459 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.394810 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.395404 12808 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.398727 12730 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:38.392546 12877 raft_consensus.cc:614] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:38.371016 15547 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:38.402876 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.403975 12801 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.410909 12727 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:38.391132 15433 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.392782 15467 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.403038 15614 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.417343 15613 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.420567 15595 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.392519 15557 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.427210 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.427870 12727 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.403158 15530 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.437471 15133 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.440249 15133 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.426271 15573 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.427765 15467 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.442001 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1874) took 1068 ms. Trace:
I20260709 13:07:38.445041 15467 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.444609 12799 rpcz_store.cc:276] 0709 13:07:37.374128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.945907 (+571779us) service_pool.cc:224] Handling call
0709 13:07:37.946253 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:37.964494 (+ 18241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.964527 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.966230 (+  1703us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.353714 (+387484us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:38.353793 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.356833 (+  3040us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.441730 (+ 84897us) raft_consensus.cc:1685] finished
0709 13:07:38.441752 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.441925 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":515,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5697,"thread_start_us":363400,"threads_started":1,"wal-append.queue_time_us":414489}
W20260709 13:07:38.445920 15685 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:07:38.447829 15695 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:38.448896 15443 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.449436 12727 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:38.458158 15694 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.461103 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1703) took 1075 ms. Trace:
I20260709 13:07:38.461629 12873 rpcz_store.cc:276] 0709 13:07:37.385571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.386606 (+  1035us) service_pool.cc:224] Handling call
0709 13:07:37.387045 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.387515 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.387549 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.388047 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.288485 (+900438us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800330b80. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:07:38.391648 (+103163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:38.391680 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.391776 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.451950 (+ 60174us) raft_consensus.cc:1685] finished
0709 13:07:38.451978 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.461021 (+  9043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":31205,"spinlock_wait_cycles":24456960,"thread_start_us":79280,"threads_started":1,"wal-append.queue_time_us":1054356}
W20260709 13:07:38.464780 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91660us
I20260709 13:07:38.466156 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.467599 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.468705 15443 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.471395 15573 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.484529 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.485855 12805 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.472096 15613 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.479238 15443 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.458938 15694 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.494694 15443 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.490206 15573 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.509838 15573 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.501981 15433 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:38.513286 15643 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.005s
I20260709 13:07:38.496582 15419 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.506963 15576 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:38.526503 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.512900 15673 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.518513 15419 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.531149 15673 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.531229 15419 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:38.531956 15587 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:38.533185 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:38.521415 15643 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.544669 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57450 (request call id 1) took 1071 ms. Trace:
I20260709 13:07:38.545673 12877 rpcz_store.cc:276] 0709 13:07:37.472820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.526672 (+ 53852us) service_pool.cc:224] Handling call
0709 13:07:38.544308 (+1017636us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003a07d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bed853 00007f0f46bbb60a 00007f0f401417d4 00007f0f40141762 00007f0f40141691 00007f0f4014160c 00007f0f401408c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:38.544410 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905314688}
I20260709 13:07:38.506995 15694 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:38.540395 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:38.563517 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.564179 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.564622 12873 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:38.551687 13514 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.568069 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.568198 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.568838 12881 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.568934 15513 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:38.569411 15513 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:38.570276 15513 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.571468 15513 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.574455 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:38.575202 12880 raft_consensus.cc:606] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:38.575644 12880 raft_consensus.cc:614] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:38.578125 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 997) took 1273 ms. Trace:
I20260709 13:07:38.578575 12807 rpcz_store.cc:276] 0709 13:07:37.304202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.850688 (+546486us) service_pool.cc:224] Handling call
0709 13:07:37.851015 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.356989 (+505974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.577865 (+220876us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54001d56d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:38.578059 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162100096}
I20260709 13:07:38.579833 15433 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.579169 15557 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.580886 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:38.581518 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:38.582173 12880 raft_consensus.cc:606] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:38.583424 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:38.584420 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:38.584481 15618 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:38.585089 15618 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.585319 15650 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.585470 15618 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.585943 15650 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:38.590447 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:38.592439 15664 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:38.593099 12806 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:38.586870 15650 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.592707 12805 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:38.594388 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.595220 12807 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.596524 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.594125 15622 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:38.549067 15643 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.601794 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:38.602317 12875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1694) took 1599 ms (client timeout 1901 ms). Trace:
I20260709 13:07:38.602641 12733 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:38.602794 12875 rpcz_store.cc:269] 0709 13:07:37.003404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.009398 (+  5994us) service_pool.cc:224] Handling call
0709 13:07:38.602147 (+1592749us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54003b6354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:38.602249 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027830656}
I20260709 13:07:38.601897 15622 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:38.605512 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:38.606582 12724 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:38.610103 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.611735 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.614064 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.614917 12799 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.625906 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.626355 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.626001 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.627859 12806 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.628214 12805 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.633608 12799 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:38.635197 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.635605 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.636785 12799 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.641351 15643 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:38.644785 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:38.604773 15582 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.650296 12807 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:38.626108 15569 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.651683 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.657945 12799 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.662698 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.665369 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:38.666002 13520 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:38.644958 15576 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:38.670253 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.670084 12805 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:38.623353 15510 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:38.626333 15467 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:38.643896 15673 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:38.678398 12806 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:38.667985 15547 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:38.679219 15510 consensus_queue.cc:1243] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:38.681372 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:38.682284 15474 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.684571 13514 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:38.685070 15587 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.685684 15587 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.686105 15587 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.658913 15581 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:38.689320 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:38.668586 15569 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.709399 13486 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:38.697289 15576 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.710335 15643 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:38.715385 15625 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:38.711217 15581 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.764550 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:38.766996 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.770368 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.772140 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.732137 15557 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.733609 15643 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:38.776301 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.777832 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:38.780421 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.781222 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.744688 15625 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:38.794889 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.795024 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.789001 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.796402 12881 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:38.796564 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:38.797236 12874 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.788668 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:38.769146 15582 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.769145 15133 raft_consensus.cc:2764] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:38.799628 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.801494 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:38.778525 15583 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.786651 15595 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.792132 15614 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.792444 15645 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.798748 15512 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.814564 15644 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:38.836299 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 173701us
I20260709 13:07:38.814602 15614 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.837277 12881 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:07:38.841322 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.845806 15581 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:38.845890 15557 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:38.846637 15557 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:38.849933 15705 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:07:38.850554 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.851179 15537 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:38.851867 15506 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:38.847568 15557 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.842352 15643 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.841578 15614 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.861961 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.862134 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:38.863363 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.864426 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:38.789296 15569 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.863366 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.845408 15625 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.835299 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:38.868407 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.871352 12881 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:38.872306 12802 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.873436 12799 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:38.879926 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65861.6us
I20260709 13:07:38.880337 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.880862 12773 leader_election.cc:400] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:07:38.881412 12799 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:38.886310 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.828327 15576 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:38.883167 12771 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.940s (SENT)
I20260709 13:07:38.877964 15644 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.887667 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.893311 15644 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.893780 12799 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:38.894080 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.896677 12806 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.898160 12806 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.899312 12878 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:38.899495 12806 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:38.901744 12805 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:38.839037 15443 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.917084 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:38.918144 12802 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:38.919164 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.922720 12773 leader_election.cc:403] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.842654 15547 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.911330 12799 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:38.924225 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:38.937873 12874 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:38.939145 12874 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:38.939561 12805 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.927006 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.870366 15358 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.925583 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.938916 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:38.895853 15644 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.882743 15581 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:38.943724 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:38.903029 15133 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.875059 15587 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:38.956471 15474 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.932359 15513 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:38.923348 15496 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:38.964197 15410 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.972323 15410 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.974474 15410 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:38.975584 15547 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.976661 15666 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:38.977095 15666 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:38.978025 15666 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.979027 15510 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:38.980077 15506 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.980700 15506 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:38.981673 15506 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.983057 15506 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.961354 15581 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:38.985591 15581 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:38.990665 12806 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:38.969686 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:38.991633 12805 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:38.970961 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:38.958262 15644 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
W20260709 13:07:38.979880 12800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1848) took 2028 ms (client timeout 2009 ms). Trace:
W20260709 13:07:38.994515 12800 rpcz_store.cc:269] 0709 13:07:36.951628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.058437 (+106809us) service_pool.cc:224] Handling call
0709 13:07:38.979644 (+1921207us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400033254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:38.979792 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633038208}
I20260709 13:07:38.970376 15535 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:07:39.004765 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:38.955137 15358 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:38.996284 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115594us
I20260709 13:07:39.007861 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.010469 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:39.012233 12773 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:39.019531 12773 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:39.020395 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:39.021144 12873 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.017616 15443 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:39.022946 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.000415 15494 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.024435 15644 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:39.027743 15530 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:39.017920 15474 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.013504 15210 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:39.028348 15530 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.004354 15650 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:39.033922 15358 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:39.013721 15643 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.006521 15666 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.990935 15618 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.039837 15517 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.040439 15210 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:39.009552 15645 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.045487 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:39.041100 15650 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:39.065136 12729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1618) took 1660 ms (client timeout 2167 ms). Trace:
I20260709 13:07:39.065429 15650 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:39.065667 12729 rpcz_store.cc:269] 0709 13:07:37.400101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.401013 (+   912us) service_pool.cc:224] Handling call
0709 13:07:39.049787 (+1648774us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400411754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:39.060798 (+ 11011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008784128}
I20260709 13:07:39.066985 15719 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:39.065699 15210 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.067507 15719 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.042196 15570 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.070183 15719 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:39.049683 15517 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:39.071916 15517 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.073071 15517 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.066485 15650 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.074438 15650 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.075740 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 990) took 1213 ms. Trace:
I20260709 13:07:39.076122 15722 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:07:39.076221 12725 rpcz_store.cc:276] 0709 13:07:37.862307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.862418 (+   111us) service_pool.cc:224] Handling call
0709 13:07:39.075527 (+1213109us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400062a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:39.075674 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001131392}
I20260709 13:07:39.080416 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:39.082908 13487 connection.cc:256] RPC call timeout handler was delayed by -1.1775982719999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:07:39.082913 15618 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:39.085222 15618 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.085680 15618 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.088083 12800 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:39.093261 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1864) took 1830 ms. Trace:
I20260709 13:07:39.093564 12807 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:07:39.093931 12807 pending_rounds.cc:85] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:07:39.093721 12804 rpcz_store.cc:276] 0709 13:07:37.263159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.472942 (+209783us) service_pool.cc:224] Handling call
0709 13:07:39.093018 (+1620076us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001b5654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:39.093206 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009868672}
I20260709 13:07:39.094295 12807 pending_rounds.cc:107] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:07:39.094542 12807 raft_consensus.cc:2889] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.095554 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 992) took 2184 ms. Trace:
I20260709 13:07:39.095978 12803 rpcz_store.cc:276] 0709 13:07:36.910797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.805272 (+894475us) service_pool.cc:224] Handling call
0709 13:07:37.816460 (+ 11188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.264205 (+447745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.095289 (+831084us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54001748d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:39.095498 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025233280}
I20260709 13:07:39.013885 15664 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:07:39.100132 15720 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:39.100785 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:39.114852 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91990.1us
I20260709 13:07:39.101766 13513 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.101783 15625 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:39.103264 12805 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:39.124058 12805 pending_rounds.cc:85] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:39.123922 12873 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:39.124419 12805 pending_rounds.cc:107] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:39.124806 12805 raft_consensus.cc:2889] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.104560 12806 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.104771 12804 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.104861 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:39.105437 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:39.117848 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.127851 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:39.128650 12873 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:39.106369 12801 pending_rounds.cc:85] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:07:39.129521 12801 pending_rounds.cc:107] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:39.129916 12801 raft_consensus.cc:2889] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:39.107963 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.688s (SENT) [suppressed 46 similar messages]
I20260709 13:07:39.108415 15722 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.110574 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:39.110800 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:39.137676 12873 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.138067 12873 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:39.141254 12804 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.143740 12808 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:39.088083 15618 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:39.153954 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43480.2us
I20260709 13:07:39.138804 12873 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.170200 12873 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.171092 13520 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:39.172242 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:39.175786 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.116832 15671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.007s	sys 0.010s
I20260709 13:07:39.185609 12806 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:39.193497 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.059547 15530 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.183347 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:39.124680 15724 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.134980 15722 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:39.198518 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:39.152194 15643 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.135169 15645 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:39.200090 12873 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:39.205392 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:39.210366 12873 pending_rounds.cc:85] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:39.210716 12873 pending_rounds.cc:107] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:39.210827 13520 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:39.189931 15671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.007s	sys 0.014s
I20260709 13:07:39.161314 15597 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.171119 15694 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.211053 12873 raft_consensus.cc:2889] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:39.213135 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 105202us
I20260709 13:07:39.161288 15613 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:07:39.291469 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.200721 15474 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.230558 12845 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:39.208669 15643 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.304992 15643 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.305173 15513 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.305727 15513 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.190855 15419 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
W20260709 13:07:39.308667 15726 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:07:39.313796 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 83397.9us
I20260709 13:07:39.206230 12696 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.289796 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:39.315218 12806 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.303514 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:39.316895 12808 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:39.182454 15644 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:39.320587 12804 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:39.307783 15513 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:39.321749 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 184833us
I20260709 13:07:39.332233 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.333097 15443 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:39.323553 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 117454us
I20260709 13:07:39.212116 15618 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.348716 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:39.321743 15545 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:39.337925 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.339027 12732 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.343372 12733 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:39.358069 12727 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:39.337469 12729 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:39.358645 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.205564 15569 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.353521 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:39.330796 15691 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.206277 15715 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:07:39.300397 15694 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.375248 12806 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:39.378342 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:39.672362 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 294165us
I20260709 13:07:39.320555 15494 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.212368 15557 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:07:39.379516 12727 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.364645 12805 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:07:39.335103 15474 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.215492 15645 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:39.438002 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:39.439900 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 278765us
I20260709 13:07:39.339470 15710 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:39.446723 12726 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:39.693176 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:39.445382 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:39.441193 15614 consensus_meta.cc:287] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.012s
I20260709 13:07:39.438570 15578 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:39.453770 15729 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:39.356140 15443 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.363744 15576 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:07:39.444591 15735 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:39.489552 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 131010us
I20260709 13:07:39.460604 15569 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.376549 15722 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.499830 15643 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:39.512908 15732 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:07:39.514189 15706 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.682s	user 0.002s	sys 0.001s
I20260709 13:07:39.517596 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:39.737442 15443 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:39.738092 15443 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.519142 15530 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:39.728546 15410 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.740172 15410 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.733143 15742 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.741247 15742 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:39.489014 15582 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.519958 15587 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:39.521234 15683 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.523550 15737 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.528764 13514 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.746852 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:39.747749 13520 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.746918 15683 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.752393 15474 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:39.558012 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.570129 15622 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.572723 15620 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:39.585974 15568 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.603188 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.609864 15537 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.615397 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:39.763182 12729 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.763429 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.617274 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:39.618533 12799 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.623818 15664 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:39.623855 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:39.630091 15666 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.000s
I20260709 13:07:39.639376 15519 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:39.640738 15517 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.642334 15506 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.642019 15570 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:39.615767 15650 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 13:07:39.661652 12878 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.707768 15614 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.808548 12728 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:39.670358 12629 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 73) took 9063 ms. Trace:
I20260709 13:07:39.678344 12873 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.678996 12874 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:39.653266 12627 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 5, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.708750 15510 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:39.812067 12627 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.813467 12627 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 5, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 5 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.668874 15589 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:39.691927 12733 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:39.700346 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:39.819540 12724 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:39.699796 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:39.821478 12727 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.822866 12727 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.712153 12807 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:39.728470 12879 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.825233 12879 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:39.684428 15694 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.736325 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:39.696895 15588 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.690888 15581 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.529805 15637 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.758980 12882 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:39.738659 15443 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:39.776990 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.766798 15537 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:39.834204 12728 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:39.767143 12774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.101s	sys 0.171s
I20260709 13:07:39.833163 12727 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:07:39.835420 12774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.102s	sys 0.171s
I20260709 13:07:39.836979 12727 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:39.729383 15569 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.802683 12729 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:39.839334 13513 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:39.665069 12875 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:39.766913 15622 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.767421 15620 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:39.793195 15527 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:07:39.815838 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:39.860643 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:39.861173 12800 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:39.809530 12629 rpcz_store.cc:276] 0709 13:07:30.606997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.621021 (+ 14024us) service_pool.cc:224] Handling call
0709 13:07:39.670275 (+9049254us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:33.739810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:33.740705 (+   895us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:33.740760 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:33.740788 (+    28us) tablet.cc:662] Decoding operations
0709 13:07:33.742091 (+  1303us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:33.742200 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:33.742246 (+    46us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:33.743307 (+  1061us) tablet.cc:701] Row locks acquired
0709 13:07:33.743332 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:07:33.743545 (+   213us) write_op.cc:270] Start()
0709 13:07:33.743714 (+   169us) write_op.cc:276] Timestamp: P: 1783602453743463 usec, L: 0
0709 13:07:33.743739 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:33.875974 (+132235us) log.cc:844] Serialized 3911 byte log entry
0709 13:07:36.254826 (+2378852us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:37.098239 (+843413us) op_driver.cc:464] REPLICATION: finished
0709 13:07:37.364455 (+266216us) write_op.cc:301] APPLY: starting
0709 13:07:37.373669 (+  9214us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:37.443291 (+ 69622us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:37.446338 (+  3047us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:37.469985 (+ 23647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:37.470200 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:37.470244 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:37.470529 (+   285us) log.cc:844] Serialized 70 byte log entry
0709 13:07:37.470708 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.470836 (+   128us) write_op.cc:454] Released schema lock
0709 13:07:37.470887 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:37.471275 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.471307 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101638,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":244122,"apply.run_cpu_time_us":3401,"apply.run_wall_time_us":106860,"num_ops":9,"prepare.queue_time_us":168083,"prepare.run_cpu_time_us":25893,"prepare.run_wall_time_us":702580,"raft.queue_time_us":819466,"raft.run_cpu_time_us":22396,"raft.run_wall_time_us":136751,"replication_time_us":3354312,"spinlock_wait_cycles":50118912,"thread_start_us":1474758,"threads_started":4,"wal-append.queue_time_us":1141432,"wal-append.run_cpu_time_us":65483,"wal-append.run_wall_time_us":3450925}]]}
I20260709 13:07:39.788662 12732 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:39.698594 15544 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:07:39.699180 15494 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:39.798765 12803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.020s
I20260709 13:07:39.783150 15664 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:39.844470 12802 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.804865 15618 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:07:39.792601 15727 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:39.718271 15710 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:39.769018 15568 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.815373 12627 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 6, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.837255 15681 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:39.803257 13520 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:07:39.859371 12726 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
W20260709 13:07:39.872308 12803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.017s	sys 0.020s
W20260709 13:07:39.873986 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 188792us
W20260709 13:07:39.838084 15642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.003s	sys 0.036s
I20260709 13:07:39.885010 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:39.847784 15570 consensus_queue.cc:1243] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:39.836918 15589 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.854234 12729 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.902434 12627 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.848924 15210 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:39.911818 12808 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.916179 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:39.852690 15519 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:07:39.920558 15642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.003s	sys 0.036s
W20260709 13:07:39.923776 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.924794 15578 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:39.871874 15613 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.839023 15588 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:39.946892 12627 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 6, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.983873 12627 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 8, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 8 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.850847 15625 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:39.842921 15743 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
W20260709 13:07:39.952754 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 103517us
I20260709 13:07:39.988220 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:39.989118 12805 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:39.844772 15715 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.842365 15637 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:39.944978 15419 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.986477 12627 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 5, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.996378 12627 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.957331 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:39.993752 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:39.991142 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 277902us
I20260709 13:07:39.998339 12627 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 7, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 7 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.947134 15496 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:07:40.003126 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:40.012722 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.003326 12800 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:40.003006 12627 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 4, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:40.019011 12627 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:40.021188 12627 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 5 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:07:40.023155 12627 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:07:40.094238 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 85874.4us
I20260709 13:07:40.094738 12805 raft_consensus.cc:2368] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:39.957160 15530 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:07:40.104810 12627 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:40.104931 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 100360us
I20260709 13:07:40.108690 12627 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 2 to 7, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 7 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:40.097357 12808 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:40.113293 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.109427 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:40.115321 12627 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 6, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:39.995597 15419 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.140252 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.097014 15544 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:40.120390 15733 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:07:40.169150 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59936.5us
I20260709 13:07:40.136870 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:40.121418 12627 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 3 to 6, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:40.171387 12627 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 5 to 6, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:07:40.001823 15587 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.097309 15666 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:07:40.098717 15749 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.195742 15749 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.200436 15749 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.184652 15443 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.225124 15743 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.245390 15743 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.201041 15419 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:39.993680 15620 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.155340 15530 consensus_queue.cc:1243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer a865487bf1854df8a5619d42465bb36c log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:40.160045 15618 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.010931 15715 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.118978 15512 consensus_queue.cc:1059] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:07:40.226562 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89815.5us
I20260709 13:07:40.098971 15581 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:07:40.179968 15519 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:07:40.217613 15544 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:40.233654 15755 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.190083 15587 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.242364 15569 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.273456 15621 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.187577 15751 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:07:40.151346 15578 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.264503 15443 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.262868 15753 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.272492 15568 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.274294 15758 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.274441 15620 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.283406 15755 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.285069 15494 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.288089 15750 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.271268 15618 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.293242 15589 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.293944 15753 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:40.304260 15752 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:07:40.309872 15756 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:07:40.311276 15743 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.311808 15683 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.312314 15587 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.313642 15715 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.314615 15710 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.304282 15544 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.299517 15758 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.320463 15513 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.320894 15513 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:40.321105 15758 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.299639 15755 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.321695 15513 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.322665 15513 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.298854 15751 consensus_queue.cc:1243] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:07:40.304930 15748 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:40.297778 15443 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:07:40.329574 15618 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.307116 15750 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.331030 15443 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.332309 15750 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.332953 15753 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.334223 15764 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:40.334597 15764 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:40.335338 15764 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.305279 15637 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.336483 15764 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.292409 15621 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.341710 15755 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.344871 15664 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:40.345785 15694 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.003s
I20260709 13:07:40.346282 15694 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.348421 15621 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.348625 15694 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.343888 15755 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:40.357739 15746 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.259s	user 0.002s	sys 0.001s
I20260709 13:07:40.361531 15643 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.363893 15645 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.418983 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1000) took 1083 ms. Trace:
W20260709 13:07:40.419916 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 310429us
I20260709 13:07:40.421967 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:40.420327 12725 rpcz_store.cc:276] 0709 13:07:39.334938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.335903 (+   965us) service_pool.cc:224] Handling call
0709 13:07:39.466666 (+130763us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.468594 (+  1928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.468635 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:39.471355 (+  2720us) log.cc:844] Serialized 52 byte log entry
0709 13:07:39.622957 (+151602us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b48000030d8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f46b1caa1 00007f0f46b13b37 00007f0f46b139ca 00007f0f46c0b26f 00007f0f46c0af37 00007f0f46c1f55c 00007f0f46c1f508 00007f0f46c1f488 00007f0f46c1f443 00007f0f46c1e6ec 00007f0f45b48a96
0709 13:07:39.940717 (+317760us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:39.940784 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.940897 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.417807 (+476910us) raft_consensus.cc:1685] finished
0709 13:07:40.417903 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.418552 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2129,"raft.run_cpu_time_us":3142,"raft.run_wall_time_us":153902,"spinlock_wait_cycles":3248384,"thread_start_us":432263,"threads_started":1,"wal-append.queue_time_us":660002}
I20260709 13:07:40.425382 12699 leader_election.cc:400] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:40.442942 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1028) took 1335 ms. Trace:
I20260709 13:07:40.445706 12808 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:40.443627 12803 rpcz_store.cc:276] 0709 13:07:39.107615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.124846 (+ 17231us) service_pool.cc:224] Handling call
0709 13:07:39.125188 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.125580 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.125614 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.155643 (+ 30029us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.910959 (+755316us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:39.911005 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.911080 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.356770 (+445690us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:40.441962 (+ 85192us) raft_consensus.cc:1685] finished
0709 13:07:40.442024 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.442575 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16632,"raft.queue_time_us":103,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":24339,"spinlock_wait_cycles":9969536,"thread_start_us":704712,"threads_started":1,"wal-append.queue_time_us":783304}
I20260709 13:07:40.449100 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.451742 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.453372 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.454860 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:40.456141 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 178241us
I20260709 13:07:40.459522 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.462939 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.467818 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.470824 12803 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:40.465219 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.466013 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.477908 12876 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:40.481426 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:40.488567 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.501421 15419 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:40.515339 15578 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.526743 15719 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.516968 15621 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.520381 15557 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.520622 15618 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.521468 15544 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.523013 15622 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.524991 15643 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:40.542595 15622 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.536612 15645 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:40.543439 15643 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.544328 15645 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.546110 15622 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.527860 15666 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.546780 15643 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.516597 15517 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.549506 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.550887 12880 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:40.550796 15544 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:40.551607 15544 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:40.555107 15517 consensus_queue.cc:1243] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:40.536537 15578 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.536815 15719 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.539640 15494 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.557327 15419 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.557971 12699 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:40.562928 15578 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.565418 15719 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.547262 15666 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.566509 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1007) took 1220 ms. Trace:
I20260709 13:07:40.568267 15666 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.571557 15494 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.566924 12730 rpcz_store.cc:276] 0709 13:07:39.346215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.346733 (+   518us) service_pool.cc:224] Handling call
0709 13:07:39.347165 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.653178 (+306013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.653214 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:39.669521 (+ 16307us) log.cc:844] Serialized 52 byte log entry
0709 13:07:39.961109 (+291588us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:39.961503 (+   394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.565861 (+604358us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000b4ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:40.565918 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.566000 (+    82us) raft_consensus.cc:1685] finished
0709 13:07:40.566013 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.566336 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10939,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":10882,"spinlock_wait_cycles":234338688,"thread_start_us":428378,"threads_started":2,"wal-append.queue_time_us":385737}
I20260709 13:07:40.570526 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1006) took 1224 ms. Trace:
I20260709 13:07:40.573869 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.576222 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.575361 12731 rpcz_store.cc:276] 0709 13:07:39.344783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.345354 (+   571us) service_pool.cc:224] Handling call
0709 13:07:39.345726 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.949569 (+603843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.949618 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.949674 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:39.949721 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.568653 (+618932us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400309154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:40.568710 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.568944 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388348160}
I20260709 13:07:40.582181 15735 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.583946 15735 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.584553 15419 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.584597 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.591060 15645 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.597528 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:40.598380 12880 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.600625 15753 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.578842 15544 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:40.604107 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46348.1us
I20260709 13:07:40.605299 15517 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:40.606406 15766 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.606443 15517 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.607422 15766 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.609138 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.610302 12873 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:40.618620 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.610321 15766 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.620736 15719 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.621357 15719 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.621745 15719 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.622051 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.622795 12875 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:40.627413 12879 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.616729 15517 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.616993 15735 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.638025 15645 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:40.639016 15645 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.640940 15753 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:40.643687 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.645103 15753 raft_consensus.cc:476] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:40.647729 15645 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.639196 15568 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:40.649611 15687 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.652515 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.658020 15410 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.665581 15513 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.666682 15513 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.673010 15614 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.673345 15687 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.680465 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:40.675856 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.676929 15537 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.682127 15742 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:07:40.677011 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.682893 15537 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.683233 15642 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.683794 15642 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:40.684684 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.678030 12730 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.678896 15588 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.679695 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.674721 15568 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.700976 15650 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.701571 15650 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:40.701877 15568 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.681921 15614 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:40.702790 15650 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.703596 15614 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.685245 15642 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.709923 12875 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:40.710456 12880 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:40.711925 15358 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:40.712504 15358 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.712895 15358 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.712996 15681 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.721328 15681 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.723917 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.724647 15681 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.724848 12806 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:40.725934 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:40.726656 12806 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:40.732965 12873 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:40.718032 13513 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:40.741436 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.742013 12806 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.742385 12873 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:40.743948 12806 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:40.749756 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.758126 12725 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:40.758483 12880 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:40.758738 12806 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:40.759660 12882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1696) took 3755 ms (client timeout 1940 ms). Trace:
W20260709 13:07:40.760185 12882 rpcz_store.cc:269] 0709 13:07:37.003997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.011111 (+  7114us) service_pool.cc:224] Handling call
0709 13:07:40.759236 (+3748125us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400221354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:40.759417 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6298316032}
I20260709 13:07:40.760623 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:40.761235 15719 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.761948 12882 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:40.762763 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.764390 15513 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:40.764931 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:40.751094 12730 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:40.772924 12732 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:40.764415 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:40.748441 15687 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.754460 12874 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.759961 12880 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.753089 12873 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
W20260709 13:07:40.769205 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 104298us
I20260709 13:07:40.745002 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:40.773996 12875 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:40.763792 15719 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.734694 15642 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.801180 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.802098 12725 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:40.803593 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.804847 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.807610 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.808657 12728 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:40.810732 12877 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:40.810643 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.812453 15650 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.814248 15597 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:40.814457 12806 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.804931 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.826996 12729 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.827786 15597 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.833150 12806 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.789233 15687 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:40.834430 12805 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:40.836184 12729 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:40.840966 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1897) took 1066 ms. Trace:
I20260709 13:07:40.841725 12805 rpcz_store.cc:276] 0709 13:07:39.774390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.597589 (+823199us) service_pool.cc:224] Handling call
0709 13:07:40.598166 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.838464 (+240298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.840876 (+  2412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.842718 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.847781 13520 raft_consensus.cc:2393] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:40.849006 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1896) took 1074 ms. Trace:
I20260709 13:07:40.849112 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.850735 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.849653 12800 rpcz_store.cc:276] 0709 13:07:39.774124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.592899 (+818775us) service_pool.cc:224] Handling call
0709 13:07:40.593477 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.593870 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:40.636460 (+ 42590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.845750 (+209290us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.848481 (+  2731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.848535 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.848580 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.848823 (+   243us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.848945 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119038,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":3285,"raft.queue_time_us":140,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":2356,"thread_start_us":198898,"threads_started":2}
I20260709 13:07:40.852418 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:40.853693 15587 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.853767 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:40.854410 15587 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.854923 15587 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.857641 15568 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:40.858268 15568 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:40.851994 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.859493 15568 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.864355 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:40.867410 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:40.863229 12875 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:40.869347 12875 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:40.867987 15588 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.872015 15588 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.872452 15588 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.873382 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.855090 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:40.870440 12730 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:40.883945 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 214) took 1043 ms. Trace:
I20260709 13:07:40.884908 15530 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.885769 15530 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.881461 15753 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.886919 15753 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.887315 15753 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.886176 15614 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.895174 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:40.895972 12799 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:40.900004 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:40.900998 13521 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:40.901235 15578 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:40.902069 15557 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:40.906376 15737 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.907226 15737 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:40.910388 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:40.884532 12804 rpcz_store.cc:276] 0709 13:07:39.773217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.585456 (+812239us) service_pool.cc:224] Handling call
0709 13:07:40.586125 (+   669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.586939 (+   814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.586968 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.587718 (+   750us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.634691 (+ 46973us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:40.796546 (+161855us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.797283 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.797424 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.797541 (+   117us) raft_consensus.cc:1685] finished
0709 13:07:40.797560 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.816350 (+ 18790us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89405,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":373,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":371,"thread_start_us":184685,"threads_started":2,"wal-append.queue_time_us":112849}
I20260709 13:07:40.912518 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1015) took 2035 ms. Trace:
I20260709 13:07:40.912940 12802 rpcz_store.cc:276] 0709 13:07:38.877018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.933444 (+ 56426us) service_pool.cc:224] Handling call
0709 13:07:38.933789 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.887175 (+953386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.911955 (+1024780us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400174dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:40.912312 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094136704}
I20260709 13:07:40.913950 12879 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.879276 15687 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:40.914654 12802 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:40.916836 15742 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.917361 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1902) took 1141 ms. Trace:
I20260709 13:07:40.887998 15768 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:40.917850 12808 rpcz_store.cc:276] 0709 13:07:39.775779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.112996 (+337217us) service_pool.cc:224] Handling call
0709 13:07:40.917134 (+804138us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:40.917281 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761570048}
I20260709 13:07:40.917593 15622 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.916484 15576 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:40.898259 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1905) took 1112 ms. Trace:
I20260709 13:07:40.917412 12801 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:40.946815 12799 rpcz_store.cc:276] 0709 13:07:39.785467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.743429 (+957962us) service_pool.cc:224] Handling call
0709 13:07:40.743802 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.896440 (+152638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.898174 (+  1734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.891770 15597 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:40.920441 13518 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:40.952461 12806 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:40.959599 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:40.911530 15637 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:40.917361 15742 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.954126 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1906) took 1168 ms. Trace:
I20260709 13:07:40.948537 15645 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.967288 12801 rpcz_store.cc:276] 0709 13:07:39.785730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.748333 (+962603us) service_pool.cc:224] Handling call
0709 13:07:40.789012 (+ 40679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.950253 (+161241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.954056 (+  3803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.948746 15614 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.952669 15768 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.979200 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 186717us
I20260709 13:07:40.980911 12728 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:07:40.998821 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.969244 15742 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.973492 15614 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.971997 15687 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.988111 15737 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:40.971379 15735 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.019899 12875 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:41.073834 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49823.4us
W20260709 13:07:41.075852 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.072929 15496 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.029073 15614 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.972597 15557 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.027297 15643 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:41.137636 15643 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.065037 15578 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:41.021471 15597 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:07:41.076144 15768 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.025089 15645 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.124193 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.126405 15642 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.129431 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70605.4us
I20260709 13:07:41.149369 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:41.150573 15769 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:41.129644 15496 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.152074 15769 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:41.154134 15496 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:41.136606 15557 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.154340 12802 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:41.156344 15557 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.118494 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.157449 12806 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:41.157757 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.158388 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:41.159739 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.159955 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.160513 12728 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:41.161580 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.162307 12728 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:41.140184 15530 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:41.165752 15557 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:41.166904 15769 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.167272 15769 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:41.163245 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.170449 12728 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:41.174878 15764 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.175416 15764 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:41.174600 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.177217 12730 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:41.179728 12724 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:41.189548 15578 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.139899 15643 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.114476 15737 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.178763 12730 pending_rounds.cc:85] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 3
I20260709 13:07:41.201277 12879 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:41.084236 15719 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:07:41.202190 15578 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.208287 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.200538 12730 pending_rounds.cc:107] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:41.206732 15643 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.210779 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.202538 15666 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.211575 15643 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.212213 15737 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.213822 15643 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.214519 15737 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.219911 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.220472 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.220815 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.221335 12881 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:41.222219 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.222389 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.223296 12881 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:41.223600 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.225389 12874 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:41.220500 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.209995 12730 raft_consensus.cc:2889] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:41.227968 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1910) took 1530 ms. Trace:
I20260709 13:07:41.229043 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.228385 12879 rpcz_store.cc:276] 0709 13:07:39.677975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.691470 (+ 13495us) service_pool.cc:224] Handling call
0709 13:07:39.728329 (+ 36859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.626363 (+898034us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540037fda0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b7106f 00007f0f41be9f60 00007f0f41beb7de 00007f0f41bf5b49 00007f0f41bf6416 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62
0709 13:07:40.913417 (+287054us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b58004e02d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b4f0aa 00007f0f41bd1447 00007f0f41be9fe7 00007f0f41beb7de 00007f0f41bf5b49 00007f0f41bf6416 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4
0709 13:07:41.201666 (+288249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.208776 (+  7110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021708032}
I20260709 13:07:41.238395 12880 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:41.227221 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.220394 15637 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.249766 12731 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:41.251250 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:41.236577 15537 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.003s
I20260709 13:07:41.257087 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:41.251271 15358 consensus_meta.cc:287] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.009s
I20260709 13:07:41.261806 12880 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:41.269757 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.273286 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.209408 15642 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.274212 12881 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:41.266904 15681 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.279517 15787 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:07:41.249926 15666 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.280995 12873 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:41.282788 15666 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:41.284178 12804 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 13:07:41.275121 15764 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:41.284904 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.285380 15764 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.286461 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:41.287822 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.279052 15681 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.255561 15597 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:41.192920 15769 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.222431 15795 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:41.228888 15735 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.294245 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:41.295853 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 165379us
I20260709 13:07:41.297644 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:41.298513 12731 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.302716 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.306576 12879 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:41.308996 12882 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:41.304219 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.258735 15753 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.313431 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.318409 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:41.291109 15568 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.254371 15637 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.322947 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.323841 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:41.269306 15358 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.309185 15643 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.315341 15517 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.349953 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.353998 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.351078 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:41.328627 15737 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:41.348521 15537 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:41.329615 15622 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.328312 15597 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.357743 15719 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.366976 15769 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.342679 15568 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:41.374398 15650 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.006s
I20260709 13:07:41.352541 15643 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.389487 12724 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:41.369436 15796 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.372774 15576 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.363377 15768 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.419729 15768 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:41.420428 15768 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.422926 15768 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:41.372987 15645 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.393702 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 316) took 1668 ms. Trace:
I20260709 13:07:41.424294 12727 rpcz_store.cc:276] 0709 13:07:39.653124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.841280 (+188156us) service_pool.cc:224] Handling call
0709 13:07:39.841527 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.861279 (+ 19752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.861322 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.861376 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.861418 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.261640 (+1400222us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b540040f454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:41.267231 (+  5591us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.321150 (+ 53919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44925184}
I20260709 13:07:41.425982 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.426594 12730 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:41.426844 12727 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:41.403067 15788 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 13:07:41.428821 15753 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.430635 15735 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.400199 15576 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.433753 15576 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.437057 15642 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:41.437242 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:41.438719 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.439033 12731 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:41.439512 12804 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:41.372102 15537 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.442392 15537 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:41.443634 15643 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.445345 15494 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:41.409565 15587 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.000s
I20260709 13:07:41.447023 15587 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.448483 12727 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:41.417893 15568 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.389902 15737 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:41.418953 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 126279us
I20260709 13:07:41.365200 15517 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.450614 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.373354 15614 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:41.895273 13487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.011s
W20260709 13:07:41.493326 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 142330us
W20260709 13:07:41.911274 13487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.011s	sys 0.012s
I20260709 13:07:41.718750 12875 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.911778 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:41.912523 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:41.494976 15797 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:41.522028 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.914278 12731 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:41.914764 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:41.915729 12731 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:41.916064 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:41.916397 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:41.452070 15622 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.917747 13521 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:41.917814 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:41.927683 15614 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.928256 13514 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:41.715015 15620 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.929452 15620 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.500545 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:41.589248 15496 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.919034 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:41.638324 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.936848 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.515133 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1908) took 1837 ms. Trace:
I20260709 13:07:41.503685 12725 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.501770 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.500463 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.920794 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:41.922895 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.465155 15358 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.494398 15796 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.461447 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:41.938877 13519 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:41.539337 15742 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.937708 12876 rpcz_store.cc:276] 0709 13:07:39.677329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.677529 (+   200us) service_pool.cc:224] Handling call
0709 13:07:39.715480 (+ 37951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.533816 (+818336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.514744 (+980928us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54000c80d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:41.515052 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750580480}
I20260709 13:07:41.925747 15681 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:41.926095 12808 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:41.925874 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:41.494109 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:41.930605 15622 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:41.475318 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.664081 15799 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.930845 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.931648 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.465281 15587 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.460561 12730 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:41.958042 12802 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
W20260709 13:07:41.513602 15588 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.004s
I20260709 13:07:41.912869 15557 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:41.948980 15537 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.949254 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:41.950011 15800 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.951081 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.951962 12724 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.910388 15597 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.959312 15358 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.963456 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 262) took 1075 ms. Trace:
W20260709 13:07:41.970631 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57715.3us
W20260709 13:07:41.966765 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.500840 15650 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.456s
I20260709 13:07:41.936853 15637 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:41.970793 13520 rpcz_store.cc:276] 0709 13:07:40.880750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.888131 (+  7381us) service_pool.cc:224] Handling call
0709 13:07:41.708185 (+820054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.714190 (+  6005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.714236 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.714299 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:41.714338 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.714419 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.956252 (+241833us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400579750. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:41.956393 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885303040}
I20260709 13:07:41.517153 15576 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:41.975891 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 475491us
I20260709 13:07:41.973016 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:41.979409 15737 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:41.980448 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.981140 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.970134 15597 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:41.982932 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:41.982697 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:41.942644 15496 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:41.987851 12804 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:41.967658 15642 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.991127 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:41.994896 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.994808 15642 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.995831 12807 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:41.997164 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:41.997488 15642 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:41.979094 15622 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:41.999157 15622 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.003618 15622 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.001267 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.012837 12807 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:41.974279 15474 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:41.967854 15764 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:42.007712 15742 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.008083 15597 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.008256 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:41.993358 12724 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:42.014925 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1026) took 2359 ms (client timeout 2076 ms). Trace:
I20260709 13:07:42.013343 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:41.984285 15587 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.019032 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:42.020439 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47653.5us
I20260709 13:07:41.966711 15588 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.967222 15614 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:07:42.016609 12726 rpcz_store.cc:269] 0709 13:07:39.655851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.692895 (+ 37044us) service_pool.cc:224] Handling call
0709 13:07:42.014483 (+2321588us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400246654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:42.014679 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380651776}
I20260709 13:07:41.971545 15800 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:41.983551 15799 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.021044 12804 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:42.021792 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.025291 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:42.004908 15810 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.027721 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:42.030987 12807 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.028189 12875 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:42.030048 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:42.015683 15737 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.031859 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 200) took 1366 ms. Trace:
I20260709 13:07:42.017656 15764 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.029794 15722 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.032691 15795 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.022531 15506 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.032740 12733 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:42.020979 15808 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.022652 15557 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.044507 15557 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.044938 15557 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.042403 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:42.050595 12800 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:42.054113 15764 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.055510 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1722) took 3317 ms. Trace:
I20260709 13:07:42.055903 12877 rpcz_store.cc:276] 0709 13:07:38.737915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.738123 (+   208us) service_pool.cc:224] Handling call
0709 13:07:40.809784 (+2071661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.821610 (+ 11826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.055269 (+1233659us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400221350. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:42.055434 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4664001408}
I20260709 13:07:42.057070 15597 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.058182 15812 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:07:42.059408 15796 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.060199 15810 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.060871 15799 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.062595 15810 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.041639 15742 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.063733 15742 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.038434 12728 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:42.065832 15742 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.068230 15650 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.068696 15650 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.069057 15650 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.069178 15800 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.060026 15796 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.070027 12878 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:42.070379 15796 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:42.070533 12878 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:42.020434 15681 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:42.032948 15667 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:42.041249 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:42.083973 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45623.2us
I20260709 13:07:42.041857 13516 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:42.084805 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:42.030033 15568 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:07:42.085075 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.085922 12801 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:42.087139 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.087963 12801 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:42.089001 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.089066 15517 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.040901 15506 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.089834 15506 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.090157 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.091673 12801 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:42.042265 15737 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.096992 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.097723 12806 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:42.043936 15474 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.043607 15795 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.063237 15496 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.034672 12875 rpcz_store.cc:276] 0709 13:07:40.665773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.779000 (+113227us) service_pool.cc:224] Handling call
0709 13:07:40.822478 (+ 43478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.718400 (+895922us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b580049a0d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b4f0aa 00007f0f41bd1447 00007f0f41be9fe7 00007f0f41beb7de 00007f0f41bf5b49 00007f0f41bf6416 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4
0709 13:07:42.031555 (+313155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.031789 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241696640}
I20260709 13:07:42.077551 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:42.078747 12803 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:42.034847 15637 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.100209 12807 raft_consensus.cc:2410] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:42.101583 15210 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.123576 15410 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.125916 15210 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.126497 15210 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.126247 15410 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.102470 15737 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.103766 15544 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.104557 15650 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:42.106701 15809 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:07:42.108632 15537 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.113348 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:42.071698 12878 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.131840 12807 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:42.129155 15642 raft_consensus.cc:2764] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:42.134366 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.094239 15681 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:42.116710 15474 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.141886 15795 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.142024 12878 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.072136 15587 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.140375 15537 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:42.144539 12803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1922) took 1692 ms (client timeout 2232 ms). Trace:
I20260709 13:07:42.123409 15637 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.146117 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1645) took 1465 ms. Trace:
I20260709 13:07:42.143579 12805 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:42.098722 15597 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:42.150482 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.181800 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.129787 13512 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:07:42.172636 12803 rpcz_store.cc:269] 0709 13:07:40.450800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.537673 (+ 86873us) service_pool.cc:224] Handling call
0709 13:07:42.143402 (+1605729us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400176bd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:42.143514 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3439605120}
I20260709 13:07:42.187477 12808 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:42.135053 15517 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.181620 12733 rpcz_store.cc:276] 0709 13:07:40.680812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.698112 (+ 17300us) service_pool.cc:224] Handling call
0709 13:07:42.015443 (+1317331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.041157 (+ 25714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.143194 (+102037us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400246650. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:42.146054 (+  2860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028750592}
I20260709 13:07:42.185359 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.187331 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.184333 12807 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:42.188022 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.184579 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:42.071718 15796 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.190304 12806 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:42.119084 15808 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.148962 15474 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.149521 15622 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.146746 15681 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.148344 15737 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.216174 12878 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:42.169807 15358 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.226696 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:42.183785 15576 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.220562 12878 pending_rounds.cc:85] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:42.232859 12878 pending_rounds.cc:107] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:42.233244 12878 raft_consensus.cc:2889] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.240711 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:42.184224 15637 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.183802 15620 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.227125 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.223238 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.285878 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1915) took 2370 ms. Trace:
W20260709 13:07:42.288012 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 339075us
I20260709 13:07:42.298072 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:42.298148 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74021.9us
I20260709 13:07:42.286437 12878 rpcz_store.cc:276] 0709 13:07:39.915005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.986124 (+ 71119us) service_pool.cc:224] Handling call
0709 13:07:40.010188 (+ 24064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.069775 (+2059587us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540037f3a0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b6adc0 00007f0f41bf51c0 00007f0f41bf6231 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c
0709 13:07:42.234026 (+164251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.285800 (+ 51774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247856512}
I20260709 13:07:42.191192 15517 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.308816 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.303925 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.313660 12876 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:42.315168 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.288961 15810 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:42.319730 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 311720us
W20260709 13:07:42.287317 15811 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:07:42.326383 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:42.330016 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 304822us
W20260709 13:07:42.313462 15687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.006s	sys 0.010s
W20260709 13:07:42.332873 15687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.006s	sys 0.010s
I20260709 13:07:42.310370 15496 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.307693 15517 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.323907 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.385938 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:42.389230 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 351231us
I20260709 13:07:42.392921 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.398962 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:42.287494 15737 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.402711 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1928) took 1204 ms. Trace:
I20260709 13:07:42.401706 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:42.402108 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50334.6us
W20260709 13:07:42.400483 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92189.7us
I20260709 13:07:42.311583 15764 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.331156 15588 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.333984 15576 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.409849 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.445689 12876 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:42.325464 15557 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:42.454094 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.281653 15667 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:07:42.337113 15614 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.401947 15358 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:42.462940 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.334195 15650 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.334136 15822 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:42.346712 15496 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.470888 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:42.472591 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86744.2us
I20260709 13:07:42.479650 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:42.471561 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 449434us
W20260709 13:07:42.481808 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.455202 15795 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.386603 15810 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:42.493721 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 94881.1us
I20260709 13:07:42.502723 12876 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:42.336526 15519 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.349s
I20260709 13:07:42.504959 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1049) took 1233 ms. Trace:
W20260709 13:07:42.505630 15744 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:42.511991 15527 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:42.512727 15527 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:42.513717 15527 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.511783 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.516765 12880 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:42.399591 15814 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:07:42.525326 12882 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:42.482820 15496 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.517552 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:42.508750 12732 rpcz_store.cc:276] 0709 13:07:41.271825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.431591 (+159766us) service_pool.cc:224] Handling call
0709 13:07:41.431942 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.432371 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.432402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.433012 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.928551 (+495539us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:41.928595 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.928675 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.504712 (+576037us) raft_consensus.cc:1685] finished
0709 13:07:42.504735 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.504891 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8904,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":495048,"threads_started":1,"wal-append.queue_time_us":601263}
I20260709 13:07:42.525549 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:42.492218 15614 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.476946 15820 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.549608 12732 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.550530 15587 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.551512 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:42.446465 15537 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.552834 15537 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.553122 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:42.553877 12876 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.562412 15808 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.458261 15821 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:07:42.563362 15821 consensus_queue.cc:1243] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:42.565587 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:42.566330 12724 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:42.477434 15358 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.569365 15358 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.569763 15210 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.576725 13486 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:42.469468 15576 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.583848 15620 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.475359 15764 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.506448 15795 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:42.588461 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59922.3us
I20260709 13:07:42.525816 15650 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:42.530292 15810 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.604249 15764 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.445029 12800 rpcz_store.cc:276] 0709 13:07:41.198125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.054975 (+856850us) service_pool.cc:224] Handling call
0709 13:07:42.055248 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.055467 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:42.289311 (+233844us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.402276 (+112965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.402343 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.402404 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.402489 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.402647 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10792,"prepare.queue_time_us":281586,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":11496,"thread_start_us":335223,"threads_started":2}
I20260709 13:07:42.607461 15568 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.608667 15557 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.489046 15824 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:07:42.498582 15822 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.611778 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:42.579442 15820 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:42.617159 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.619405 12874 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
W20260709 13:07:42.622026 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 170260us
I20260709 13:07:42.623126 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:42.629164 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.630821 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.630964 12773 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:42.612071 15650 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:42.659755 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.584928 15517 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.590453 15506 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.633008 15666 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.650573 15587 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.636914 15820 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.681686 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1058) took 1391 ms. Trace:
I20260709 13:07:42.650156 15358 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.689833 15358 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.690537 15358 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.646713 15831 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.692592 15831 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.687999 12725 rpcz_store.cc:276] 0709 13:07:41.290289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.941241 (+650952us) service_pool.cc:224] Handling call
0709 13:07:41.956586 (+ 15345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.975583 (+ 18997us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:42.430684 (+455101us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.655860 (+225176us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.681204 (+ 25344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.681274 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:42.681338 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.681429 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.681602 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97954,"prepare.queue_time_us":629746,"prepare.run_wall_time_us":64,"raft.queue_time_us":83242,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14374,"spinlock_wait_cycles":5291264,"thread_start_us":533229,"threads_started":2,"wal-append.queue_time_us":206133}
I20260709 13:07:42.685218 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1059) took 1380 ms. Trace:
I20260709 13:07:42.704646 12731 rpcz_store.cc:276] 0709 13:07:41.311801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.948302 (+636501us) service_pool.cc:224] Handling call
0709 13:07:41.963510 (+ 15208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.968635 (+  5125us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:42.327350 (+358715us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.492800 (+165450us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.610208 (+117408us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180034cd20. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:07:42.664999 (+ 54791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.665063 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.684952 (+ 19889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.685030 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.685161 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131471,"prepare.queue_time_us":506830,"prepare.run_wall_time_us":37,"raft.queue_time_us":178774,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":32600,"spinlock_wait_cycles":36630400,"thread_start_us":529458,"threads_started":3,"wal-append.queue_time_us":250930}
W20260709 13:07:42.710182 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 239374us
W20260709 13:07:42.720085 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59183.3us
I20260709 13:07:42.720893 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.720602 15795 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.726787 12873 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:42.662142 15819 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.730422 15735 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.649927 15568 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.684394 15587 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:07:42.739454 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 108504us
I20260709 13:07:42.743059 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:42.748507 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.678009 15620 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:42.721854 15810 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:42.749271 12879 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:42.684141 15666 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.729984 15819 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:42.759610 15506 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:42.760957 12773 connection.cc:256] RPC call timeout handler was delayed by -1.524435224000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:07:42.764712 15827 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:07:42.767663 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.768481 12877 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:42.741369 15764 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.770720 12876 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:42.746194 15587 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.779481 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.780887 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:42.781971 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.782552 12880 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:42.783439 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.801468 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.757390 15735 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:42.803064 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.809278 12877 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:42.768249 15819 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.773031 15737 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:42.805338 12876 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:42.788422 15824 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.814881 15831 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.815274 15822 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.818596 15517 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.819463 15812 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:42.820025 15799 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:42.806735 15474 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.001s
I20260709 13:07:42.855746 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.857959 12881 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:42.810021 15576 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.785331 15810 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.823930 15666 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:42.816311 15835 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:07:42.873667 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.785533 15764 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.871523 15622 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:42.806071 15650 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.812384 15735 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.872718 15410 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.872530 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:42.815739 15838 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:07:42.874915 12876 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:42.853950 15799 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:42.811223 15795 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:42.894950 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:42.897310 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:42.859483 15474 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.865741 15824 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:07:42.900621 15681 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.624s	user 0.004s	sys 0.008s
I20260709 13:07:42.927255 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:42.927330 15834 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.928181 15834 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:42.930794 15834 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:42.932408 15568 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:42.934834 15637 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.004s
I20260709 13:07:42.935287 15637 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:42.895324 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:42.949298 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 76871us
W20260709 13:07:43.013723 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.071262 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 566824us
I20260709 13:07:43.073063 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.073779 12731 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:43.075335 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.076222 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.079962 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 358859us
I20260709 13:07:43.080402 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:42.973527 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:43.085204 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.086365 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:43.022374 15825 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
I20260709 13:07:43.089651 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:43.068195 15841 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:42.924543 15831 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.104848 15637 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:43.090121 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.092396 12731 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.098927 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.100528 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.104292 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.123669 13484 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:43.124575 15842 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:07:43.125152 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:43.126212 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.126500 15620 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.126675 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:43.127031 15620 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.127326 13520 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.127584 15620 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.128602 15474 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.128925 15805 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:43.129362 15805 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.129738 15805 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.130554 15764 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.135130 13520 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:43.030355 15843 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:43.136502 15843 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.090557 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.140236 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:43.126992 12729 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:43.098488 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:42.934844 15810 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.079066 15588 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:43.150094 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48289.9us
I20260709 13:07:43.155157 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:42.988567 15799 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.156634 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.156899 15834 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.157285 12876 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:43.157786 15820 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.158560 15210 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:43.155210 15843 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.161616 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.090766 15735 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.164562 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:43.164834 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.152705 15837 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:43.165516 12804 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:43.166559 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.167645 15820 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:43.168403 15650 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.168557 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:43.169086 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.170351 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.152385 15831 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.171593 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.088456 15358 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.172760 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.173883 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:43.174093 15358 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.174422 12875 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.176455 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.177567 15544 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:43.177702 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:43.178334 12879 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:43.178174 15544 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.179481 12879 pending_rounds.cc:85] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:43.179770 12879 pending_rounds.cc:107] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:43.090940 15796 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:07:43.163748 15642 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:43.180413 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:43.180011 12879 raft_consensus.cc:2889] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:43.151353 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58546.3us
I20260709 13:07:43.190419 12874 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:43.186976 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.196185 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 109898us
I20260709 13:07:43.195484 12733 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:43.150358 15519 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.206040 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:43.207007 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:42.949324 15681 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.208406 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.224993 12800 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:43.183367 15637 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.234210 15637 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:43.234683 15637 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.235379 12807 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:43.236342 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.237597 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.189774 15642 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:43.240516 15642 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.241917 15642 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:43.242336 15496 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.001s
W20260709 13:07:43.242770 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52182.3us
I20260709 13:07:43.243425 15681 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:43.171731 15831 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.242823 15496 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.244465 12699 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:43.245121 12880 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:43.245582 15831 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:43.246403 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.246999 12805 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:43.247759 12878 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:43.232326 15799 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.250890 12877 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:43.236706 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:43.282707 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 85782us
I20260709 13:07:43.282739 12803 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.284214 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:43.294984 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:43.300091 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:43.305799 12729 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:43.317067 12727 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:43.319440 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:43.182092 15588 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.156667 15587 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.250252 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:43.337069 12875 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:43.294474 15544 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:43.285283 15519 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:43.294219 15824 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.338244 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.314332 15506 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:43.332594 15854 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:43.286226 15474 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:07:43.355178 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 166197us
I20260709 13:07:43.359122 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.360767 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.360777 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:43.378288 12732 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.356871 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.301910 15557 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:07:43.366183 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 71294.8us
I20260709 13:07:43.344126 15210 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.380374 12882 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:43.381117 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:43.429348 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.429919 12799 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:43.382498 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81273.6us
I20260709 13:07:43.389294 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.385872 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:43.423035 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.431497 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:43.424605 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.433200 12731 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.430485 12727 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:43.434163 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.353406 15576 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.438264 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:43.439355 12807 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.439704 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:43.440213 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.440831 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:43.448203 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.450860 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.461027 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:43.461884 13520 raft_consensus.cc:2368] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
I20260709 13:07:43.464627 12771 leader_election.cc:400] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
I20260709 13:07:43.464946 12771 leader_election.cc:403] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.466921 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.353395 15735 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:07:43.437121 15210 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:43.499372 15210 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.476920 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.500396 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59634.2us
I20260709 13:07:43.477465 15795 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.480607 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.482611 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:43.493026 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 156193us
I20260709 13:07:43.447700 15831 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:43.476205 13516 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:43.477064 15587 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.495790 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.501470 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:43.506345 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:43.516726 12799 raft_consensus.cc:2410] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:43.507594 12808 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:43.521916 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.522432 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.523159 12731 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:43.524454 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.518504 12725 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.517300 12805 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:43.526253 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.522614 12808 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:43.529918 12731 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.480204 15650 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.495754 15496 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:43.542945 12807 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:43.459704 15576 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.476136 15849 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.515986 15544 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.473929 15620 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.552129 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.554312 12807 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:43.756651 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45761.5us
I20260709 13:07:43.769619 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:43.661412 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.563844 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 179762us
I20260709 13:07:43.765347 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.632902 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:43.777616 12727 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:43.613224 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:43.781579 12731 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.632432 12805 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:43.789989 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:43.789871 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.790834 12727 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:43.790810 12808 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:43.622006 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.608266 12726 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:43.715932 12732 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:43.794976 13487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.017s
W20260709 13:07:43.622233 15852 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:07:43.624194 15855 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
W20260709 13:07:43.620978 15836 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:43.623778 15576 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.564123 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.801138 13487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.004s	sys 0.018s
W20260709 13:07:43.818460 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 525987us
I20260709 13:07:43.701421 12803 raft_consensus.cc:2410] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:43.675856 15496 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.636216 15819 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.000s
I20260709 13:07:43.581061 15613 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.808560 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.808813 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:43.632366 15588 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:43.813367 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 285044us
W20260709 13:07:43.796325 15642 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.005s
I20260709 13:07:43.795897 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.815184 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.847843 12732 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:43.533591 15650 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.537562 15519 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.823052 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:43.812244 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 282398us
I20260709 13:07:43.857846 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.840778 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.839473 12806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.020s
I20260709 13:07:43.614560 15805 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.575527 15849 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.822139 15846 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.818826 15838 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:43.861765 12732 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:43.629963 15637 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.858994 12724 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:43.859069 12806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.021s
I20260709 13:07:43.870754 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:43.871920 15846 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.874919 15849 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:43.878111 15799 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.002s
I20260709 13:07:43.878723 13512 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:43.853566 15650 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.883540 15799 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.885027 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.886235 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:43.842748 15819 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.846551 15496 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:43.890769 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.900784 12725 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.902840 13519 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:07:43.906339 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83387.2us
I20260709 13:07:43.908591 15831 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.909289 15831 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.909690 15831 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.911664 15620 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.913611 15819 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:43.914286 12728 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.915356 15613 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.917187 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:43.918067 13514 raft_consensus.cc:2368] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:07:43.927693 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:43.934324 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:43.937081 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.939742 15864 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:43.940450 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:43.942602 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.889678 15744 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:43.958612 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 72600.1us
W20260709 13:07:43.959165 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 101983us
I20260709 13:07:43.960589 12724 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.964018 12845 leader_election.cc:400] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:07:43.964461 12845 leader_election.cc:403] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.915923 15637 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:43.964556 15744 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:43.963761 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.970274 12724 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.978371 12728 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:43.981297 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.981964 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:43.967901 15744 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:43.983793 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 43769.7us
I20260709 13:07:43.984724 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:43.984108 12725 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:43.920708 15210 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:43.992561 15795 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
I20260709 13:07:43.994386 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:43.994068 13486 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:44.001866 12724 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 3. (term mismatch)
I20260709 13:07:44.002406 12724 pending_rounds.cc:85] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 2
I20260709 13:07:43.999260 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:44.003741 12724 pending_rounds.cc:107] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 8.3
I20260709 13:07:44.004163 12724 raft_consensus.cc:2889] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.995296 15876 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.011643 12724 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:43.986855 15637 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:44.033342 15868 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.002141 15873 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.024708 15795 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.033911 15868 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.034391 15795 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.036356 15795 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.025398 15496 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.026304 15210 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:44.028805 12726 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:44.040146 15868 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.042124 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.043071 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.044533 15681 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.044919 15210 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.045017 15681 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:44.045439 15210 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:44.045663 15681 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.045917 15210 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:44.047879 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 621390us
I20260709 13:07:44.048751 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.049897 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.050956 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.051648 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.032164 12725 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.052527 15812 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.053180 15527 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.043460 15650 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.053653 15527 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.054010 15474 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.054129 15527 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.054800 15474 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.055176 15474 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.055441 15650 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.056670 15835 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.057106 15835 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:44.058038 15831 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.029954 15880 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.061430 15819 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.061990 15819 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.053438 15812 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:44.032274 15853 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.556s	user 0.011s	sys 0.006s
I20260709 13:07:44.064162 15831 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.058046 15835 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.066047 15835 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.055523 15474 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.070386 13516 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:07:44.071398 13520 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:44.078190 15614 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:44.079178 15614 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:44.080302 15410 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.080687 15410 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:44.081606 15410 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.083050 15410 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.084209 15838 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:44.084864 15838 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:44.051931 15846 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.086572 15506 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.086217 15838 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.088011 15506 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:44.053653 15799 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.088555 15506 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.088783 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.087769 15838 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.089432 12806 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.092247 13514 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.092885 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1674) took 1003 ms. Trace:
I20260709 13:07:44.093283 12728 rpcz_store.cc:276] 0709 13:07:43.089156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.089389 (+   233us) service_pool.cc:224] Handling call
0709 13:07:44.092686 (+1003297us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400411254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:44.092815 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777763072}
I20260709 13:07:44.095906 15805 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.096284 15849 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:44.097564 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 112924us
I20260709 13:07:44.098640 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:44.099512 15849 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.101015 15849 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:44.084904 15819 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.110595 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 154) took 7825 ms. Trace:
I20260709 13:07:44.111057 15876 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
W20260709 13:07:44.111755 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.111814 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:44.113063 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:44.114318 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:44.117933 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.120908 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.113292 15846 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.115564 15849 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.114897 15614 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:44.135414 15819 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.124998 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.111128 12627 rpcz_store.cc:276] 0709 13:07:36.285568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.285847 (+   279us) service_pool.cc:224] Handling call
0709 13:07:44.110373 (+7824526us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:40.452422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:40.455112 (+  2690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:40.455170 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:07:40.455208 (+    38us) tablet.cc:662] Decoding operations
0709 13:07:40.464682 (+  9474us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:40.464849 (+   167us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:40.464891 (+    42us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:07:40.467112 (+  2221us) tablet.cc:701] Row locks acquired
0709 13:07:40.467168 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:07:40.477039 (+  9871us) write_op.cc:270] Start()
0709 13:07:40.477244 (+   205us) write_op.cc:276] Timestamp: P: 1783602460476906 usec, L: 0
0709 13:07:40.477287 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:07:40.478278 (+   991us) log.cc:844] Serialized 7406 byte log entry
0709 13:07:40.592528 (+114250us) op_driver.cc:464] REPLICATION: finished
0709 13:07:40.642391 (+ 49863us) write_op.cc:301] APPLY: starting
0709 13:07:40.642524 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:40.643035 (+   511us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:40.643283 (+   248us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:40.742669 (+ 99386us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:40.743081 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:07:40.743140 (+    59us) write_op.cc:312] APPLY: finished
0709 13:07:40.743663 (+   523us) log.cc:844] Serialized 131 byte log entry
0709 13:07:40.743886 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:40.744089 (+   203us) write_op.cc:454] Released schema lock
0709 13:07:40.744178 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:40.744653 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:40.744682 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23176,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":49402,"apply.run_cpu_time_us":6858,"apply.run_wall_time_us":102212,"num_ops":19,"prepare.queue_time_us":20153,"prepare.run_cpu_time_us":10204,"prepare.run_wall_time_us":54547,"raft.queue_time_us":49078,"raft.run_cpu_time_us":5761,"raft.run_wall_time_us":28318,"replication_time_us":115046,"thread_start_us":72585,"threads_started":4,"wal-append.queue_time_us":29009,"wal-append.run_cpu_time_us":18196,"wal-append.run_wall_time_us":1237317}]]}
W20260709 13:07:44.185185 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60298.5us
I20260709 13:07:44.186357 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.189450 12628 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 3 to 4, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 4 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.195014 15210 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:44.127381 12771 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 3.142s (SENT) [suppressed 15 similar messages]
I20260709 13:07:44.187812 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.135470 15795 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.191884 12628 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 6, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.158818 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.222257 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:44.216277 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 88924.7us
I20260709 13:07:44.196251 15588 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:44.224375 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65700.9us
I20260709 13:07:44.135890 15846 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.086627 15744 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.220755 15576 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:44.236712 15588 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.237644 15796 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:44.221016 15795 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:44.244307 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 282335us
I20260709 13:07:44.286666 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:44.268424 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.250962 12628 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 6, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.289141 12806 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
W20260709 13:07:44.294976 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 242168us
I20260709 13:07:44.302585 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:44.264565 15576 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:44.250521 15642 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.289076 15764 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.277740 15210 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.282243 15795 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.246248 15819 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.245755 15820 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.304651 15519 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.249812 15744 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.265077 15588 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.247565 15846 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.280942 15527 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.316911 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.314711 15642 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:44.318832 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.338099 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.313505 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:44.321385 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.268453 15614 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.246299 15557 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:07:44.237624 15849 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:44.320580 12628 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 2 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 5 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.281853 15474 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.327044 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.311720 15805 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:44.327940 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.249745 15506 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.331403 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.332233 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.256778 15838 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.338215 12807 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:44.378798 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.379874 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.380631 12807 raft_consensus.cc:2410] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:44.276559 15796 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.312139 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.339640 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.279217 15735 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.341555 12801 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:44.343060 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.412545 12799 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:44.324654 15519 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.341637 12802 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:44.416826 12802 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.324229 15820 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.324393 15819 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:44.370119 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.373200 12806 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:44.419265 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.357133 15744 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.413875 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.421983 12800 raft_consensus.cc:2368] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:07:44.422142 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:44.426837 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 118680us
I20260709 13:07:44.367666 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:44.348259 15614 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:44.427434 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 205274us
I20260709 13:07:44.383795 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.358163 15868 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:44.481889 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 168536us
I20260709 13:07:44.652525 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.475996 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:44.599671 12803 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:44.622079 15881 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:07:44.502954 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:44.607671 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 236774us
I20260709 13:07:44.581981 12628 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.662043 12807 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:44.614495 15887 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:44.584780 12806 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:44.570747 15892 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:07:44.423528 15819 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.667987 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.423758 15519 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.719599 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.720722 12876 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:44.721549 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 44385.4us
W20260709 13:07:44.633302 15410 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 13:07:44.428822 15544 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.422580 15805 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:44.675617 12802 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:44.743109 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90661.6us
I20260709 13:07:44.421048 15735 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:44.755785 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.756508 12803 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.756563 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.678537 15527 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.425930 15820 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.758749 12628 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.667047 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.626965 15796 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.421316 15744 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:44.726241 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.674590 15880 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.729635 15868 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:44.730155 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.729954 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.730388 15614 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.730624 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.415072 15576 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.731138 12878 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:44.731585 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:44.731777 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.776206 12880 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.776245 12881 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:44.774580 12874 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:44.732255 15890 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.732571 15893 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.732863 12873 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:07:44.782106 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 112627us
I20260709 13:07:44.734298 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:44.734949 15885 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.149s	user 0.004s	sys 0.000s
I20260709 13:07:44.710676 15894 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.735968 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1683) took 1120 ms. Trace:
I20260709 13:07:44.789149 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.788112 12731 rpcz_store.cc:276] 0709 13:07:43.615534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.859454 (+243920us) service_pool.cc:224] Handling call
0709 13:07:43.869132 (+  9678us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.059704 (+190572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.059750 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.060960 (+  1210us) log.cc:844] Serialized 574 byte log entry
0709 13:07:44.338696 (+277736us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.338746 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.338838 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.735715 (+396877us) raft_consensus.cc:1685] finished
0709 13:07:44.735749 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.735903 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189988,"raft.queue_time_us":190166,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":277246,"threads_started":1,"wal-append.queue_time_us":672425}
I20260709 13:07:44.736369 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:44.790869 12879 raft_consensus.cc:606] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:44.791349 12879 raft_consensus.cc:614] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.737993 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:44.792857 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.739156 15506 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:44.410781 15838 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.710327 15764 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.710107 15876 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.605726 15496 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.480352 15637 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.261s
I20260709 13:07:44.763501 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:44.754866 15735 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:07:44.769681 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 103023us
I20260709 13:07:44.819235 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.819787 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.740808 15812 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.758656 15410 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.777809 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.780972 12882 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:44.764575 15835 consensus_meta.cc:287] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.000s
I20260709 13:07:44.540071 15642 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.762641 15899 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.801880 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.843979 12876 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:44.807682 15764 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.845101 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.846203 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.808019 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:44.809877 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 307014us
I20260709 13:07:44.847476 12803 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:44.847841 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.786603 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:44.815383 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52240.2us
I20260709 13:07:44.816566 12880 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
W20260709 13:07:44.848786 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62327.2us
I20260709 13:07:44.849349 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:44.849539 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:44.850304 12880 raft_consensus.cc:2376] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8. Re-sending same reply.
I20260709 13:07:44.850562 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.851698 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:44.761397 15544 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.828063 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:44.785344 15474 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.787743 15894 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:44.803433 15614 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.852723 15637 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.853070 15614 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.853480 15637 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.853752 15614 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.854080 15637 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.854915 15544 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:44.841500 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.856165 15894 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.852484 15527 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.857059 15527 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.857527 15527 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.857697 12878 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 13:07:44.842705 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.851794 12880 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:44.860518 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:44.860930 12880 pending_rounds.cc:85] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:44.861188 12880 pending_rounds.cc:107] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:44.861409 12880 raft_consensus.cc:2889] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.858945 12878 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:44.867144 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.824656 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1082) took 1462 ms. Trace:
I20260709 13:07:44.876355 12727 rpcz_store.cc:276] 0709 13:07:43.362164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.848240 (+486076us) service_pool.cc:224] Handling call
0709 13:07:43.871564 (+ 23324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.061717 (+190153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.061749 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.062201 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.284672 (+222471us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:44.284718 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.284803 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.733232 (+448429us) raft_consensus.cc:1685] finished
0709 13:07:44.733252 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.824381 (+ 91129us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400430dd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:44.824593 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189734,"raft.queue_time_us":190889,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":24821632,"thread_start_us":222023,"threads_started":1,"wal-append.queue_time_us":348652}
I20260709 13:07:44.776830 15880 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:44.900060 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52287us
I20260709 13:07:44.822650 15812 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:44.908711 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.836298 15735 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.918735 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.916920 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:44.907168 12628 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 6, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.927556 12881 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:44.839074 15902 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.820315 15876 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.899920 15835 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.823028 15496 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.845947 15899 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.840147 15506 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:44.931635 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:44.908221 15744 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.909046 15831 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.839077 15410 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.804673 15893 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.958267 15880 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:44.958935 15900 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:07:44.959038 15506 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.960253 15908 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:44.960898 15908 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.963271 15908 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.965255 13514 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:44.966122 12804 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:44.972440 15506 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:44.972362 15897 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:44.975056 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:44.977092 15838 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:44.978508 15527 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.963864 15908 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.981555 15527 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:44.982892 15588 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260709 13:07:44.984930 15893 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:44.989681 15876 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:44.977334 15681 consensus_meta.cc:287] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.005s
I20260709 13:07:44.933676 15868 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:44.997396 15894 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:44.999584 15905 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.000448 15905 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:45.001359 15905 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.954953 15831 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.002424 15735 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:45.002879 15735 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:45.003278 15735 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.004060 15410 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:45.004719 15410 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.005035 15410 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:45.005890 15410 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.007050 15410 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.940819 15642 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.001729 15905 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:45.017895 15744 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.029913 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:44.952908 15899 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:45.034850 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 251836us
W20260709 13:07:45.038501 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 189219us
I20260709 13:07:44.905107 15805 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:45.002444 15831 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.029155 15905 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:45.039542 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 211620us
I20260709 13:07:45.054589 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:44.983492 15588 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.062224 15820 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.060081 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:45.039433 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:45.064186 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 241315us
I20260709 13:07:45.064028 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:45.007786 15637 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.019263 15681 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:45.085227 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45933.3us
W20260709 13:07:45.090102 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 238508us
I20260709 13:07:45.098896 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.076130 15846 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.000s
I20260709 13:07:45.069984 15902 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:45.101240 12847 connection.cc:256] RPC call timeout handler was delayed by -1.05103806000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:07:45.098147 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:45.104449 12808 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:45.105022 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:45.076674 15576 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:45.108515 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 207441us
I20260709 13:07:45.111547 12848 leader_election.cc:400] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:07:45.112524 12873 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:45.113296 12876 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:45.111545 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.122321 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:45.126660 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:45.128513 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.129637 12876 raft_consensus.cc:2368] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10.
I20260709 13:07:45.129842 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:45.130689 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.133155 12874 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:45.134299 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.135386 12874 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:45.139624 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:45.140678 12880 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.140727 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.019137 15812 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.092485 15911 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.147219 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.148195 12882 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:45.151927 15544 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.163182 12876 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:45.108254 15910 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:45.117228 15838 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.117352 15898 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.161983 15892 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.112541 15846 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:45.173125 12879 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:07:45.172991 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52578.5us
I20260709 13:07:45.165692 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.100713 15890 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:07:45.108580 15913 raft_consensus.cc:2764] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:45.146636 15902 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:45.179306 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:45.170351 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51647.5us
I20260709 13:07:45.184002 12880 raft_consensus.cc:2410] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:45.195796 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.197237 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.193989 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:45.199119 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.200630 12848 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:45.201916 12876 raft_consensus.cc:2368] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:07:45.146816 15576 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:45.204574 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.208415 12729 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:45.208207 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.205565 12728 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:45.208660 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.208873 12879 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.205638 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.209003 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.207458 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:45.216391 12731 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:45.207832 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.218784 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.221037 12733 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:45.188894 15892 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.223803 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:45.206502 15795 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.872s	user 0.014s	sys 0.001s
I20260709 13:07:45.202342 15812 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.201504 15902 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:45.215631 15894 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.206691 15496 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:45.230618 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.215591 15890 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:45.234941 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 105292us
I20260709 13:07:45.216805 15210 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:45.233045 15892 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.233530 15925 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:45.224751 15915 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:45.250566 15819 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 13:07:45.210829 15914 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:45.217147 15764 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.183226 15910 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.222008 15913 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:45.275297 15910 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.238397 15795 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.210978 15911 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:07:45.263187 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.277119 12802 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:45.278411 15795 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:45.277119 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.270102 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 130088us
I20260709 13:07:45.244098 15902 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.269485 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:45.258343 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.190099 15898 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.282704 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.268827 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.255319 15210 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.253193 15921 raft_consensus.cc:2764] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:45.284592 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:45.298636 12696 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.299942 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.301170 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.279542 15920 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:45.261268 15890 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:45.304880 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:45.284940 15519 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:07:45.279960 15588 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.284425 15557 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.317575 12881 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:45.292397 15681 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:45.308329 15910 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.307044 15903 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.308931 15637 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:45.298377 15210 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.271086 15819 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.306540 15820 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:45.346403 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.347110 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.352514 12806 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:45.293318 15614 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.339342 15932 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.349397 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:45.357537 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56456.4us
I20260709 13:07:45.264489 15925 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:45.393306 12803 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:45.338315 15588 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.375375 12804 raft_consensus.cc:2368] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10.
I20260709 13:07:45.321336 15557 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.319207 15519 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:45.405690 12771 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.506s (SENT)
I20260709 13:07:45.325954 15930 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:45.431018 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.392720 15910 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.412984 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.413483 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:45.407588 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.426148 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:45.379739 15912 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 13:07:45.442682 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:45.414880 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.401692 15588 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.432535 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.437942 12724 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.441027 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:45.428915 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 248) took 1056 ms. Trace:
I20260709 13:07:45.448240 12877 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:07:45.443908 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 147038us
I20260709 13:07:45.475265 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:45.476522 12847 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.646s (SENT)
I20260709 13:07:45.476804 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.478067 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.480528 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.452913 15588 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:45.481820 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.443856 15930 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:45.434088 15924 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.430439 15210 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.483481 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.435194 15915 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:45.429494 15926 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.231s
I20260709 13:07:45.503716 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:45.504920 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 64273us
I20260709 13:07:45.507241 12731 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:45.508211 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58592us
I20260709 13:07:45.486595 15893 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.511832 12696 leader_election.cc:400] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10.
I20260709 13:07:45.514840 12696 leader_election.cc:403] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.519018 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.518656 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:45.511574 15764 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.509758 15681 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:45.520922 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91465.9us
I20260709 13:07:45.541445 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.522312 12731 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.543569 12876 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
W20260709 13:07:45.541610 12771 leader_election.cc:336] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.581s (SENT)
W20260709 13:07:45.556694 12771 leader_election.cc:336] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.603s (SENT)
I20260709 13:07:45.557367 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.559501 12771 leader_election.cc:336] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.879s (SENT)
I20260709 13:07:45.560724 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.566164 12771 leader_election.cc:336] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.909s (SENT)
I20260709 13:07:45.566800 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.569621 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.563258 12724 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:45.569700 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:45.564261 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.509982 15938 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.591513 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:45.522986 15918 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:07:45.537176 15735 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.003s
W20260709 13:07:45.593228 12771 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.048s (SENT)
W20260709 13:07:45.543466 15410 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.004s
I20260709 13:07:45.655221 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:45.656567 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63409us
I20260709 13:07:45.658262 12771 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:45.659137 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:45.538417 15744 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
W20260709 13:07:45.659891 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90369.1us
I20260709 13:07:45.673604 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.660147 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.445480 15890 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.671480 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.670689 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.530275 15819 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.676658 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.678694 12875 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.533658 15519 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:45.572566 15820 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.682139 12807 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.685302 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.654323 15911 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.517524 15893 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:45.686972 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.596609 15838 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.722409 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:45.728842 12876 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:45.671939 15831 consensus_meta.cc:287] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.001s
I20260709 13:07:45.668233 15921 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.732712 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:45.734515 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47691.8us
I20260709 13:07:45.734757 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:45.736599 12874 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.741221 12731 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:45.701684 15938 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:07:45.746721 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.730178 15642 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.002s
I20260709 13:07:45.705756 15898 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:45.758193 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:45.758585 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:45.729702 15819 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.759023 12876 raft_consensus.cc:606] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.681213 15735 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.682477 15903 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:07:45.836623 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 100805us
I20260709 13:07:45.743850 15744 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.855609 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:45.858459 12807 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:45.861743 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1124) took 1047 ms. Trace:
I20260709 13:07:45.864735 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.865339 12803 rpcz_store.cc:276] 0709 13:07:44.814269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.903033 (+ 88764us) service_pool.cc:224] Handling call
0709 13:07:45.861311 (+958278us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001d47d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:45.861649 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020523264}
I20260709 13:07:45.867424 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.868453 12803 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:45.869264 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.873309 12803 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.873848 12802 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:45.875975 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:45.877882 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.754844 15557 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:45.781975 15519 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.902135 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:45.919315 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:45.920428 12807 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:45.921434 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:45.538388 15930 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.942654 12699 leader_election.cc:400] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10.
I20260709 13:07:45.735244 15831 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.909906 12803 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:45.912580 15955 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:07:45.880734 15917 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 13:07:45.927156 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 386628us
I20260709 13:07:45.871428 15914 raft_consensus.cc:2764] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:45.958655 12807 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:45.959074 15892 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 13:07:45.953240 15929 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.448208 13512 rpcz_store.cc:276] 0709 13:07:44.372738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.377187 (+  4449us) service_pool.cc:224] Handling call
0709 13:07:44.479524 (+102337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.724837 (+245313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.728494 (+  3657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.002210 (+273716us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2c00012df8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:07:45.002754 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.069827 (+ 67073us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.072389 (+  2562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.082323 (+  9934us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.368378 (+286055us) raft_consensus.cc:1685] finished
0709 13:07:45.368409 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.425525 (+ 57116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162225,"raft.queue_time_us":173930,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12154,"spinlock_wait_cycles":26612480,"thread_start_us":50872,"threads_started":1,"wal-append.queue_time_us":104931}
I20260709 13:07:45.960198 15931 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.283s
I20260709 13:07:45.962119 15883 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.961836 15945 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10.
I20260709 13:07:45.963028 15941 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.716638 15915 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.964141 15937 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.961781 15904 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:07:45.902889 15210 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:45.965801 15904 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:45.968266 15812 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.004s
I20260709 13:07:45.966354 15904 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:45.970767 15904 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.760198 15938 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:45.953701 15907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.023s	sys 0.050s
I20260709 13:07:45.975418 15938 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:45.854667 15819 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:45.938575 15557 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.091135 12773 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.506s (SENT)
I20260709 13:07:46.094976 15904 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.947808 15897 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:46.116174 15947 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.178s	user 0.005s	sys 0.000s
I20260709 13:07:46.112357 12773 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:46.118296 15949 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:07:46.121950 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 251285us
I20260709 13:07:45.946120 15928 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.123441 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:46.124332 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 442526us
W20260709 13:07:46.126217 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 468098us
W20260709 13:07:46.057585 15588 consensus_meta.cc:287] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.006s
I20260709 13:07:46.133296 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:46.125692 12696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.003s	sys 0.009s
W20260709 13:07:46.147322 12696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.009s
W20260709 13:07:46.148671 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 637673us
I20260709 13:07:46.150192 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:45.938203 15519 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.153980 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.154925 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.155797 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:46.162330 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:46.164587 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:46.135424 15474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.003s	sys 0.009s
I20260709 13:07:45.959743 15892 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.169358 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:46.139833 15953 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:07:46.172103 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.175129 12771 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.175819 15892 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.176393 12807 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:46.176597 15892 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.120406 15557 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.177321 15892 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:46.178105 15474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.009s
I20260709 13:07:46.186668 15967 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.186983 15936 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:46.187673 15650 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.137437 15642 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.167464 15812 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.138797 15613 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.137095 15897 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.210789 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.200896 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:46.207121 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:46.159963 15930 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:46.167728 15931 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:46.213982 12696 leader_election.cc:400] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:07:46.223708 12696 leader_election.cc:403] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.224627 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.216395 12805 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:46.188400 15650 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.167740 15410 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:45.982012 15955 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.242287 12801 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.219065 15945 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.189455 15925 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.152056 15588 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.273645 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.274027 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.274456 12729 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:46.275421 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.276139 12724 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:46.276422 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.277083 12731 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:46.277374 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.275604 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.243337 15650 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:46.282819 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 128296us
I20260709 13:07:46.211175 15938 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.170894 15911 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:07:46.247231 15929 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:46.244887 15937 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:46.271221 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.306052 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.171396 15838 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:07:46.279328 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.222882 15622 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.288420 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:46.289330 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 114289us
I20260709 13:07:46.314070 12724 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:46.294540 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:46.315968 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.211318 15967 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:07:46.268554 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44012.7us
W20260709 13:07:46.282145 15899 consensus_meta.cc:287] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.228s	user 0.012s	sys 0.003s
I20260709 13:07:46.258175 15812 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.274705 15557 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.254232 15931 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:46.310542 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 103554us
I20260709 13:07:46.216146 15613 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.316697 12724 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:46.351652 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:46.247565 15928 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.318637 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.268882 15410 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:46.323526 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.306322 15941 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.348875 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:46.302716 15735 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.351959 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:46.316798 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.412128 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.412555 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.361542 15961 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:07:46.347303 15899 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.363416 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:46.415866 13514 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:46.417826 15899 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.418464 15899 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.337971 15929 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:46.367465 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1963) took 1017 ms. Trace:
I20260709 13:07:46.422312 12804 rpcz_store.cc:276] 0709 13:07:45.349911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.477849 (+127938us) service_pool.cc:224] Handling call
0709 13:07:46.367201 (+889352us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.367357 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541180672}
I20260709 13:07:46.368547 15819 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:46.352743 15902 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.049s	user 0.002s	sys 0.011s
I20260709 13:07:46.373314 15928 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.438871 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.375005 15613 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:46.439857 12881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 1954) took 1330 ms (client timeout 1533 ms). Trace:
I20260709 13:07:46.376492 15796 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:46.376991 15950 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:07:46.444089 15796 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:46.444263 15955 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.445178 15796 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.446214 15796 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.446553 15650 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:46.443616 12881 rpcz_store.cc:269] 0709 13:07:45.109418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.125043 (+ 15625us) service_pool.cc:224] Handling call
0709 13:07:46.439600 (+1314557us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54004209d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.439747 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284223744}
I20260709 13:07:46.380291 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1110) took 1955 ms. Trace:
W20260709 13:07:46.383277 15905 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.314s	user 0.010s	sys 0.005s
I20260709 13:07:46.448791 12808 rpcz_store.cc:276] 0709 13:07:44.424811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.426251 (+  1440us) service_pool.cc:224] Handling call
0709 13:07:44.426530 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.116508 (+689978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.379996 (+1263488us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540028c654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:46.380225 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558804736}
I20260709 13:07:46.449185 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.384333 15921 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:46.450079 15921 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.297405 15938 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.383455 15911 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.395455 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.451931 12731 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:46.451835 15911 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.412978 12724 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:46.453354 12731 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:46.453678 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1774) took 1734 ms. Trace:
I20260709 13:07:46.321206 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.454173 12875 rpcz_store.cc:276] 0709 13:07:44.719435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.729405 (+  9970us) service_pool.cc:224] Handling call
0709 13:07:44.729752 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.695952 (+966200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.453458 (+757506us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540006c7d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:46.453609 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182163200}
I20260709 13:07:46.455145 15819 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.455559 12875 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:46.300617 15897 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.415099 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.367456 15519 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:46.357229 15642 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:46.456919 12873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1782) took 1733 ms (client timeout 1603 ms). Trace:
I20260709 13:07:46.457116 15642 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.455770 15819 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.414772 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.338290 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:46.461199 13512 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:46.423614 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:46.371340 15931 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.421886 15876 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.428726 15902 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.430397 15410 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:46.431717 15948 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:46.413906 15622 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:46.434152 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.466477 12878 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:46.438553 15820 consensus_meta.cc:287] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.714s	user 0.004s	sys 0.007s
I20260709 13:07:46.376055 15831 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:46.467228 15820 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:46.440697 15928 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.467360 15622 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.469923 15622 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:46.471484 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1105) took 1065 ms. Trace:
I20260709 13:07:46.472992 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 347) took 1582 ms. Trace:
I20260709 13:07:46.473362 12732 rpcz_store.cc:276] 0709 13:07:44.890431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.890635 (+   204us) service_pool.cc:224] Handling call
0709 13:07:44.890924 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.991099 (+100175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.991142 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.991194 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:44.991237 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.472747 (+1481510us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b540040f454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:46.472802 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.472932 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229718272}
I20260709 13:07:46.471860 12730 rpcz_store.cc:276] 0709 13:07:45.406314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.408253 (+  1939us) service_pool.cc:224] Handling call
0709 13:07:45.434016 (+ 25763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.448373 (+ 14357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.448403 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.448867 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.516253 (+ 67386us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:45.516303 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.516389 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.431084 (+914695us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:46.471211 (+ 40127us) raft_consensus.cc:1685] finished
0709 13:07:46.471233 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.471428 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6220,"raft.queue_time_us":14708,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":44243,"spinlock_wait_cycles":12844288,"thread_start_us":18627,"threads_started":1,"wal-append.queue_time_us":739960}
I20260709 13:07:46.478229 12845 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:46.480720 15965 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:46.482911 15614 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.484174 15819 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.488500 15527 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.440914 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.423641 15961 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.442026 15929 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.503015 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:46.503857 13514 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:46.490603 15974 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:07:46.506686 15876 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.507076 15876 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:46.422379 15932 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:46.427927 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.513675 12882 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:46.443873 15838 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:46.449108 15905 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.450407 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.450888 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:46.517464 12880 raft_consensus.cc:606] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:46.451397 15938 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.452373 15921 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.453763 12724 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:46.456705 12874 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.393968 15744 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:46.423007 15966 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.009s
I20260709 13:07:46.384482 15907 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.458379 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:46.528128 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 69847.3us
I20260709 13:07:46.412149 12801 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:46.532946 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.534619 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:46.420617 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 71819.4us
I20260709 13:07:46.459616 12881 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:46.457345 12873 rpcz_store.cc:269] 0709 13:07:44.723636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.783128 (+ 59492us) service_pool.cc:224] Handling call
0709 13:07:46.456712 (+1673584us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400070dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.456843 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741331328}
I20260709 13:07:46.457568 15642 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.437630 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.490090 12876 raft_consensus.cc:2376] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9. Re-sending same reply.
I20260709 13:07:46.490422 12804 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.537283 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:46.499509 15904 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.500272 12803 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:46.501631 15867 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:46.501384 15961 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.507491 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.428226 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.548317 12806 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
W20260709 13:07:46.548516 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120381us
I20260709 13:07:46.510231 12845 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:46.517864 12880 raft_consensus.cc:614] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:46.538509 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.549867 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:46.550827 12806 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.555801 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:46.560496 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.562283 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:46.565182 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 55109.4us
I20260709 13:07:46.567183 12847 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:46.545194 15908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.474s	user 0.000s	sys 0.041s
I20260709 13:07:46.568925 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:46.544700 15967 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.527786 15907 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:46.542172 15650 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:46.572672 12808 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.543292 15921 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.544781 15838 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.564718 15931 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:46.553082 15744 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:46.581238 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:46.565274 15902 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.569331 15831 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:46.572386 15908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.000s	sys 0.047s
I20260709 13:07:46.586536 15744 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.588879 15977 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.591897 15961 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.545562 15867 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.573580 15883 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.571702 15974 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.569747 15928 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.570027 15614 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.569931 15880 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.578140 15967 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.604993 12806 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:46.622483 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.546111 15904 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.623859 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.570639 15820 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:07:46.614837 12879 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.615314 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.581244 15911 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.610327 15876 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.628767 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.629119 15876 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.629683 15905 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.619204 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.612735 15883 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.632386 15883 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.633002 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.619874 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.613497 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.634629 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.635470 12879 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:46.518780 15932 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.625854 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.628312 12880 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:46.618532 15893 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.635406 12873 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.638353 12879 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.639189 12873 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:46.624410 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.634507 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.653440 15882 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.653962 15882 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:46.612921 15928 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:46.659000 15928 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.654676 12804 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:46.627071 15967 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.656808 15882 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.660943 15882 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.661448 12878 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:46.662106 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1104) took 1256 ms. Trace:
I20260709 13:07:46.655321 15796 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.662469 12726 rpcz_store.cc:276] 0709 13:07:45.405968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.406093 (+   125us) service_pool.cc:224] Handling call
0709 13:07:45.431001 (+ 24908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.432323 (+  1322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.432370 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.432411 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:45.432445 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.661937 (+1229492us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5400309154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:46.661974 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.662060 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605824}
I20260709 13:07:46.662884 15796 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:46.664729 12805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1099) took 2333 ms (client timeout 1933 ms). Trace:
I20260709 13:07:46.664909 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1130) took 1110 ms. Trace:
W20260709 13:07:46.665218 12805 rpcz_store.cc:269] 0709 13:07:44.331687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.331961 (+   274us) service_pool.cc:224] Handling call
0709 13:07:46.664492 (+2332531us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001d42d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.664617 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176081792}
I20260709 13:07:46.665395 12802 rpcz_store.cc:276] 0709 13:07:45.555027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.587750 (+ 32723us) service_pool.cc:224] Handling call
0709 13:07:46.664723 (+1076973us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001757d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.664853 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491293952}
I20260709 13:07:46.666157 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.666811 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.621196 15614 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:46.657708 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.666908 12879 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:46.667754 12802 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:46.668370 12806 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:46.669353 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.670219 12876 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:46.670764 12873 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.657616 15904 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.669502 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.678244 12800 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.680323 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.680970 12802 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:46.681860 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.682372 12802 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:46.683104 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.633253 15907 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.683595 12802 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:46.684002 15907 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.685148 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.685985 12802 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:46.691237 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.686620 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:46.693536 12882 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:46.696276 12881 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.702044 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:46.702898 12878 raft_consensus.cc:2376] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10. Re-sending same reply.
I20260709 13:07:46.665031 15796 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.685748 15614 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.689749 15882 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.715749 15789 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.718034 15789 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.718479 15789 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.720762 12802 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:46.720643 12801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1131) took 1158 ms (client timeout 1508 ms). Trace:
W20260709 13:07:46.721415 12801 rpcz_store.cc:269] 0709 13:07:45.562179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.569394 (+  7215us) service_pool.cc:224] Handling call
0709 13:07:46.720385 (+1150991us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400175cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:46.720574 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543763200}
W20260709 13:07:46.724009 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.724521 15932 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:46.710356 15892 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.002s
I20260709 13:07:46.725142 15892 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:46.727170 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 185670us
I20260709 13:07:46.729435 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.730125 12801 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.733464 12874 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:46.734527 12875 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:07:46.735036 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.730070 12726 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 3.
I20260709 13:07:46.735703 12729 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:46.737564 12808 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:46.738051 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.738834 12729 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.739924 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.740571 12732 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:46.743624 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.745272 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.747676 12874 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:46.747996 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.741477 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.747862 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:46.749033 12730 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:46.740739 12724 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:46.749712 15905 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:46.750121 15905 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:46.750533 15905 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.743055 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:46.721868 15882 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:46.752344 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.754246 15931 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.755193 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:46.754671 15931 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.756656 15931 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.755820 12726 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:46.758863 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.754528 15882 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:46.762089 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:46.762144 15867 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:46.763819 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:46.765059 15959 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:07:46.752209 15796 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.774852 12729 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:46.781960 15642 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.768237 15544 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.789006 15544 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:46.761125 15922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.022s	sys 0.026s
W20260709 13:07:46.791039 15922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.022s	sys 0.027s
I20260709 13:07:46.798337 15642 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.803747 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:46.804236 15969 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.566s	user 0.004s	sys 0.000s
I20260709 13:07:46.804651 13519 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:46.770359 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:46.795770 15544 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.818657 15846 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.824731 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:46.837337 15642 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.840809 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:46.839157 15789 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.832213 15846 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.865777 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1974) took 1325 ms. Trace:
I20260709 13:07:46.868235 12808 rpcz_store.cc:276] 0709 13:07:45.540369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.749229 (+1208860us) service_pool.cc:224] Handling call
0709 13:07:46.749550 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.749753 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:46.750062 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.865225 (+115163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.865306 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.865383 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.865486 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.865687 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1109,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":113878,"threads_started":1}
I20260709 13:07:46.848861 15796 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:46.882072 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.885771 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1129) took 1337 ms. Trace:
I20260709 13:07:46.839185 15977 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:46.859325 15911 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:46.888356 12808 rpcz_store.cc:276] 0709 13:07:45.553963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.873031 (+1319068us) service_pool.cc:224] Handling call
0709 13:07:46.873506 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.873767 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.873795 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.873839 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:46.873901 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.874001 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.885651 (+ 11650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.885097 15796 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:46.928727 15967 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.878764 15846 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:46.952272 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1775) took 2232 ms. Trace:
I20260709 13:07:46.952908 12877 rpcz_store.cc:276] 0709 13:07:44.719776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.719903 (+   127us) service_pool.cc:224] Handling call
0709 13:07:44.729603 (+  9700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.448750 (+719147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.951951 (+1503201us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540006c2d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:46.952208 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645538048}
W20260709 13:07:47.029376 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.899886 15911 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:47.044910 15938 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:47.047756 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.046151 12731 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: [9.3-9.3]
I20260709 13:07:46.927374 15789 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:47.092365 15967 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:46.933115 15796 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.158815 12732 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:47.759797 12771 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.013s
W20260709 13:07:47.763335 12771 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.002s	sys 0.013s
W20260709 13:07:47.763877 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 607034us
W20260709 13:07:47.320590 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.718825 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.218382 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:47.767869 12808 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:47.540349 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.406519 15996 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:07:47.155017 15883 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
W20260709 13:07:47.680114 15905 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.004s
W20260709 13:07:47.639187 15614 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.917s	user 0.013s	sys 0.000s
W20260709 13:07:47.721805 15931 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.965s	user 0.007s	sys 0.008s
W20260709 13:07:47.269095 15928 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.003s
W20260709 13:07:47.440430 15893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.012s	sys 0.027s
I20260709 13:07:47.899873 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:47.783082 15744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.036s	sys 0.054s
I20260709 13:07:47.312003 15977 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.736152 15933 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.100816 15921 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.089502 15894 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:47.884414 15995 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:07:47.093037 15938 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:47.363757 15838 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:47.907949 12880 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.890116 15967 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:47.909991 15893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.013s	sys 0.031s
I20260709 13:07:47.920866 15977 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:47.910894 15744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.037s	sys 0.054s
I20260709 13:07:47.934136 15846 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:47.923406 15894 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:47.906226 15614 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:47.933166 15576 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:47.954749 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 227) took 1163 ms. Trace:
I20260709 13:07:47.906431 15905 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.905715 15883 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:47.955132 12874 rpcz_store.cc:276] 0709 13:07:46.791478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.791711 (+   233us) service_pool.cc:224] Handling call
0709 13:07:46.792210 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.792785 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.792827 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.794537 (+  1710us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.879853 (+ 85316us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.879893 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.879964 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.954518 (+1074554us) raft_consensus.cc:1685] finished
0709 13:07:47.954539 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.954684 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7998,"thread_start_us":59111,"threads_started":1,"wal-append.queue_time_us":238506}
I20260709 13:07:47.943076 15911 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:47.923872 15933 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.940729 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 1991) took 1282 ms. Trace:
I20260709 13:07:47.963266 12880 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:47.963830 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 229) took 1035 ms. Trace:
I20260709 13:07:47.963519 12875 rpcz_store.cc:276] 0709 13:07:46.658668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.658825 (+   157us) service_pool.cc:224] Handling call
0709 13:07:46.734137 (+ 75312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:46.735071 (+   934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.940523 (+1205452us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b540006ccd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:47.940670 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172240256}
I20260709 13:07:47.914072 15928 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.964290 12880 rpcz_store.cc:276] 0709 13:07:46.928562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.931601 (+  3039us) service_pool.cc:224] Handling call
0709 13:07:47.963773 (+1032172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.945243 15838 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.972631 12873 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.956318 15846 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:47.951577 12808 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:47.914299 15931 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.977087 12805 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:47.968494 15911 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.946381 15967 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:47.988324 12804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1143) took 1598 ms (client timeout 1563 ms). Trace:
I20260709 13:07:47.933841 15921 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:47.988819 12804 rpcz_store.cc:269] 0709 13:07:46.389681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.423323 (+ 33642us) service_pool.cc:224] Handling call
0709 13:07:47.982546 (+1559223us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54003994d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:47.988243 (+  5697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64413440}
I20260709 13:07:47.995246 12804 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.996342 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1133) took 2432 ms. Trace:
I20260709 13:07:47.996851 12804 rpcz_store.cc:276] 0709 13:07:45.563707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.994571 (+2430864us) service_pool.cc:224] Handling call
0709 13:07:47.995009 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.995964 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.996266 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.002525 12804 pending_rounds.cc:85] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 4
I20260709 13:07:48.003618 12804 pending_rounds.cc:107] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:48.003976 12804 raft_consensus.cc:2889] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.988988 15911 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:47.975878 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60724 (request call id 239) took 1048 ms. Trace:
I20260709 13:07:48.012465 12808 rpcz_store.cc:276] 0709 13:07:46.927604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.084785 (+157181us) service_pool.cc:224] Handling call
0709 13:07:47.975811 (+891026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.978837 15846 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.042276 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1966) took 2648 ms. Trace:
I20260709 13:07:48.034054 15911 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.042738 12807 rpcz_store.cc:276] 0709 13:07:45.393502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.959873 (+566371us) service_pool.cc:224] Handling call
0709 13:07:45.960247 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.176824 (+216577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.041970 (+1865146us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001b6054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:48.042204 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496482688}
I20260709 13:07:48.047744 12807 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.048774 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1137) took 2367 ms. Trace:
I20260709 13:07:48.049124 12807 rpcz_store.cc:276] 0709 13:07:45.681137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.047078 (+2365941us) service_pool.cc:224] Handling call
0709 13:07:48.047429 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.048517 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.048717 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.004914 15894 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.050593 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 233) took 2294 ms. Trace:
I20260709 13:07:48.047663 15496 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.051568 16002 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.051749 15496 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.052307 16002 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:48.053506 12806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 1979) took 1633 ms (client timeout 2147 ms). Trace:
I20260709 13:07:48.054029 15496 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:48.053906 12806 rpcz_store.cc:269] 0709 13:07:46.420435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.625523 (+205088us) service_pool.cc:224] Handling call
0709 13:07:48.053336 (+1427813us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54001761d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:48.053447 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49224576}
I20260709 13:07:48.054631 16002 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.055295 12806 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.051015 12807 rpcz_store.cc:276] 0709 13:07:45.755861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.049907 (+2294046us) service_pool.cc:224] Handling call
0709 13:07:48.050207 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.050385 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.050400 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.050427 (+    27us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.050448 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.050481 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.050556 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.058262 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 235) took 2118 ms. Trace:
I20260709 13:07:48.055960 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 234) took 2185 ms. Trace:
I20260709 13:07:48.058983 12806 rpcz_store.cc:276] 0709 13:07:45.870399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.054828 (+2184429us) service_pool.cc:224] Handling call
0709 13:07:48.055119 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.055734 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.055913 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.058826 12807 rpcz_store.cc:276] 0709 13:07:45.939883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.057422 (+2117539us) service_pool.cc:224] Handling call
0709 13:07:48.057693 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.057859 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.057885 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.057930 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.057978 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.058056 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.058194 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.039384 15913 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.066046 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1139) took 1677 ms. Trace:
I20260709 13:07:48.066674 12806 rpcz_store.cc:276] 0709 13:07:46.388779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.065037 (+1676258us) service_pool.cc:224] Handling call
0709 13:07:48.065380 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.065592 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.065630 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.065689 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:48.065736 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.065811 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.065965 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.065385 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1141) took 1676 ms. Trace:
I20260709 13:07:48.073670 12807 rpcz_store.cc:276] 0709 13:07:46.389244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.064748 (+1675504us) service_pool.cc:224] Handling call
0709 13:07:48.065020 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.065157 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.065172 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.065198 (+    26us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:48.065221 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.065254 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.065339 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.069166 15862 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:48.071904 15913 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.076732 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 236) took 1649 ms. Trace:
I20260709 13:07:48.076539 15862 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:48.077128 12807 rpcz_store.cc:276] 0709 13:07:46.426983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.075479 (+1648496us) service_pool.cc:224] Handling call
0709 13:07:48.075975 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.076432 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.076457 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.076496 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.076524 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.076576 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.076681 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.078477 15913 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.078758 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1144) took 1646 ms. Trace:
I20260709 13:07:48.079274 15862 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.079209 12807 rpcz_store.cc:276] 0709 13:07:46.431893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.077998 (+1646105us) service_pool.cc:224] Handling call
0709 13:07:48.078300 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.078475 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.078499 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.078537 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:48.078569 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.078618 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.078708 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.082131 12807 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.082923 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1145) took 1623 ms. Trace:
I20260709 13:07:48.083248 12807 rpcz_store.cc:276] 0709 13:07:46.459694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.080327 (+1620633us) service_pool.cc:224] Handling call
0709 13:07:48.080556 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.082695 (+  2139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.082873 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.083806 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:48.084764 12807 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 11. Ops: []
I20260709 13:07:48.085269 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1147) took 1586 ms. Trace:
I20260709 13:07:48.085502 12807 rpcz_store.cc:276] 0709 13:07:46.499079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.084280 (+1585201us) service_pool.cc:224] Handling call
0709 13:07:48.084592 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.085112 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.085234 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.063211 15977 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.079883 15992 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 13:07:48.074250 15894 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:48.088946 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:48.090123 12807 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:48.075043 15905 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.089752 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.091084 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 240) took 1123 ms. Trace:
I20260709 13:07:48.075296 15614 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:07:48.092729 12807 rpcz_store.cc:276] 0709 13:07:46.967911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.089592 (+1121681us) service_pool.cc:224] Handling call
0709 13:07:48.089830 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.090558 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.091031 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.093254 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.095239 15576 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:48.083829 15921 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:48.090699 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.095836 15576 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.095227 16001 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:48.085922 15862 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.092295 15977 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.100927 16001 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.107322 16003 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.107414 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:48.108078 16003 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.091961 15838 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.114501 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1970) took 2658 ms. Trace:
I20260709 13:07:48.114923 12803 rpcz_store.cc:276] 0709 13:07:45.456453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.144284 (+687831us) service_pool.cc:224] Handling call
0709 13:07:46.144862 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.543545 (+398683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.114207 (+1570662us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002b34d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:48.114440 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816950656}
I20260709 13:07:48.112586 15977 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.119120 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.104923 15967 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.119886 15962 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:48.120492 15962 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:48.121039 15977 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.119956 12733 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:48.105130 15931 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.105940 15862 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:48.172848 15933 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.173363 13518 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:48.174026 15846 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.174669 15883 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:48.112020 13512 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:48.184896 13519 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:48.108703 15796 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:48.199560 12847 leader_election.cc:336] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.509s (SENT)
I20260709 13:07:48.217950 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:48.219391 15576 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.221393 15796 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.222522 15862 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.419703 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.326547 15846 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.326236 15796 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:48.371397 15915 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.455752 13484 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.028s (SENT)
I20260709 13:07:48.214136 15883 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.403133 15637 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.401914 15931 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.481602 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.489600 15862 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.497839 12732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1728) took 1716 ms (client timeout 2107 ms). Trace:
W20260709 13:07:48.507318 12732 rpcz_store.cc:269] 0709 13:07:46.739842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.742739 (+  2897us) service_pool.cc:224] Handling call
0709 13:07:48.455869 (+1713130us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540038fc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:48.456084 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675668736}
I20260709 13:07:48.452482 15977 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:48.223608 15933 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.276s
I20260709 13:07:48.516245 16003 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.517653 16001 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.518721 15977 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.520166 15862 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:48.523442 15862 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.526134 15967 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.466948 15846 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.408972 15962 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.504676 15915 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.497548 15796 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:48.513687 15931 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.511674 15637 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.586539 15796 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:48.589434 15637 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.578758 15962 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.597641 15846 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.598213 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.578150 15967 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.514340 15883 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.604264 15967 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.607600 15967 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.608798 15977 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.612501 15931 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.613961 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.330171 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.629524 15893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.049s	sys 0.077s
W20260709 13:07:48.651198 15893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.050s	sys 0.078s
I20260709 13:07:48.657637 15588 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.652740 12806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.011s
W20260709 13:07:48.659614 12806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.004s	sys 0.011s
W20260709 13:07:48.654781 12808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.009s
W20260709 13:07:48.660715 12805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1138) took 2272 ms (client timeout 2303 ms). Trace:
W20260709 13:07:48.661254 12805 rpcz_store.cc:269] 0709 13:07:46.388459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.669212 (+280753us) service_pool.cc:224] Handling call
0709 13:07:48.660470 (+1991258us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400033c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:48.660650 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2998412544}
I20260709 13:07:48.663523 15928 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.672737 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.674299 13513 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:07:48.675190 15882 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.675803 15882 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.677333 12805 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:48.677264 15915 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.679019 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1715) took 2395 ms. Trace:
I20260709 13:07:48.679325 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:48.679486 12731 rpcz_store.cc:276] 0709 13:07:46.283892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.454171 (+170279us) service_pool.cc:224] Handling call
0709 13:07:46.454659 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.086964 (+632305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.678732 (+1591768us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400245c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:48.678924 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359937408}
W20260709 13:07:48.680761 15894 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:07:48.681164 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:48.682188 15994 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.014s	sys 0.022s
W20260709 13:07:48.682636 15994 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.014s	sys 0.022s
I20260709 13:07:48.683539 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.684274 12803 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:48.685796 12803 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:48.689224 12805 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:48.690308 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.690994 12803 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
W20260709 13:07:48.660750 12808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.007s	sys 0.009s
W20260709 13:07:48.692086 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 146022us
I20260709 13:07:48.693346 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.694574 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.695231 12805 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
W20260709 13:07:48.695408 12804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.021s
W20260709 13:07:48.695895 12804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.015s	sys 0.021s
I20260709 13:07:48.696662 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1134) took 3016 ms. Trace:
I20260709 13:07:48.697423 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.698060 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:48.699112 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:48.699787 12807 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:48.692096 15882 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:48.701340 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.018s	sys 0.019s
W20260709 13:07:48.700647 12699 connection.cc:256] RPC call timeout handler was delayed by -1.4749039979999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2379s for a response
W20260709 13:07:48.702550 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.018s	sys 0.019s
W20260709 13:07:48.702771 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 221324us
W20260709 13:07:48.701282 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.703616 12848 connection.cc:256] RPC call timeout handler was delayed by -1.8505986199999143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:07:48.704393 12848 connection.cc:256] RPC call timeout handler was delayed by -1.7938986199999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:07:48.703469 12804 rpcz_store.cc:276] 0709 13:07:45.680264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.001643 (+2321379us) service_pool.cc:224] Handling call
0709 13:07:48.002225 (+   582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.010774 (+  8549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.010827 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.011533 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.696290 (+684757us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:48.696331 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.696399 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.696440 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:48.696451 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.696605 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":663873,"threads_started":1,"wal-append.queue_time_us":662356}
I20260709 13:07:48.699792 12803 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:48.708674 13516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 250) took 2386 ms (client timeout 2147 ms). Trace:
W20260709 13:07:48.709116 13516 rpcz_store.cc:269] 0709 13:07:46.295980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.296660 (+   680us) service_pool.cc:224] Handling call
0709 13:07:48.681023 (+2384363us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:48.681871 (+   848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4931840}
I20260709 13:07:48.711828 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:48.712756 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 495516us
I20260709 13:07:48.712982 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:48.713454 13486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.020s
I20260709 13:07:48.713840 12803 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
W20260709 13:07:48.714166 13486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.021s
W20260709 13:07:48.715234 12847 leader_election.cc:336] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.606s (SENT)
I20260709 13:07:48.718530 15893 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:48.715727 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 624605us
I20260709 13:07:48.718976 15893 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:48.722968 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.723580 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.722424 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.725031 12731 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:48.716589 15891 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.735864 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.736371 15891 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.728097 16017 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:48.723840 15967 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.738725 15891 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.716861 16018 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.702246 15576 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:48.733135 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.734366 16024 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:48.735433 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:48.756166 12881 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:48.739121 15967 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.725631 15588 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:48.743726 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:48.743999 15893 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.745152 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:48.747433 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.775144 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.757655 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:48.776932 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.758540 15928 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.761309 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.729429 16010 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.772837 12875 raft_consensus.cc:2376] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
I20260709 13:07:48.777573 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:48.778578 12732 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10. Re-sending same reply.
I20260709 13:07:48.779297 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.780229 12729 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:48.780333 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.746362 15891 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.782449 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.786243 12729 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:48.784577 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:48.789265 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 75652.8us
I20260709 13:07:48.789726 12729 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.790105 12696 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.756409 15642 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.791713 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:48.797492 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:48.798125 12732 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.792071 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:48.798627 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.793316 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:48.793560 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.794059 12727 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.802210 12729 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:48.794248 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.756482 15894 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.803954 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.804766 12731 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:48.806105 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.806739 12727 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:48.808514 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:48.809125 12733 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.803107 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:48.813272 12728 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.785632 15846 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.783494 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.813300 12729 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.818104 15862 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:48.818430 15883 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:48.790612 15796 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.794845 15588 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:48.774924 15576 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:48.821250 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:48.822723 12725 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:07:48.795475 15893 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.837340 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1112) took 4378 ms. Trace:
I20260709 13:07:48.808959 15928 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.843562 12799 rpcz_store.cc:276] 0709 13:07:44.449910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.541300 (+ 91390us) service_pool.cc:224] Handling call
0709 13:07:44.599962 (+ 58662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.752822 (+152860us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:46.383385 (+1630563us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b18003c7000. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c0d0bf
0709 13:07:46.383540 (+   155us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.465580 (+ 82040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.465641 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.465699 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.989441 (+1523742us) spinlock_profiling.cc:243] Waited 952 us on lock 0x7b18003c7000. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ead42a6 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419
0709 13:07:48.828387 (+838946us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001748d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:48.828446 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.828600 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12930,"prepare.queue_time_us":53715,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":120,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2321,"spinlock_wait_cycles":370211072,"thread_start_us":139772,"threads_started":2,"wal-append.queue_time_us":188574,"wal-append.run_cpu_time_us":1518,"wal-append.run_wall_time_us":1060944}
I20260709 13:07:48.787256 16010 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.809841 15642 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.826526 16008 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.826314 15933 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.825686 15210 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.842221 15576 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:48.815034 15637 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.774590 15967 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.757839 16018 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.811520 16017 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:48.856648 16026 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:48.795892 15891 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.855405 13517 raft_consensus.cc:2376] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8. Re-sending same reply.
I20260709 13:07:48.945354 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.947937 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.928822 16017 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:48.950178 12730 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:48.948695 12728 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:48.880273 16027 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:48.953779 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1968) took 3527 ms. Trace:
I20260709 13:07:48.954300 12800 rpcz_store.cc:276] 0709 13:07:45.426336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.138129 (+711793us) service_pool.cc:224] Handling call
0709 13:07:46.668135 (+530006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.678777 (+ 10642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.953569 (+2274792us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54001757d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:48.953719 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217978112}
W20260709 13:07:48.960438 16025 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:07:48.962359 16018 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:48.964901 16013 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:48.966712 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1135) took 3286 ms. Trace:
I20260709 13:07:48.967144 12808 rpcz_store.cc:276] 0709 13:07:45.680574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.014631 (+2334057us) service_pool.cc:224] Handling call
0709 13:07:48.015138 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.015620 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.015665 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.031930 (+ 16265us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.692167 (+660237us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.692213 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.692302 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.966475 (+274173us) raft_consensus.cc:1685] finished
0709 13:07:48.966496 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.966638 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35852,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10063,"thread_start_us":636386,"threads_started":1,"wal-append.queue_time_us":740851}
I20260709 13:07:48.974133 15891 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:48.934685 16026 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:48.984535 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 223367us
I20260709 13:07:48.989066 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.881023 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.992784 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:48.836756 15588 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:48.811064 15894 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:48.846886 15928 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.913863 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1971) took 3404 ms. Trace:
I20260709 13:07:49.008241 12802 rpcz_store.cc:276] 0709 13:07:45.482377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.705986 (+1223609us) service_pool.cc:224] Handling call
0709 13:07:46.720555 (+ 14569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.726116 (+  5561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.886637 (+2160521us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5400175cd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:48.886787 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32784640}
I20260709 13:07:48.912803 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1972) took 3380 ms. Trace:
W20260709 13:07:48.916550 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.928539 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:48.931586 12847 leader_election.cc:336] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.097s (SENT)
I20260709 13:07:49.012288 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.010272 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:49.012710 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81164us
W20260709 13:07:49.013808 12847 leader_election.cc:336] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.127s (SENT)
I20260709 13:07:49.014406 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:48.879012 15846 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:49.009871 12801 rpcz_store.cc:276] 0709 13:07:45.501471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.722314 (+1220843us) service_pool.cc:224] Handling call
0709 13:07:46.726156 (+  3842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.730739 (+  4583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.881935 (+2151196us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b54003999d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:48.882205 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8486784}
I20260709 13:07:48.884809 15210 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.018114 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.018903 12731 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:48.994191 12728 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:49.025663 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.028879 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.029748 12725 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:49.029991 12728 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:49.030920 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:48.878590 12729 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:48.878090 12732 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:48.913237 15637 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:48.974136 15993 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.876s	user 0.012s	sys 0.022s
W20260709 13:07:49.027143 12847 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.217s (SENT)
W20260709 13:07:49.032874 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.994622 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:49.032737 12725 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
W20260709 13:07:49.036182 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 47845.4us
I20260709 13:07:49.038836 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.012421 15928 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.041097 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.044363 15642 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.043620 15210 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.042493 12728 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:49.071715 12728 pending_rounds.cc:85] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 4
I20260709 13:07:49.052016 15846 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.008423 16017 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.024703 16003 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.057318 15894 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:49.059749 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.059963 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:49.061179 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:48.880110 15933 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.051481 12733 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:49.071974 12728 pending_rounds.cc:107] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:49.086374 12728 raft_consensus.cc:2889] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:49.072543 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 321824us
I20260709 13:07:49.086956 12731 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:49.071820 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 279857us
I20260709 13:07:48.876251 16008 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.051465 16010 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.096437 15862 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.097003 15862 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:49.088796 15576 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.097944 15862 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.101915 15933 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.068233 16032 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.105033 16032 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:49.106420 16032 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.107257 15928 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.093066 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.111016 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.088416 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.111732 12728 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:49.113417 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.092466 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.116063 12732 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:49.111196 12731 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:49.094630 12733 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:49.115046 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.099750 15967 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:49.124639 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 112422us
I20260709 13:07:49.128185 15967 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:49.124714 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 252) took 2579 ms. Trace:
I20260709 13:07:49.125671 16033 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.122941 16034 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:49.129084 16008 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.121258 16023 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.130745 16033 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.132566 16033 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.042299 15588 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.131840 15967 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.136572 15967 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:49.136694 15588 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.137399 15967 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.139320 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.140270 12733 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:49.141207 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.142066 12732 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:49.142081 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.092540 15637 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.144155 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.144865 12727 raft_consensus.cc:2376] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8. Re-sending same reply.
I20260709 13:07:49.148806 12699 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.150425 15891 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.151259 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.152395 15891 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:49.152937 15891 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:49.153990 15891 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.159893 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:49.160512 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.161177 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.161607 15976 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.163417 15976 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.163590 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.164660 15637 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.165119 15637 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:49.130635 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.166464 15637 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.166934 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:49.175232 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.129547 13520 rpcz_store.cc:276] 0709 13:07:46.544826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.545104 (+   278us) service_pool.cc:224] Handling call
0709 13:07:48.778873 (+2233769us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:48.779128 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.779430 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:48.837999 (+ 58569us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.124194 (+286195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.124276 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:49.124348 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.124445 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.124595 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2128,"prepare.queue_time_us":89163,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":31921,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":40434560,"thread_start_us":323862,"threads_started":3,"wal-append.queue_time_us":289773}
W20260709 13:07:49.179078 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91654.8us
W20260709 13:07:49.226356 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46591.9us
I20260709 13:07:49.236474 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.138698 15967 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.237375 12881 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:49.247025 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.248023 12881 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:49.237920 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.238432 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.235877 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.168334 15637 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.253230 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:49.255313 13520 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.253618 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.179255 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:49.258383 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.147s (SENT) [suppressed 40 similar messages]
I20260709 13:07:49.226080 16023 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.259884 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.260699 12878 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.257066 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.261813 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.169080 15928 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:49.169548 15588 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.274937 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.279323 15929 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:49.234069 16018 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.236652 16027 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:49.283974 16018 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:49.284662 16018 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.233146 16034 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:49.262181 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.236151 16001 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.258989 16023 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:07:49.291006 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.278574 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.167888 15681 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:07:49.294341 12876 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:49.301436 12878 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:49.311483 13520 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:49.272279 15891 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.314584 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.283987 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:49.324060 12847 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:49.306284 16023 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.290403 15890 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:49.313484 15588 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:49.334174 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.317680 15891 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.325299 15933 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.305210 16001 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.331887 16003 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.365521 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:49.366608 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0099978389999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 13:07:49.356010 15929 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.377925 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:49.363085 15933 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.382025 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.368115 15744 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.386296 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.368616 16003 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.357555 15588 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.384768 15882 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:49.432440 15882 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.432847 15882 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.438599 15588 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.413079 15898 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.452589 15898 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.385715 15933 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.389546 15744 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.483762 15744 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.402390 16003 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.473743 16001 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:49.485668 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.505935 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.556320 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.453063 15898 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.571506 15928 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:49.569808 16044 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:07:49.524335 15210 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.588163 15891 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.595402 16047 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.596068 16047 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.596895 15882 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.598363 16047 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.599732 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 224) took 2921 ms. Trace:
I20260709 13:07:49.600194 12873 rpcz_store.cc:276] 0709 13:07:46.678737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.688385 (+  9648us) service_pool.cc:224] Handling call
0709 13:07:46.688770 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.974556 (+1285786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.599484 (+1624928us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003b9554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:49.599663 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952362240}
I20260709 13:07:49.604357 15210 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.597457 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.605785 12724 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:49.606596 15210 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.527061 16033 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:49.608175 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 230378us
W20260709 13:07:49.608239 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 222026us
I20260709 13:07:49.617267 16033 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.617584 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:49.618857 16003 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.619835 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.620826 12730 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:49.621394 16003 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.622159 15882 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.622329 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.623188 12724 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:49.624120 15929 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:49.625166 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.625517 16017 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.625833 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.619880 16027 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.626834 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.623078 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.572263 15846 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:49.623615 15882 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:49.628216 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.627094 12733 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.629379 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.637765 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.637949 12728 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:49.626477 12732 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:49.632347 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:49.627136 16027 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:49.633577 16047 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:49.635664 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.635550 15681 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:49.572218 15928 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.630136 15210 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.643759 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.574246 16018 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.644223 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.650449 12724 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:49.651928 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.652249 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.652746 12725 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.652884 12729 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:49.643399 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.642902 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.648092 12728 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:49.653846 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.654204 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.644021 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.654428 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.654385 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.655618 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.655041 12730 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:49.656252 12732 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:49.654980 12724 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:49.657025 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.636600 15929 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.630733 16054 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:49.640321 15999 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.647070 15967 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.640118 15962 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.665439 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.662151 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.649049 15210 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.670553 15210 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.623934 15933 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.646642 15681 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:49.676088 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 417719us
I20260709 13:07:49.644352 15890 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:49.638890 15846 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.663877 16032 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.664294 15929 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.669203 12727 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.667596 15999 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:49.669991 15967 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.668689 15962 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.650234 16047 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.693032 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.693946 12732 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:49.697901 12726 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:49.688961 15967 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.706557 15928 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.707110 15928 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:49.705348 15933 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.683777 16032 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.707580 15928 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.682825 16023 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.691687 16027 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.714426 15928 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:49.717523 12725 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:07:49.719834 16047 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:49.720023 15960 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:49.720461 15960 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:49.721385 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.686563 15999 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.683344 15929 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.735020 15210 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.740705 12731 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:49.688650 15962 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.738154 15898 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.736214 15681 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.748153 12732 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:49.749105 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.756556 15891 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:49.756992 16018 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:49.760285 16017 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.758849 15210 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:49.759528 16023 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.762125 16048 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.762218 16023 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:49.758255 16056 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:49.764670 16056 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:49.765403 15898 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:49.766484 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.762674 16048 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:49.770809 13518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 280) took 1681 ms (client timeout 1804 ms). Trace:
I20260709 13:07:49.761307 15681 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:49.771339 13518 rpcz_store.cc:269] 0709 13:07:48.089192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.089358 (+   166us) service_pool.cc:224] Handling call
0709 13:07:49.770543 (+1681185us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b5400770454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:49.770686 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182621568}
I20260709 13:07:49.749224 15960 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.777541 15960 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.725199 16032 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.771555 16048 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.779309 16048 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.783447 13518 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.786204 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.787190 12726 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:49.760491 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:49.789337 16001 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.789800 16001 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:49.790934 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.790813 16001 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.791769 12728 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:49.793259 15928 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:49.794512 15642 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.794786 12728 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:49.757846 15846 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.797407 16001 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.797878 15642 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:49.798964 15642 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.800343 15642 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.815855 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.765450 16056 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:49.807541 16026 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.823211 16026 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.787242 15744 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:49.843568 16045 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.484s	user 0.003s	sys 0.013s
I20260709 13:07:49.844342 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:49.847000 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.848241 12773 connection.cc:256] RPC call timeout handler was delayed by -1.5785266670000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:07:49.849818 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 210601us
I20260709 13:07:49.851032 12732 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:49.849941 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2244873610000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 13:07:49.853178 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2084355969999478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:07:49.853518 12773 connection.cc:256] RPC call timeout handler was delayed by -1.2007032469999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:07:49.853791 12773 connection.cc:256] RPC call timeout handler was delayed by -1.1413666429999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:07:49.854069 12773 connection.cc:256] RPC call timeout handler was delayed by -1.0531032469999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:07:49.852305 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:49.864988 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.863087 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:49.865383 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.849452 16000 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:49.868309 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 129137us
I20260709 13:07:49.868619 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 1983) took 3447 ms. Trace:
I20260709 13:07:49.870184 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:49.870458 12806 rpcz_store.cc:276] 0709 13:07:46.421405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.068101 (+1646696us) service_pool.cc:224] Handling call
0709 13:07:48.068543 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.068804 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:48.660002 (+591198us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.764341 (+1104339us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b1800081040. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:07:49.783836 (+ 19495us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800081040. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a
0709 13:07:49.867774 (+ 83938us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.868127 (+   353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.868186 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.868238 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.868402 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.868552 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":662519,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4762,"raft.queue_time_us":8955,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":50431488,"thread_start_us":730405,"threads_started":3,"wal-append.queue_time_us":72788}
I20260709 13:07:49.851022 16032 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.873170 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.894665 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.899991 12728 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.900202 12729 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.903636 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.904593 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.905309 12882 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:49.905719 12878 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: [9.3-9.3]
I20260709 13:07:49.873566 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:49.907655 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:49.907827 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:49.908377 12726 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:49.909466 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:49.909878 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.910358 12726 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.909494 12882 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.903852 12873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:49.915012 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:49.919027 12729 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:49.866329 15890 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.927428 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.928382 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.932425 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:49.933131 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.932765 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.872751 15933 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.934435 12878 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:49.882575 16058 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.892711 16027 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.946781 16027 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:49.927779 15210 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:49.947526 15210 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.947659 16027 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.950256 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.936689 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.874444 15931 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:49.863718 15846 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:49.939757 12876 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:49.921265 15913 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:49.907097 15976 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:49.921697 15928 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:49.945441 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.897200 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 286) took 1150 ms. Trace:
I20260709 13:07:49.938390 15789 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:49.928047 16003 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.980996 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.866148 15898 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:07:49.912365 15637 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:49.955921 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:49.963353 12728 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:49.968627 15890 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:49.989096 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.962813 16059 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.888477 16000 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.887290 16018 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:49.975126 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.850298 16056 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:49.979943 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.937271 15933 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.914577 16032 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:49.983697 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 75950.2us
I20260709 13:07:49.985685 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:49.987192 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:49.987025 15962 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.976213 15931 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:49.969973 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.970806 15862 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:49.956792 16058 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:49.976689 15976 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:50.147338 16059 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.518846 16059 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:50.521776 16059 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:50.132700 16070 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:50.545624 16070 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:50.543967 16058 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:50.546797 16070 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.548324 16070 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.566061 16056 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.649966 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:50.650674 12875 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.258591 12882 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:50.654359 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:50.655405 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:50.657354 12875 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:50.658591 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:50.659242 12875 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:50.431290 15967 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.000s
I20260709 13:07:50.660302 12875 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:50.660758 15967 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.662019 12733 raft_consensus.cc:2368] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:50.662079 12875 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:50.663213 15967 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:50.710595 16026 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.887s	user 0.013s	sys 0.001s
I20260709 13:07:49.989802 15637 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:50.819453 15637 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:50.845264 12730 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:50.847551 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1748) took 1194 ms. Trace:
I20260709 13:07:50.848088 12730 rpcz_store.cc:276] 0709 13:07:49.652883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.656368 (+  3485us) service_pool.cc:224] Handling call
0709 13:07:50.847191 (+1190823us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540030a054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:50.847417 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706270592}
W20260709 13:07:50.868115 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.871340 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.892688 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.893958 16075 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.895133 16075 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.898438 16073 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:50.898422 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.899375 16075 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:50.899907 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.899689 16073 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.904140 16073 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:50.044452 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.921762 13487 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.013s	sys 0.016s
W20260709 13:07:50.922247 13487 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.013s	sys 0.016s
W20260709 13:07:50.922708 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 995039us
I20260709 13:07:50.962735 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:50.964102 16073 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:50.965150 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.967352 16073 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.968247 16073 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.970709 12728 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.988538 16073 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:49.996722 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.026149 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.028144 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.028825 16073 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.029431 16073 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.029899 16073 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.030611 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:51.035571 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.045819 12875 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:51.050354 16075 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.050670 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.051098 16075 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.051563 16075 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.052338 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:51.052568 12726 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.141s	user 0.021s	sys 0.009s
I20260709 13:07:51.053195 12726 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:51.053218 12875 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:51.053453 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:51.054116 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1177) took 1157 ms (client timeout 1530 ms). Trace:
I20260709 13:07:51.055532 16070 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.056085 16070 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.056510 16070 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.054653 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.058097 12731 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:51.054656 12726 rpcz_store.cc:269] 0709 13:07:49.896447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.909172 (+ 12725us) service_pool.cc:224] Handling call
0709 13:07:51.054034 (+1144862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.063876 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.064860 12726 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:07:51.055546 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.068150 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:51.069151 16072 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.071439 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.072302 12728 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:51.081244 16073 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.086824 13487 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.618s (SENT)
W20260709 13:07:51.099491 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44289.3us
I20260709 13:07:51.303303 12726 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:51.340606 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 253972us
I20260709 13:07:51.342602 16042 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.343549 16042 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:51.347182 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.347659 16042 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.365612 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1180) took 1465 ms. Trace:
W20260709 13:07:51.391516 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 368308us
I20260709 13:07:51.357811 16073 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.393424 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 322321us
I20260709 13:07:51.391562 12728 rpcz_store.cc:276] 0709 13:07:49.899677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.985353 (+ 85676us) service_pool.cc:224] Handling call
0709 13:07:51.354305 (+1368952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.110576 16072 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.402678 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 358) took 2161 ms. Trace:
I20260709 13:07:51.402812 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.403357 12727 rpcz_store.cc:276] 0709 13:07:49.240753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.240920 (+   167us) service_pool.cc:224] Handling call
0709 13:07:49.259381 (+ 18461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.682032 (+422651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.388020 (+1705988us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540040f454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:51.402358 (+ 14338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942022016}
I20260709 13:07:51.404896 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.405500 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.405802 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.406908 12727 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:51.410956 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.412020 12728 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:51.416774 16073 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.417377 16073 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.417758 16073 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.418010 12726 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:51.421380 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1176) took 1525 ms. Trace:
I20260709 13:07:51.422601 16072 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.424607 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 365) took 1375 ms. Trace:
I20260709 13:07:51.425216 12727 rpcz_store.cc:276] 0709 13:07:50.049049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.423092 (+1374043us) service_pool.cc:224] Handling call
0709 13:07:51.423597 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.424149 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.424186 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.424242 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.424285 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.424356 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.424535 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.426932 16075 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.421934 12728 rpcz_store.cc:276] 0709 13:07:49.895876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.413011 (+1517135us) service_pool.cc:224] Handling call
0709 13:07:51.420438 (+  7427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.420903 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.420941 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.421030 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:51.421078 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.421155 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.421307 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.406040 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1834) took 1450 ms. Trace:
I20260709 13:07:51.433913 12878 rpcz_store.cc:276] 0709 13:07:49.955875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.986786 (+ 30911us) service_pool.cc:224] Handling call
0709 13:07:51.405927 (+1419141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.436882 16042 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:51.439178 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.439620 16042 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:49.975069 13512 rpcz_store.cc:276] 0709 13:07:48.746902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.748473 (+  1571us) service_pool.cc:224] Handling call
0709 13:07:49.844168 (+1095695us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:49.886851 (+ 42683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5966208}
I20260709 13:07:51.441457 12731 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:51.441309 12773 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:51.443236 12731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1179) took 1544 ms (client timeout 1825 ms). Trace:
W20260709 13:07:51.443759 12731 rpcz_store.cc:269] 0709 13:07:49.899132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.943294 (+ 44162us) service_pool.cc:224] Handling call
0709 13:07:51.443128 (+1499834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.447038 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.448828 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.450381 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.450583 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.453414 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.407011 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:51.460708 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 118554us
I20260709 13:07:51.473119 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.477021 12878 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
W20260709 13:07:50.004684 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.477056 15977 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.481047 15977 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.481477 15977 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.482457 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 126912us
I20260709 13:07:51.482987 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:51.483417 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.483832 12878 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.477730 16075 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.485831 16075 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.486990 16026 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.487895 16026 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:51.498432 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.501678 12878 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
W20260709 13:07:51.499790 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58666.4us
I20260709 13:07:51.453433 16070 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.506410 12875 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:51.507782 16070 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.509006 16070 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.509651 16070 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.520414 16026 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.520848 16042 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:50.031822 15999 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.530586 15999 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.531512 15999 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.532618 12881 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:51.535521 12662 debug-util.cc:398] Leaking SignalData structure 0x7b0800064c20 after lost signal to thread 11576
W20260709 13:07:51.536125 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080004d800 after lost signal to thread 11579
I20260709 13:07:51.538108 16000 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.539768 16073 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.542608 16073 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.515401 12771 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.522s (SENT)
I20260709 13:07:51.544101 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:51.547438 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.555648 15846 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.511217 16070 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.566926 12878 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.568919 15976 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.569766 16026 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.570590 16026 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.582341 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 175778us
I20260709 13:07:51.547353 15999 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:51.584435 12771 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.757s (SENT)
I20260709 13:07:51.589918 12878 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:51.591085 16088 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.591558 16026 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.592011 16088 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.593036 16026 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:51.593560 15681 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:51.594161 15681 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.594679 15681 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.595005 16088 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.595587 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.593747 16026 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:50.227571 15744 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.596100 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:51.602983 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.596511 13513 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:51.606936 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:51.599488 15999 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.615489 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.587193 15977 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.628326 15846 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.628906 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81671.8us
I20260709 13:07:51.629427 16083 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:51.630096 16083 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.630155 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.630600 16083 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:51.628425 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.634070 15846 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.634563 15846 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.634959 15846 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.635138 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:51.641022 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56626.3us
W20260709 13:07:51.642674 12771 leader_election.cc:336] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.783s (SENT)
I20260709 13:07:51.643249 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:51.598538 16026 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.645984 15977 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.624073 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.647737 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.631605 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.595717 16088 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:51.665846 16086 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.658872 16083 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.660470 16026 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.666219 16088 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.666594 16086 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.667052 16026 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.664124 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.646003 15846 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.661018 15931 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.683549 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52133.1us
W20260709 13:07:51.686203 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.686059 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.690893 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.697079 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.699258 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:51.704744 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62215.2us
I20260709 13:07:51.705405 15977 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.705974 15977 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:51.706399 15977 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:51.705624 12771 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.799s (SENT)
I20260709 13:07:51.708338 16026 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.708534 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:51.709354 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:51.710100 12771 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.804s (SENT)
I20260709 13:07:51.689704 16073 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.710898 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:51.710614 16000 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.711920 16073 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.701290 16086 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.710156 12729 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.716713 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.717751 12728 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:51.719148 12727 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:51.717717 12878 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:51.720196 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.721071 12875 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.987368 16003 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.723117 12882 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.727733 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.729508 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.726416 16086 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.740527 16086 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:50.516760 15933 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.743549 16086 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.731118 16018 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.744462 16018 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.744853 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1756) took 1951 ms. Trace:
I20260709 13:07:51.732234 16017 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.732751 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.737351 16083 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.739048 15681 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.714540 16088 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:50.041397 15890 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.745424 12732 rpcz_store.cc:276] 0709 13:07:49.793080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.795804 (+  2724us) service_pool.cc:224] Handling call
0709 13:07:49.796246 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.853168 (+ 56922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.744218 (+1891050us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54001ef354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:51.744597 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125522816}
I20260709 13:07:51.750916 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.752590 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.752967 16073 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.723824 16003 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.753556 16075 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.753528 16073 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.753688 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.749455 12729 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:51.755622 12882 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:07:51.754426 16073 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.759454 16042 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:51.759847 12878 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:51.760073 16017 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.760259 16042 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.760793 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.761528 12878 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:51.762243 16017 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.762857 12771 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.963s (SENT)
I20260709 13:07:51.752609 15681 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.753839 16000 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.762260 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:51.763999 12771 leader_election.cc:336] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.970s (SENT)
I20260709 13:07:51.768368 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:51.766345 16090 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.771435 16003 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.771633 16090 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.770568 16000 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.773005 16000 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.774258 16090 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.772200 16003 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.759788 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:51.783450 16017 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.777146 16003 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.787545 12882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1836) took 1809 ms (client timeout 2213 ms). Trace:
W20260709 13:07:51.790187 12882 rpcz_store.cc:269] 0709 13:07:49.978664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.655183 (+676519us) service_pool.cc:224] Handling call
0709 13:07:51.787339 (+1132156us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c94d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:51.787486 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453987200}
I20260709 13:07:51.788162 15681 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.791934 12878 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:51.802336 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.783694 16088 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.803206 12882 raft_consensus.cc:2376] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9. Re-sending same reply.
I20260709 13:07:51.803550 16088 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.804147 16017 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.806380 16088 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.806802 16017 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.807050 15960 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 2.029s	user 0.021s	sys 0.005s
I20260709 13:07:51.793253 15681 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:51.809854 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45936.4us
I20260709 13:07:51.824326 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.830298 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.823967 15681 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.838335 12875 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:51.844338 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:51.844584 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.845027 12732 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
W20260709 13:07:51.846318 12880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1825) took 1935 ms (client timeout 1970 ms). Trace:
W20260709 13:07:51.846731 12880 rpcz_store.cc:269] 0709 13:07:49.910831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.971652 (+ 60821us) service_pool.cc:224] Handling call
0709 13:07:51.846127 (+1874475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.829162 16018 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.848425 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.849408 12878 raft_consensus.cc:2410] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:51.829873 15637 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.851109 15637 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.824162 16088 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.852416 16088 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.855441 16088 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.855584 16039 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:51.856422 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.857287 12728 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:51.857549 16039 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:51.858004 16039 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:51.859329 16039 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:51.837304 15931 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:51.860711 15931 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.861234 15931 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:51.864871 12733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1739) took 2221 ms (client timeout 1629 ms). Trace:
W20260709 13:07:51.865330 12733 rpcz_store.cc:269] 0709 13:07:49.643024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.643145 (+   121us) service_pool.cc:224] Handling call
0709 13:07:51.864400 (+2221255us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540040e554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:51.864665 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318407040}
I20260709 13:07:51.866683 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.838923 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.861047 16039 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.868989 16087 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.869604 16087 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.870000 16087 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.872255 15960 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.872985 15960 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.873932 15210 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:51.875694 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.878319 15890 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.878932 15890 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.825095 16073 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.869324 15913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.877s	user 0.026s	sys 0.054s
W20260709 13:07:51.851507 12771 leader_election.cc:336] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.107s (SENT)
I20260709 13:07:51.850322 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.836217 16042 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.874135 15960 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.847752 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.888592 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:51.889523 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1168) took 2020 ms. Trace:
W20260709 13:07:51.884518 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.889715 12878 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8. Re-sending same reply.
I20260709 13:07:51.884742 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1824) took 1974 ms. Trace:
W20260709 13:07:51.887956 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.902115 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.893903 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 140359us
W20260709 13:07:51.881099 15913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.026s	sys 0.055s
I20260709 13:07:51.897792 12725 rpcz_store.cc:276] 0709 13:07:49.868972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.869193 (+   221us) service_pool.cc:224] Handling call
0709 13:07:49.869567 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.869957 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.869988 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.899169 (+ 29181us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.992664 (+ 93495us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:49.992725 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.992813 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.889088 (+1896275us) raft_consensus.cc:1685] finished
0709 13:07:51.889132 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.889354 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":24875,"thread_start_us":45904,"threads_started":1,"wal-append.queue_time_us":112183,"wal-append.run_cpu_time_us":2883,"wal-append.run_wall_time_us":1052700}
I20260709 13:07:51.903867 15913 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:51.904057 16099 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:51.900314 12881 rpcz_store.cc:276] 0709 13:07:49.910474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.910637 (+   163us) service_pool.cc:224] Handling call
0709 13:07:49.910931 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.533203 (+1622272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.884418 (+351215us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540013a454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:51.884658 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3728660736}
I20260709 13:07:51.905224 15913 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.906308 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.890115 16032 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.903769 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.906705 16083 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:51.910785 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:51.889360 12874 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:51.832702 16075 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:51.893649 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:51.891866 16087 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:51.921866 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45143.8us
I20260709 13:07:51.920461 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.924604 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:07:51.927742 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.929821 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.931157 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.889182 15977 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.934108 15977 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:51.935210 16075 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.936625 12880 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:51.921172 12881 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:51.945313 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:51.946449 13521 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:51.883519 16000 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.951515 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:51.952106 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:51.936616 15933 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.960500 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.960213 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:51.879132 15931 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.965108 16087 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:51.965749 15882 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:51.966210 12771 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.190s (SENT)
I20260709 13:07:51.962585 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.967891 12875 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:51.972926 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.968907 12878 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:51.880167 15890 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.980312 16100 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.980933 12876 raft_consensus.cc:2368] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
W20260709 13:07:51.981350 12699 leader_election.cc:336] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.147s (SENT)
I20260709 13:07:51.981313 16100 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.966311 16088 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:51.984315 16088 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:51.984722 16088 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.955693 15681 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:51.988410 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 159713us
I20260709 13:07:51.978899 16102 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.989897 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.990859 16017 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:51.976707 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.964399 16083 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.989905 12806 raft_consensus.cc:2368] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:51.990059 16018 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.980823 16079 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.949s	user 0.004s	sys 0.002s
I20260709 13:07:51.991562 16017 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:51.987677 15931 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:51.997072 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.991649 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:51.999408 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:51.996188 12876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1839) took 2005 ms (client timeout 1501 ms). Trace:
I20260709 13:07:51.969122 16073 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.002972 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:51.991649 16096 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.970741 15882 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:52.009922 12878 raft_consensus.cc:2368] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:51.971194 15977 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.995409 16102 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:51.993189 16083 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.020999 16083 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.021183 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:52.021662 16102 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.022505 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:52.023702 12696 leader_election.cc:400] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:52.024269 16097 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.024564 16086 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.024811 16097 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.025224 16097 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.012207 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.026126 16027 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.026342 12725 raft_consensus.cc:2393] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.026808 16027 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:52.027755 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.028209 12873 raft_consensus.cc:606] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:52.028442 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.028630 12725 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.021023 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.029667 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.030303 12878 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:52.027870 16027 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.031165 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.006451 12876 rpcz_store.cc:269] 0709 13:07:49.990734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.996399 (+  5665us) service_pool.cc:224] Handling call
0709 13:07:51.984004 (+1987605us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54000708d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:51.996100 (+ 12096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198812416}
I20260709 13:07:52.032585 16000 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.033043 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.019842 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.034718 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.025179 16086 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:52.018680 16072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.007s	sys 0.006s
W20260709 13:07:52.130393 12846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.180s	user 0.015s	sys 0.011s
I20260709 13:07:52.073958 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:52.087621 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.023968 12696 leader_election.cc:403] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.034168 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.074949 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 108795us
I20260709 13:07:52.109153 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:52.186177 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 112295us
I20260709 13:07:52.028681 12873 raft_consensus.cc:614] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:52.126557 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.186422 12727 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.164664 12725 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:52.014940 15882 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.188236 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.010418 16096 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.124866 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.034164 16017 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:52.196982 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 173530us
I20260709 13:07:52.192868 15210 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.015146 16018 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.034258 15681 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:52.200726 16026 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9.
I20260709 13:07:52.201705 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.212710 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.203533 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.202894 12846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.253s	user 0.024s	sys 0.016s
I20260709 13:07:52.184103 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.201402 16086 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.123730 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.123039 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.126323 12800 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:52.124089 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:52.185537 16072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.014s	sys 0.011s
W20260709 13:07:52.110023 16079 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:07:52.012190 16100 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.209375 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:52.122164 15929 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 2.373s	user 0.015s	sys 0.016s
I20260709 13:07:52.206688 16096 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.216400 12877 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.108579 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:52.026417 15962 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.220436 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.218250 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:52.224226 12771 leader_election.cc:336] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.238s (SENT)
I20260709 13:07:52.223798 12878 raft_consensus.cc:2376] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:07:52.086771 15977 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.233701 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.236164 12807 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:52.236289 12876 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.237435 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.237646 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.238061 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.239575 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.240141 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.239575 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.241292 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:52.241437 12731 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.240811 12808 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:52.238149 12807 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:52.233009 15999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.014s	sys 0.015s
I20260709 13:07:52.245172 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.246436 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.247004 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.247017 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.248662 12880 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:52.243885 15929 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:52.248874 15999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.014s	sys 0.016s
I20260709 13:07:52.267474 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.325026 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 114501us
I20260709 13:07:52.327054 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1174) took 2432 ms. Trace:
I20260709 13:07:52.328320 16100 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.269258 12879 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 9. Ops: [7.4-7.4]
I20260709 13:07:52.276348 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.282172 12800 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.282665 12801 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:52.287810 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.288581 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.294138 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 83807.1us
I20260709 13:07:52.261422 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.268573 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.295042 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.264837 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.272372 12881 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
W20260709 13:07:52.297808 12874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1820) took 2394 ms (client timeout 2238 ms). Trace:
I20260709 13:07:52.281855 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.340255 12731 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:52.342460 16070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.012s	sys 0.002s
W20260709 13:07:52.343057 16070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.012s	sys 0.002s
W20260709 13:07:52.268432 15642 consensus_meta.cc:287] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 2.467s	user 0.015s	sys 0.019s
I20260709 13:07:52.345705 12804 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:52.294737 16106 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:52.321395 12806 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.346575 12882 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:52.261705 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:07:52.350711 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 142742us
I20260709 13:07:52.327512 12724 rpcz_store.cc:276] 0709 13:07:49.894783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.895282 (+   499us) service_pool.cc:224] Handling call
0709 13:07:49.895665 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:49.896195 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:50.956732 (+1060537us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b180034f420. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c0d0bf 00007f0f41c0d038
0709 13:07:50.966578 (+  9846us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.037533 (+ 70955us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:51.044859 (+  7326us) log.cc:844] Serialized 52 byte log entry
0709 13:07:51.045113 (+   254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:51.058617 (+ 13504us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.059321 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.235212 (+175891us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.979642 (+744430us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:52.326651 (+347009us) raft_consensus.cc:1685] finished
0709 13:07:52.326676 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.326876 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2277,"prepare.queue_time_us":1065282,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":1027,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":11968,"spinlock_wait_cycles":1371249664,"thread_start_us":74100,"threads_started":2,"wal-append.queue_time_us":64088}
I20260709 13:07:52.352087 13486 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:52.352695 16015 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.353420 16015 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.353951 16015 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:52.340886 12874 rpcz_store.cc:269] 0709 13:07:49.903171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.903321 (+   150us) service_pool.cc:224] Handling call
0709 13:07:52.297486 (+2394165us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400382a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:52.297692 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4547477760}
W20260709 13:07:52.265180 16089 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.647s	user 0.003s	sys 0.001s
I20260709 13:07:52.282353 15977 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.348694 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.347806 12808 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:52.329700 12629 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.348846 12803 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.350732 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.364809 12807 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.273869 15846 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.360137 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.360347 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 118958us
I20260709 13:07:52.360889 12799 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:52.272436 15637 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.360162 15862 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:52.368554 12804 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.366937 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.367700 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.370390 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.267742 15929 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.372076 12880 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.373733 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.375151 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.376835 12727 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:52.291664 16083 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.374373 12881 raft_consensus.cc:2376] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
I20260709 13:07:52.379220 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1178) took 2482 ms. Trace:
I20260709 13:07:52.379515 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.380722 12804 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.379665 12726 rpcz_store.cc:276] 0709 13:07:49.896965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.419382 (+1522417us) service_pool.cc:224] Handling call
0709 13:07:51.419956 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.464348 (+ 44392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.464408 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.511344 (+ 46936us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.601722 (+ 90378us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:51.601755 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.601814 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.264290 (+662476us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:52.378893 (+114603us) raft_consensus.cc:1685] finished
0709 13:07:52.378919 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.379148 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26617,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":3393,"spinlock_wait_cycles":25908992,"thread_start_us":89893,"threads_started":1,"wal-append.queue_time_us":106436}
I20260709 13:07:52.381618 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.382359 12804 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.383136 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.383661 16026 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.383859 12804 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.372947 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.386236 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.387477 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.387997 12808 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:52.389591 12800 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.390863 12874 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:52.386986 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.391580 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:52.393504 15637 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.396235 15898 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.383340 16015 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.398609 12807 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.405179 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.406385 12875 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:52.398612 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.410940 15882 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.417378 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.426874 15882 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:52.430429 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.430917 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.442627 16015 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.429790 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:52.376794 15977 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.416492 15898 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.397607 15637 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:52.485744 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.462821 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.486188 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.448539 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.509042 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.479768 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:52.484498 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.561796 12874 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.561904 12875 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 9. Ops: []
I20260709 13:07:52.552376 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:52.575069 12876 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:52.560556 12808 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:52.579226 12880 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:52.578810 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.591959 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2007) took 1547 ms. Trace:
I20260709 13:07:52.592406 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 240) took 1590 ms. Trace:
I20260709 13:07:52.592805 12874 rpcz_store.cc:276] 0709 13:07:50.987664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.406947 (+1419283us) service_pool.cc:224] Handling call
0709 13:07:52.561594 (+154647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.577427 (+ 15833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.577655 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.592427 12875 rpcz_store.cc:276] 0709 13:07:51.031369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.414697 (+1383328us) service_pool.cc:224] Handling call
0709 13:07:52.561733 (+147036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.577739 (+ 16006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.577920 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217408}
I20260709 13:07:52.601277 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 241) took 1593 ms. Trace:
I20260709 13:07:52.601822 12880 rpcz_store.cc:276] 0709 13:07:51.008207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.408707 (+1400500us) service_pool.cc:224] Handling call
0709 13:07:52.577563 (+168856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.600909 (+ 23346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.601190 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921472}
I20260709 13:07:52.603835 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:52.605907 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.606007 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.606861 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:52.607292 15933 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:52.608230 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.491974 15588 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.606910 12800 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.612267 15588 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:52.612912 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.613510 12800 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:52.613216 15588 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.613569 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.614269 15588 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.614566 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.614882 12807 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.615227 12800 raft_consensus.cc:2376] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
I20260709 13:07:52.608116 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.616472 12804 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:52.618211 12662 debug-util.cc:398] Leaking SignalData structure 0x7b0800064cc0 after lost signal to thread 12665
W20260709 13:07:52.618659 16077 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.757s	user 0.007s	sys 0.000s
I20260709 13:07:52.620247 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1175) took 2724 ms. Trace:
I20260709 13:07:52.600306 15977 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.621637 12803 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.620617 12730 rpcz_store.cc:276] 0709 13:07:49.895366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.850106 (+954740us) service_pool.cc:224] Handling call
0709 13:07:50.850703 (+   597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.851373 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.851413 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.852621 (+  1208us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.864448 (+ 11827us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.864491 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.864626 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.618075 (+1753449us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:52.619931 (+  1856us) raft_consensus.cc:1685] finished
0709 13:07:52.619952 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.620185 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"spinlock_wait_cycles":1759418624,"thread_start_us":11330,"threads_started":1,"wal-append.queue_time_us":8455}
W20260709 13:07:52.599434 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 169753us
I20260709 13:07:52.625711 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.556806 15962 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.557791 16087 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.631843 12804 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:52.486259 16018 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.635414 12882 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:52.636092 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2014) took 1602 ms. Trace:
I20260709 13:07:52.630733 12807 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:52.636444 12882 rpcz_store.cc:276] 0709 13:07:51.033789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.422680 (+1388891us) service_pool.cc:224] Handling call
0709 13:07:52.599746 (+177066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.635806 (+ 36060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.636006 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.640497 12874 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:07:52.641709 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.644526 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2019) took 1608 ms. Trace:
I20260709 13:07:52.645051 12874 rpcz_store.cc:276] 0709 13:07:51.035633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.605128 (+1569495us) service_pool.cc:224] Handling call
0709 13:07:52.635740 (+ 30612us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:52.644113 (+  8373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.644443 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.634217 16088 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.006s
I20260709 13:07:52.632586 16086 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.652123 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.589522 16096 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.656318 12880 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:52.653218 12881 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:07:52.657989 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.660887 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:52.664252 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 184712us
I20260709 13:07:52.666656 16017 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.667090 16017 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.667450 16017 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.650436 15890 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.675292 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.679296 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:52.682492 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.679517 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.676744 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1815) took 2775 ms. Trace:
I20260709 13:07:52.679455 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:52.686204 12802 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.677377 16084 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:07:52.688349 15898 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.689337 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:52.661496 16086 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:52.690124 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.690977 12801 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:07:52.690855 16086 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.643415 15962 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.651402 16087 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.653859 16088 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.685206 13521 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.696274 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.786350 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:52.753249 13487 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.817s (SENT)
I20260709 13:07:52.776933 15977 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:52.732682 16097 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.707s	user 0.015s	sys 0.000s
I20260709 13:07:52.825724 16097 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:52.825141 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 135962us
W20260709 13:07:52.828326 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.828461 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:52.830572 16102 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.831115 16102 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:52.817028 15681 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:52.694355 12877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1827) took 2783 ms (client timeout 1963 ms). Trace:
I20260709 13:07:52.834512 15681 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.826846 12876 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.827402 15962 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.663553 16096 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.844345 12729 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.843657 12874 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:52.698285 12881 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:52.799535 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08001e71e0 after lost signal to thread 12757
I20260709 13:07:52.846453 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:52.770313 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.818758 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57450 (request call id 7) took 2917 ms. Trace:
W20260709 13:07:52.677945 16071 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 2.087s	user 0.000s	sys 0.008s
I20260709 13:07:52.845881 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.847841 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.847981 12730 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:52.711407 12807 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:07:52.684919 12879 rpcz_store.cc:276] 0709 13:07:49.901561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.901734 (+   173us) service_pool.cc:224] Handling call
0709 13:07:49.902158 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.349738 (+2447580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.676350 (+326612us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b54003b6354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:52.676641 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5443428736}
I20260709 13:07:52.805740 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:52.692981 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.836556 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.824700 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:52.670341 12804 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:52.837935 16015 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.820075 15637 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.855157 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.838938 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.855871 12800 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:52.839558 16083 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:52.814836 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.840793 12878 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:52.842017 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2015) took 1807 ms. Trace:
I20260709 13:07:52.858003 12876 rpcz_store.cc:276] 0709 13:07:51.034124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.605105 (+1570981us) service_pool.cc:224] Handling call
0709 13:07:52.826415 (+221310us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:52.826642 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.841744 (+ 15102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.841953 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15679232}
W20260709 13:07:52.672150 16085 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.174s	user 0.006s	sys 0.000s
I20260709 13:07:52.859820 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.687945 16084 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.850769 12802 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.851361 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.841200 15588 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:52.863353 15862 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.847115 12873 rpcz_store.cc:276] 0709 13:07:49.901125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.903708 (+  2583us) service_pool.cc:224] Handling call
0709 13:07:52.818434 (+2914726us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400221354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bed853 00007f0f46bbb60a 00007f0f401417d4 00007f0f40141762 00007f0f40141691 00007f0f4014160c 00007f0f401408c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:52.818604 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4861196032}
I20260709 13:07:52.853385 13518 raft_consensus.cc:2368] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:07:52.864701 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.865609 12800 raft_consensus.cc:2368] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:52.865458 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.853852 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 245) took 1155 ms. Trace:
I20260709 13:07:52.866873 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.867033 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.867573 12800 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.863379 12882 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
W20260709 13:07:52.855409 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.856694 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5d20 after lost signal to thread 12832
I20260709 13:07:52.856451 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:52.842526 15681 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.858956 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 242) took 1831 ms. Trace:
I20260709 13:07:52.859349 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.859635 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.873935 12878 rpcz_store.cc:276] 0709 13:07:51.027327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.408105 (+1380778us) service_pool.cc:224] Handling call
0709 13:07:52.840461 (+432356us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:07:52.840664 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.858180 (+ 17516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.858377 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609024}
I20260709 13:07:52.874383 12879 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:52.862051 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:52.867386 12881 rpcz_store.cc:276] 0709 13:07:51.698178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.657496 (+959318us) service_pool.cc:224] Handling call
0709 13:07:52.669063 (+ 11567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.853594 (+184531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.853791 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.834873 12877 rpcz_store.cc:269] 0709 13:07:49.911370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.963140 (+ 51770us) service_pool.cc:224] Handling call
0709 13:07:51.634785 (+1671645us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b58001c0298. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:07:52.694114 (+1059329us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400221354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:52.694263 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328217600}
I20260709 13:07:52.870611 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.876129 12807 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.850378 12805 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:52.867759 12873 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.881177 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.881621 12725 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:52.882426 12733 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.883797 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.883983 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.885146 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.885267 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.885970 12806 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:52.886683 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.886780 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.887554 12806 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:52.887650 12724 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.888222 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.888684 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.888931 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:52.889528 12800 raft_consensus.cc:2376] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9. Re-sending same reply.
I20260709 13:07:52.890379 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.889554 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.890913 12800 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:52.893376 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:52.893918 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47499.9us
I20260709 13:07:52.894215 13518 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:52.890990 12732 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.888350 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.896893 12801 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:52.897697 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.898362 12882 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.891875 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.899696 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:52.902850 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.903791 15999 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:52.905388 12800 raft_consensus.cc:2410] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:52.906265 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ba0 after lost signal to thread 12906
I20260709 13:07:52.906595 12804 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:52.904819 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.908741 15637 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.909379 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.910480 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.910725 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.911104 12801 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.911638 12806 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 13: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.832137 16102 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.912743 12806 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.911993 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.912917 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.914151 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:52.919293 12878 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:52.922494 12799 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:52.923038 15928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.933s	user 0.021s	sys 0.047s
W20260709 13:07:52.923504 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccae0 after lost signal to thread 13545
W20260709 13:07:52.923797 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08003d16c0 after lost signal to thread 13546
W20260709 13:07:52.924744 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080032c7e0 after lost signal to thread 16023
W20260709 13:07:52.925081 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08000e95c0 after lost signal to thread 16031
I20260709 13:07:52.925135 15588 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.925724 12799 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:52.926189 12799 pending_rounds.cc:85] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:07:52.926406 12799 pending_rounds.cc:107] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:52.926672 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.927520 12726 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:52.927634 12806 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:52.928498 12879 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.928887 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.929104 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1860) took 1051 ms. Trace:
I20260709 13:07:52.929440 12879 rpcz_store.cc:276] 0709 13:07:51.877972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.899311 (+1021339us) service_pool.cc:224] Handling call
0709 13:07:52.928320 (+ 29009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.928890 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.929057 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.929939 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.930568 12730 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.931699 15999 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:52.932144 15637 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:52.932907 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.933264 15637 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.932986 15999 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:52.941244 12803 raft_consensus.cc:1240] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:52.941723 16026 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:52.942691 12803 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:52.942533 16026 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:52.944885 12801 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:52.916222 12881 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.935070 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.936733 16087 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:52.937196 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.862856 16084 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:52.926683 12799 raft_consensus.cc:2889] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:52.959297 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 206128us
I20260709 13:07:52.963188 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.966034 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.967170 12804 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 13: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:52.968174 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:52.969359 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.972136 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.972958 12728 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:52.975421 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:52.974910 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 75282.9us
I20260709 13:07:52.977268 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.978914 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:52.979957 12807 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:52.953809 16071 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:52.976061 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:52.973868 15928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.986s	user 0.021s	sys 0.047s
I20260709 13:07:52.987691 12696 leader_election.cc:400] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:07:52.988492 12729 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.985010 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.994522 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:52.995110 12733 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.995635 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.989960 12805 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:52.990576 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:52.991243 12696 leader_election.cc:403] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.997505 12728 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:52.982395 16087 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.000679 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:52.981251 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:52.925768 15588 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.008082 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:53.008806 12726 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.007085 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:53.010476 13518 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:53.010638 12728 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
W20260709 13:07:53.001899 12773 connection.cc:256] RPC call timeout handler was delayed by -1.74213184000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:07:52.999775 16096 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:53.015062 16096 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.016023 15944 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:53.016564 15944 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:53.017377 16096 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.017931 16087 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:53.018944 16087 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.024435 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:53.026129 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:53.026517 16072 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.026716 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:53.027472 16072 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:53.002461 16086 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:53.035061 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:53.035990 12731 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:53.037026 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:53.038040 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:53.013706 15890 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.040470 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:53.040933 12875 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:53.041326 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.041352 12728 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:53.026993 12725 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:53.055385 15588 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.056102 12724 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.056243 16042 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.056979 16042 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.058706 12726 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:07:53.060201 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:53.061967 12732 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:53.062254 12733 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:53.013751 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:53.066903 12729 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:53.070760 12731 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:53.073516 12727 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:53.073546 12731 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:07:53.067754 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 80214.7us
I20260709 13:07:53.075408 12727 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:53.076689 12727 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.001050 16039 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:07:53.080375 12725 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:53.085839 12732 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:53.079278 16118 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
W20260709 13:07:53.093156 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 92601.3us
W20260709 13:07:53.093312 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 79654.5us
I20260709 13:07:53.095810 12733 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:53.069339 15862 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:53.064998 15933 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.103669 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.069563 15588 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:53.105341 12731 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:53.111150 12773 leader_election.cc:400] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:53.114419 12773 leader_election.cc:403] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.105118 16072 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:53.120080 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:53.123502 12806 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:53.124094 12806 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:53.124995 12806 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.126457 12806 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.128836 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:53.107926 15588 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:53.110257 16026 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:53.116770 16120 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:07:53.133283 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.136555 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:53.017693 15944 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.150458 15944 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:53.152596 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44414.1us
I20260709 13:07:53.110714 16015 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:07:53.110391 15890 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:53.107864 16118 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:53.166450 12773 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:53.168004 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73560.5us
I20260709 13:07:53.168325 16042 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.169394 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.132671 16096 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.155901 15933 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.172837 15933 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.173097 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.173310 15933 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.176416 16026 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.176669 15890 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:53.156227 16097 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.177300 15890 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:53.178544 15890 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.157413 16072 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:53.181172 16072 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.133342 15588 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:53.130015 16017 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.157037 15681 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.185719 16015 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:53.186285 15681 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:53.189631 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:53.190379 13521 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.171705 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.194800 12730 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:53.196630 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58121us
I20260709 13:07:53.203783 12724 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:53.145730 15977 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:53.205940 12877 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:53.203194 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74053.2us
I20260709 13:07:53.213155 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.214066 12875 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:53.216444 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:53.218134 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.222317 12806 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 10 index: 3. (term mismatch)
I20260709 13:07:53.222728 12806 pending_rounds.cc:85] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 2
I20260709 13:07:53.222958 12806 pending_rounds.cc:107] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 9.3
I20260709 13:07:53.223214 12806 raft_consensus.cc:2889] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.226177 13521 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:53.177007 16026 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:53.230686 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59111.4us
I20260709 13:07:53.205200 15931 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.231796 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.193928 16017 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:53.198572 15862 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:53.186406 16015 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:53.208242 16083 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:53.246506 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.220168 15928 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.207866 16097 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.227759 15890 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.237097 16026 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.254462 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:53.238227 16065 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:53.259086 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.262884 12880 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.248194 16083 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.267385 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:53.272104 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.273804 12877 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:53.276908 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.277578 12875 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.235982 15962 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:53.278354 15962 consensus_queue.cc:1243] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:53.280922 15862 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.285369 15882 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.285930 15882 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.286303 15882 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.279803 15588 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.289505 15933 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.290174 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.292207 12726 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:53.292928 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.293445 15588 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.292234 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.294765 12803 raft_consensus.cc:2368] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9.
I20260709 13:07:53.293812 12808 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.296605 16015 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.298084 16015 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.263756 16017 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.244398 15931 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.303467 16088 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:53.304740 12879 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:53.318204 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 119822us
I20260709 13:07:53.322360 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:53.324713 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52763.7us
I20260709 13:07:53.321283 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:53.320417 12629 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 4 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:53.328474 16124 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:07:53.328648 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:53.329684 12629 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.330441 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.334631 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.336403 12803 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.342145 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.270547 16083 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.352272 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:53.353474 12803 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:53.352836 12808 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:53.355363 12880 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:53.269258 15977 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:07:53.321031 16088 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.364338 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.365767 12877 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:53.287580 16084 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.367197 16084 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.352128 15928 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.369135 15928 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.369656 15928 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.369796 13513 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:53.370121 15928 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.371677 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.372668 15931 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.376577 12799 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.378262 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.378944 12799 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:53.378741 16096 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.380213 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.372627 12805 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:07:53.383478 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.384361 15931 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:53.384821 15933 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:53.384985 15931 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:53.388608 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62854us
I20260709 13:07:53.389715 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.396183 12875 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:53.396744 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.398056 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.352526 16065 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.411594 16097 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.414284 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:53.415263 12771 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.501s (SENT)
I20260709 13:07:53.415529 12805 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.414489 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.415968 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.404182 16017 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.417666 16017 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.418032 16017 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.418342 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.412937 16065 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.419776 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.420585 16065 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.421346 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.421934 16015 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:53.423633 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.405225 16096 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:53.424563 16015 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:53.424855 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:53.425524 16096 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.425964 16096 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:53.426537 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.427320 15588 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.427243 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.427815 15588 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.428280 15588 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.428577 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.386190 15931 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.433058 12878 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.443058 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:53.445926 16027 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.446672 16027 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.448315 16097 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:53.449923 16097 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:53.450373 16097 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:53.448390 16086 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.459128 16086 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.459510 16086 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.468262 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.451387 16097 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:53.426043 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.470480 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55277.5us
I20260709 13:07:53.470811 12808 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.426549 16096 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.477317 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.467655 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.478119 12803 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.478739 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.424980 16015 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:53.491658 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.495918 12771 leader_election.cc:336] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.514s (SENT)
W20260709 13:07:53.498266 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.498536 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.497781 12874 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:53.470227 16118 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:53.516458 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 181897us
I20260709 13:07:53.524710 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:53.521191 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.476774 16119 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:53.499771 16018 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.535037 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.539475 12879 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:53.540270 12880 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:53.517014 16118 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:53.543704 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.526665 16097 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.550611 15933 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.538663 16018 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.557235 16018 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.565124 12878 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:53.539090 16119 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:53.577735 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 99081.9us
I20260709 13:07:53.555852 16118 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.617305 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.568612 16015 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.560521 15882 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.583446 16136 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.622408 15588 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.583534 15977 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.621109 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.645850 16072 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.646431 16072 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:53.647766 15588 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.623015 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.629758 15929 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:53.665723 12799 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.630645 15890 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:53.588136 15933 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.668299 15933 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.630980 16088 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.612092 16027 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.606442 16119 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.594995 16026 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.632169 16083 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.672497 12806 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.610296 16134 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:53.610441 15999 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:53.674376 16083 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.638140 15882 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:53.648236 15637 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:53.634790 16015 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.676414 15637 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:53.677023 15637 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:53.678114 15637 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.647377 16072 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.649907 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:53.682423 12696 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.606437 16137 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:53.656298 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.613727 12628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 191) took 23609 ms (client timeout 15000 ms). Trace:
I20260709 13:07:53.657384 16018 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.662906 16065 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:53.668762 15933 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:53.672744 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.583976 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 196068us
I20260709 13:07:53.598210 16131 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:53.679735 15637 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:53.686031 13518 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:53.686684 12805 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:53.655478 16097 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.689846 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.707062 12806 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.688441 12803 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:53.690696 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 105650us
I20260709 13:07:53.694370 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.686092 15862 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.711968 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.715184 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.727380 12799 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:53.729327 12806 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:53.727955 12799 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:53.743911 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.745703 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.746771 12803 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.752419 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:53.754552 13521 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.752826 12799 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.779346 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.780179 12805 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:53.697772 16131 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:53.697374 16143 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.709661 16137 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:53.740154 15862 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.688082 16017 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:53.787087 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 266013us
I20260709 13:07:53.788265 12799 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.742357 15588 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.740386 16026 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:53.796281 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 300445us
I20260709 13:07:53.787276 16143 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.784188 16097 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:53.816547 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.753178 16088 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:53.802646 15862 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.752332 16027 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:07:53.824536 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 80743.9us
I20260709 13:07:53.825647 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.833480 13521 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:53.837822 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:53.845561 16017 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:53.846388 16017 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:53.846760 16017 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:53.817273 16143 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.823601 16026 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.863634 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.857157 13487 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:53.847710 16017 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.834066 16083 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:53.876158 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.818892 15928 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.877079 12803 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:07:53.856832 16088 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:53.856309 15977 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:53.688418 12628 rpcz_store.cc:269] 0709 13:07:30.007225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.008646 (+  1421us) service_pool.cc:224] Handling call
0709 13:07:30.021206 (+ 12560us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b54001c0610. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacf0b2 00007f0f47a48a89 00007f0f479e0da6 00007f0f479b2088 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc
0709 13:07:53.613326 (+23592120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:45.567950 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:45.876926 (+308976us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:45.881583 (+  4657us) write_op.cc:435] Acquired schema lock
0709 13:07:45.902774 (+ 21191us) tablet.cc:662] Decoding operations
0709 13:07:46.312988 (+410214us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:46.322324 (+  9336us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:46.341567 (+ 19243us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:46.462270 (+120703us) tablet.cc:701] Row locks acquired
0709 13:07:46.462292 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:46.462467 (+   175us) write_op.cc:270] Start()
0709 13:07:46.462597 (+   130us) write_op.cc:276] Timestamp: P: 1783602466462426 usec, L: 0
0709 13:07:46.463869 (+  1272us) op_driver.cc:348] REPLICATION: starting
0709 13:07:46.506991 (+ 43122us) log.cc:844] Serialized 2818 byte log entry
0709 13:07:47.962523 (+1455532us) op_driver.cc:464] REPLICATION: finished
0709 13:07:48.682655 (+720132us) write_op.cc:301] APPLY: starting
0709 13:07:48.682744 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:48.682932 (+   188us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:48.683073 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:48.698167 (+ 15094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:48.698356 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:07:48.698399 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:48.722264 (+ 23865us) log.cc:844] Serialized 58 byte log entry
0709 13:07:48.934885 (+212621us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.945737 (+ 10852us) write_op.cc:454] Released schema lock
0709 13:07:48.950864 (+  5127us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:49.013913 (+ 63049us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:49.022436 (+  8523us) write_op.cc:454] Released schema lock
0709 13:07:49.602697 (+580261us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b180015b140. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
Metrics: {"mutex_wait_us":17033,"reported_tablets":54,"spinlock_wait_cycles":10643712,"child_traces":[["op",{"apply.queue_time_us":716233,"apply.run_cpu_time_us":15020,"apply.run_wall_time_us":308045,"num_ops":7,"prepare.queue_time_us":485316,"prepare.run_cpu_time_us":86224,"prepare.run_wall_time_us":1161311,"raft.queue_time_us":1168605,"raft.run_cpu_time_us":37568,"raft.run_wall_time_us":763516,"replication_time_us":1483314,"spinlock_wait_cycles":12981504,"thread_start_us":1913930,"threads_started":5,"wal-append.queue_time_us":525675,"wal-append.run_cpu_time_us":43102,"wal-append.run_wall_time_us":4147795}]]}
I20260709 13:07:53.830964 16096 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.821430 16144 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:07:53.889268 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73706.7us
I20260709 13:07:53.900311 12808 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:53.900216 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:53.904923 12806 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.875139 16018 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:53.908386 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82819.1us
I20260709 13:07:53.875255 16026 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:53.910619 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.909984 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:53.912976 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.915951 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.917255 12804 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:53.848788 16150 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:07:53.920219 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.913043 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:53.921187 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 64129.7us
I20260709 13:07:53.926718 13487 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:53.924721 12807 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:53.896090 16084 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.932365 12726 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:53.903631 16065 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:53.933804 12802 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:53.933357 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.933308 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:53.857442 16136 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:07:53.870947 16118 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.948963 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:53.909466 16088 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:53.962177 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:53.962198 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.965304 12878 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:53.986866 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:53.987854 12731 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:53.966739 12806 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:53.968477 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:53.988569 12727 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.988826 12877 raft_consensus.cc:2410] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:53.969117 16018 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.969740 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.970434 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.992616 12881 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.971120 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.993507 12880 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.967815 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:53.948576 16149 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.953522 16027 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:53.972636 16151 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.025010 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 71676.8us
I20260709 13:07:53.923772 15933 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.824112 16131 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:53.979357 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:54.033288 12771 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.033704 12728 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:53.980171 12803 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:53.932914 16097 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:53.934116 16017 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.998999 12731 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.038401 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:54.002991 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.908103 16137 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.009694 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:54.011314 12875 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:54.035123 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:54.083251 16131 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.087953 12729 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.088192 16097 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:54.042897 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 56564us
I20260709 13:07:54.090675 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.102085 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.021869 16027 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:54.110205 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77022.7us
I20260709 13:07:54.028628 16126 raft_consensus.cc:2764] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:54.116050 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.116966 12881 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:54.119462 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.117126 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:54.120718 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 194119us
I20260709 13:07:54.126690 12729 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:54.037189 16083 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:54.137127 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.137791 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:54.140543 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.141821 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.140919 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.142571 12878 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:07:54.148623 12727 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.148743 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.153296 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.154975 12880 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:54.157128 12771 leader_election.cc:400] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:54.158270 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.118659 16027 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.160746 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.028796 16151 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.165593 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.178390 12800 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.178658 12873 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:54.164631 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.165072 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.165174 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.182098 12803 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:54.164692 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.183411 12806 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:54.176203 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.185055 12805 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:54.177171 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.176908 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.192623 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.194092 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.139979 16144 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.195389 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.196368 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.198570 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:54.200242 12732 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:54.200830 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44005.8us
I20260709 13:07:54.217337 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.218045 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.218230 12875 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:54.218876 12880 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:54.044654 16026 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.223838 12730 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:54.222205 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.223688 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.225351 12807 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.226720 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.227797 12805 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:54.229887 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.230224 12801 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:54.187812 16150 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:54.189508 16161 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:54.233006 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.195240 16136 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.199698 16144 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:54.245651 12732 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.246420 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.251317 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.192082 16084 consensus_queue.cc:1059] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:07:54.256963 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80161.7us
I20260709 13:07:54.190915 16163 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:07:54.261255 12873 raft_consensus.cc:2368] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8.
W20260709 13:07:54.098592 16156 consensus_queue.cc:1175] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45825bb09c34201b13ddcec07c4b3f1" responder_term: 9 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:54.250355 16148 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 13:07:54.267210 16158 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.267915 16158 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.242671 15944 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.273211 12882 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.276432 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:54.278193 12873 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:54.279553 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.202018 16126 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:54.241710 16096 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.292881 12882 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:07:54.285646 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.600s (SENT) [suppressed 54 similar messages]
I20260709 13:07:54.288959 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.298295 16168 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.299033 16168 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.194141 16088 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.302024 16168 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.305109 16163 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.305795 16163 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:07:54.289865 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53367us
I20260709 13:07:54.315867 12800 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:54.316114 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:54.307013 16163 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:54.325260 12699 leader_election.cc:336] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.897s (SENT)
I20260709 13:07:54.328341 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:54.337229 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.345266 12725 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:54.346287 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 69988.8us
I20260709 13:07:54.346616 12725 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.347947 12725 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:07:54.350208 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70754.5us
I20260709 13:07:54.352406 16136 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:54.353199 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.353385 16136 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:54.355317 12873 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.355180 16136 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.270748 16158 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.272276 16097 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:54.358918 12699 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.941s (SENT)
I20260709 13:07:54.363032 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.359732 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.364795 12800 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
W20260709 13:07:54.369091 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.311540 15588 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.382113 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:54.403252 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:54.409608 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 64686.6us
W20260709 13:07:54.410559 12699 leader_election.cc:336] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 2.176s (SENT)
I20260709 13:07:54.358389 16162 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.423424 12699 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:54.426715 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.430625 12808 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.375838 16118 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.395936 16097 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.385560 16018 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:54.392412 15933 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:54.457777 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:54.460498 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.407140 15977 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:54.278648 16083 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.465011 12800 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:54.376462 16150 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:54.471163 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:54.452600 16119 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.783s	user 0.014s	sys 0.000s
I20260709 13:07:54.474900 12800 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.271919 16144 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.488550 12805 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:54.489164 12805 pending_rounds.cc:85] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 4
I20260709 13:07:54.489431 12805 pending_rounds.cc:107] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:54.489706 12805 raft_consensus.cc:2889] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:54.493645 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83136.6us
I20260709 13:07:54.500389 12699 leader_election.cc:400] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:54.500989 12699 leader_election.cc:403] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:07:54.506762 16164 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:54.507133 15944 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.510357 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.511288 12804 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:54.511036 15977 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.512425 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:54.513612 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55919.2us
I20260709 13:07:54.515295 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.523897 12800 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:54.467355 16158 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:54.475541 16126 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:54.524596 15862 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.003s
I20260709 13:07:54.492866 15931 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.531586 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:54.538941 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:54.496556 15928 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.535429 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:54.535392 16172 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 13:07:54.538950 13513 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:54.541790 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.555044 12771 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.542524 16176 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.465758 16097 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.564606 12729 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:54.566504 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 71410.6us
W20260709 13:07:54.548995 16015 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.003s
I20260709 13:07:54.538853 16157 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:54.549103 15931 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.544587 16158 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:54.573356 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.493148 16119 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.570904 16131 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:54.582230 16131 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.596786 12848 leader_election.cc:400] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9.
I20260709 13:07:54.597648 12848 leader_election.cc:403] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.571640 16162 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:54.577757 16143 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.006s
I20260709 13:07:54.570158 16151 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.577262 15931 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.549490 15862 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.613279 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.619967 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.621021 12799 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.609095 15882 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9.
W20260709 13:07:54.625540 16170 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:54.627287 16174 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:54.628623 16179 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.629925 16176 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.639374 12808 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:54.610988 15637 consensus_meta.cc:287] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.901s	user 0.014s	sys 0.000s
I20260709 13:07:54.641999 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.642984 12808 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.599393 16168 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:54.588747 16182 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:54.600144 16173 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.648490 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:07:54.611389 16157 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:54.661674 12875 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:07:54.655392 12799 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:54.612090 16143 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:54.656471 16169 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:07:54.657361 16118 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:54.657686 16131 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.658342 13516 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:54.664263 16157 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.670234 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.671023 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:54.649322 16086 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.188s	user 0.012s	sys 0.009s
I20260709 13:07:54.675143 12807 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:54.640545 16176 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:54.677637 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59017.9us
I20260709 13:07:54.682427 12724 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.697171 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.697969 12724 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:54.698401 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.573324 16018 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.702975 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.694109 12808 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:54.694116 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.694882 12799 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:54.704223 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.705493 12799 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:07:54.705657 12808 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:54.707265 12799 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:54.709383 12799 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:54.707823 12808 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:07:54.675558 16118 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:07:54.714840 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43934.4us
I20260709 13:07:54.719856 12771 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.721745 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.723012 16182 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.725708 12727 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:54.725869 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.728168 16153 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.728967 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.729777 16153 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.730422 16153 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.732401 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.676249 15637 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:54.714367 16179 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.713340 15588 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.710675 16162 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.712818 16118 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:54.709753 16131 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:54.734190 16027 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 13:07:54.669209 16173 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.738425 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:54.744699 12799 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:54.710467 16070 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:54.746315 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.701428 16086 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.737347 16168 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.748543 16158 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.749235 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:54.790750 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44518.8us
W20260709 13:07:54.753973 16017 consensus_meta.cc:287] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.002s
I20260709 13:07:54.733587 15928 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.759824 16119 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.807819 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.808370 15999 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.809548 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.761206 16143 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:54.761533 16167 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
W20260709 13:07:54.761801 16184 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:07:54.764417 15931 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.774308 12799 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.708995 16176 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.735404 16174 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:07:54.767112 16027 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.779470 15862 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.744154 16097 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.791947 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.800634 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.801735 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:54.802063 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:54.812913 12724 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:54.813573 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91892.9us
I20260709 13:07:54.817385 16072 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:54.818130 15637 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:54.819200 12726 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:54.819475 12728 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:54.829710 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91350.9us
I20260709 13:07:54.829478 16173 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.843894 16017 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:54.817452 16190 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.191s	user 0.003s	sys 0.000s
I20260709 13:07:54.835670 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.838546 12804 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:54.815939 16070 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:54.840663 12808 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:54.842312 16177 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.856083 16177 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.858700 16176 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.832183 16065 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.862010 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:54.863708 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.864993 12729 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:54.865736 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:54.866725 12729 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.840956 16143 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.867440 16143 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:54.866734 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.867978 16143 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.868513 15928 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.869338 15928 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.869742 15928 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.870122 15928 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.872262 16156 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.796892 16153 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.850965 15637 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.873276 16118 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.873956 15637 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:54.869086 16150 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.878341 16177 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.862183 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.879197 16163 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.879698 12881 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:07:54.865619 16086 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.880478 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.881975 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.882122 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.882876 12806 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
W20260709 13:07:54.883329 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.883692 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:54.884181 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.884572 12730 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:54.885543 12725 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.843716 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:54.886169 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45170.4us
I20260709 13:07:54.852473 15931 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.869922 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.824931 15999 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:54.894618 12802 raft_consensus.cc:2368] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:07:54.852104 16027 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.875141 15637 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.886910 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:54.888453 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:54.895814 12806 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:54.850392 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.891497 12731 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.897429 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:54.897799 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:54.898658 12731 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:54.899365 15862 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.899497 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:54.899971 15862 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.900728 12730 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:54.897471 12808 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.905529 12732 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:54.905634 12806 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.903949 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:54.908124 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:54.909396 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47539.3us
I20260709 13:07:54.911525 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:54.912425 16158 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:54.913265 15637 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.913117 16158 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.912599 13513 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:54.916282 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:54.917695 12696 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:54.922089 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.924309 12729 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.925518 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:54.881107 16018 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.928097 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.928808 16027 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:54.904161 16161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.012s	sys 0.000s
I20260709 13:07:54.934227 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:54.935699 13518 raft_consensus.cc:2410] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:54.895689 16118 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.939030 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:54.902163 16185 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.902398 16096 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:54.901834 16015 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:07:54.947160 16096 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.948572 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:54.915747 16083 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.921351 15933 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:54.932600 16168 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:54.938143 16161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.013s	sys 0.000s
I20260709 13:07:54.953744 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:54.922613 16017 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.911567 15862 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.956207 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.922940 16173 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:54.932687 16097 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:54.895303 16072 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:54.925259 16086 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.921356 16174 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:54.953006 16096 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:54.938491 16018 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:54.962030 16179 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:55.005395 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 271) took 1216 ms. Trace:
W20260709 13:07:55.109038 12771 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.051s (SENT)
I20260709 13:07:54.975852 12808 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:55.133493 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:54.964663 16027 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:07:55.129521 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 225806us
I20260709 13:07:55.006608 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:54.969794 16161 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:55.137908 12803 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.131778 13516 rpcz_store.cc:276] 0709 13:07:53.788903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.789147 (+   244us) service_pool.cc:224] Handling call
0709 13:07:53.810284 (+ 21137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.678469 (+868185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.005029 (+326560us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54005fe1d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:55.005287 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932757760}
I20260709 13:07:55.004253 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:07:55.039402 16199 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:55.147277 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 231517us
W20260709 13:07:55.153025 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.045104 16149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.008s	sys 0.009s
W20260709 13:07:55.157124 16149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.011s	sys 0.017s
I20260709 13:07:55.003679 15882 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:55.089072 16146 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.156s	user 0.004s	sys 0.000s
I20260709 13:07:54.992089 16026 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.020123 15933 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:55.159920 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:55.115844 16084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.011s	sys 0.001s
I20260709 13:07:54.976212 16168 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:55.142881 15999 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:55.151944 16119 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.180656 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:55.181720 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 242776us
I20260709 13:07:54.987036 16097 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:54.970420 16131 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:07:54.980319 16017 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:54.993474 16201 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.089906 16158 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:54.987495 16173 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:55.167025 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:55.164793 15882 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:55.173739 12732 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:55.173857 12729 raft_consensus.cc:1240] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:55.175395 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.150104 16096 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.001978 16072 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.173832 12803 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:55.003536 16189 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.207386 16072 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.207212 16161 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.167320 16162 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.209085 16162 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.211310 16162 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:55.192703 16182 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.213644 16018 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:55.215107 15882 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.216390 15882 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.201234 16201 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.220026 16083 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.220227 16096 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:55.191725 15999 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.222551 16096 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:55.222862 16201 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.223309 15999 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:55.197245 16153 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.224603 16153 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.225019 16153 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.224895 16017 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:54.980202 15862 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.188663 12726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1221) took 1227 ms (client timeout 1563 ms). Trace:
I20260709 13:07:55.163705 16157 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:55.237562 12726 rpcz_store.cc:269] 0709 13:07:53.961720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.961896 (+   176us) service_pool.cc:224] Handling call
0709 13:07:55.188435 (+1226539us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400411c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:55.188589 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922407680}
I20260709 13:07:55.143229 15588 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:55.192777 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:55.268973 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 76327.5us
I20260709 13:07:55.269876 12699 leader_election.cc:400] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:07:55.271059 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:55.170708 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.272565 12725 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
W20260709 13:07:55.176280 16084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.012s	sys 0.001s
I20260709 13:07:55.196350 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:07:55.182658 16136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.007s	sys 0.014s
I20260709 13:07:55.171945 15933 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:55.200572 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.201174 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.202232 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.283070 12727 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:07:55.283281 12805 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:55.204761 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 2054) took 1059 ms. Trace:
I20260709 13:07:55.205549 16204 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.205981 16154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.006s	sys 0.011s
I20260709 13:07:55.223670 16027 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.182581 12848 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:55.192485 16119 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.285225 12731 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
W20260709 13:07:55.286339 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90060.1us
I20260709 13:07:55.288831 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:55.284684 12803 rpcz_store.cc:276] 0709 13:07:54.145738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.006311 (+860573us) service_pool.cc:224] Handling call
0709 13:07:55.204673 (+198362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.246951 12771 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:55.279439 16096 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:55.301651 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 119168us
W20260709 13:07:55.280896 16136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.007s	sys 0.014s
I20260709 13:07:55.309757 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:55.311113 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 64339.8us
I20260709 13:07:55.282238 16149 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:55.305174 13520 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:55.312012 12771 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:55.313597 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:07:55.292554 16154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.006s	sys 0.011s
I20260709 13:07:55.306949 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:55.237637 15862 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.316188 16173 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.323733 16212 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.292387 16201 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.327251 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:55.334417 12848 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:55.280546 16143 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.302321 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:55.336975 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 201926us
I20260709 13:07:55.307397 16096 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:55.316721 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:55.324822 16179 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.352686 16180 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.352988 16211 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:55.353910 16181 consensus_queue.cc:1059] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:07:55.354743 16213 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.356159 16127 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:55.357635 16119 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.326259 16157 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.323776 16083 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:55.306419 16168 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.324604 16209 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.342797 15999 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.341547 16185 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.375036 12771 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.961s (SENT)
I20260709 13:07:55.403627 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:55.316470 16084 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:55.292416 16204 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.408294 16204 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.409704 16215 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.410290 16215 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.410559 16206 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:55.410682 16215 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.410979 16206 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:55.412199 16208 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.412703 16208 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.414927 16208 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.415470 16220 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.417063 16065 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.373039 15637 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:55.326040 15928 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:55.419504 16217 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:55.346095 16201 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:55.421422 15928 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.394896 13518 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:55.370556 12733 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.422730 12800 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:55.324064 16097 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:55.391597 16163 consensus_meta.cc:287] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.004s
I20260709 13:07:55.375571 16179 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.411923 16206 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.419062 16144 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.360607 16096 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.443542 16179 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:55.444826 16224 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:55.342047 16149 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.420924 16201 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.395725 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1236) took 1120 ms. Trace:
I20260709 13:07:55.448385 12724 rpcz_store.cc:276] 0709 13:07:54.275411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.698717 (+423306us) service_pool.cc:224] Handling call
0709 13:07:54.698986 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.835279 (+136293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.393127 (+557848us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540030a054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:55.395659 (+  2532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261085056}
I20260709 13:07:55.314210 15933 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.450752 15933 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.429896 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:55.434700 12771 leader_election.cc:336] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.811s (SENT)
I20260709 13:07:55.447597 16149 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:55.455222 12731 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:55.460731 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:55.462139 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:55.463158 12803 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 4: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:55.470594 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.432099 15999 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:55.476317 12731 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:55.409778 15862 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.464658 15944 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.481591 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:55.481801 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:55.482473 16189 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.482848 12805 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:55.483400 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.484011 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1224) took 1369 ms. Trace:
I20260709 13:07:55.483058 16189 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.484445 12728 rpcz_store.cc:276] 0709 13:07:54.114170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.114306 (+   136us) service_pool.cc:224] Handling call
0709 13:07:55.483806 (+1369500us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400062a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:55.483955 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565353728}
I20260709 13:07:55.375869 16180 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.485913 12804 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:07:55.479172 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:55.453753 16185 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.483897 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.436353 16209 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.511986 16209 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.518213 16180 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.481654 15944 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.491492 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.492476 12801 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:55.541356 12801 pending_rounds.cc:85] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 4
I20260709 13:07:55.541888 12801 pending_rounds.cc:107] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:55.542596 12801 raft_consensus.cc:2889] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:55.494081 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.496698 12731 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:55.498834 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.499466 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.400997 16127 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.485240 16126 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:55.502275 15862 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.502559 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:55.557497 12728 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.502291 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:55.503577 16226 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:07:55.480413 15999 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.509217 16143 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.515306 16153 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.546353 12807 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:55.552495 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.480417 16206 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.541412 12799 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:07:55.544188 12804 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
W20260709 13:07:55.554169 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 219836us
I20260709 13:07:55.554039 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:55.570698 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:55.558046 16126 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.557291 15862 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.593259 12800 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:55.593641 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:55.594681 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.602706 12799 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:55.602766 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.593855 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:55.608461 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.563987 16161 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:55.608892 12799 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:55.631660 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:55.590055 16226 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.629189 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:07:55.638839 12728 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:55.594148 16143 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.603470 15862 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.602049 16126 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.643712 16153 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.585892 16176 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:55.635677 16131 consensus_queue.cc:1243] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:55.636524 16226 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.639823 16185 raft_consensus.cc:2764] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:55.668922 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.001s	sys 0.021s
W20260709 13:07:55.670938 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.001s	sys 0.021s
I20260709 13:07:55.638978 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:55.672701 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 535581us
I20260709 13:07:55.636086 16161 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.670994 16226 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:55.685024 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46158.3us
I20260709 13:07:55.686257 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:55.660079 16143 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:55.678797 16137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.008s	sys 0.015s
I20260709 13:07:55.692625 15882 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:55.692625 15933 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.680823 16162 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:55.706990 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.706383 16234 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.710637 16229 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.724851 16229 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:55.725339 16229 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.726599 16219 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:07:55.729332 16230 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:55.730188 16230 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.732260 16189 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.708180 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:55.698678 16137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.008s	sys 0.016s
W20260709 13:07:55.832645 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 115222us
W20260709 13:07:55.837447 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 245416us
W20260709 13:07:55.838974 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116027us
I20260709 13:07:55.818868 16181 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.692891 16157 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.844818 12771 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 3.155s (SENT)
I20260709 13:07:55.832101 16127 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:55.867331 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.716796 15929 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:07:55.832046 15933 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:55.708267 16213 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:07:55.876686 12802 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.877888 12699 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:55.884222 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:55.818608 16162 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.839522 16136 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:55.898908 15928 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.899549 16232 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.876017 15931 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.937769 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 93036.6us
I20260709 13:07:55.938020 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:55.939435 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:55.865556 15890 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:55.897131 15637 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.941347 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2072) took 1092 ms. Trace:
W20260709 13:07:55.940120 12771 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 3.307s (SENT)
I20260709 13:07:55.906349 16158 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.914160 15929 consensus_queue.cc:1243] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:55.876596 16096 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.887780 16157 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:55.955250 16241 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:55.917166 16232 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.961476 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:55.949760 12808 rpcz_store.cc:276] 0709 13:07:54.848388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.134186 (+285798us) service_pool.cc:224] Handling call
0709 13:07:55.134675 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.407774 (+273099us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b18004898e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060 00007f0f41bebbfb 00007f0f41bf664b
0709 13:07:55.407904 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.407928 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.408427 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.640700 (+232273us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:55.884229 (+243529us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.901480 (+ 17251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.904590 (+  3110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.912186 (+  7596us) raft_consensus.cc:1685] finished
0709 13:07:55.920499 (+  8313us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.940647 (+ 20148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62231,"raft.queue_time_us":120324,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":13594,"spinlock_wait_cycles":14251264,"thread_start_us":550913,"threads_started":3,"wal-append.queue_time_us":309540}
I20260709 13:07:55.941342 16065 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:55.950291 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:55.937068 16189 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.943573 15931 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.975342 16230 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:55.977101 16159 raft_consensus.cc:3055] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:55.977732 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:56.059060 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51829.8us
W20260709 13:07:55.978186 16233 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:56.060873 13521 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:55.981825 12807 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:56.061303 12807 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:07:55.916934 16136 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.065590 16096 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.991613 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:55.945729 16168 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:56.068728 16018 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:55.963528 12724 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:56.008993 12725 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:56.070598 16018 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.071130 16018 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:07:55.968555 16017 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:56.071769 16017 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.071961 16136 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:56.072283 16017 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.073365 16250 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.074000 16250 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:55.897759 16181 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:55.936798 15928 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.079512 16181 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.080255 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1244) took 1195 ms. Trace:
I20260709 13:07:56.080663 12733 rpcz_store.cc:276] 0709 13:07:54.884746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.884877 (+   131us) service_pool.cc:224] Handling call
0709 13:07:54.905445 (+ 20568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.422946 (+517501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.079974 (+657028us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b540038ed54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.080186 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069097728}
W20260709 13:07:56.017580 16235 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:07:56.084085 16234 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:56.084590 16234 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.085552 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1213) took 1577 ms. Trace:
I20260709 13:07:56.085686 16234 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.086457 12802 rpcz_store.cc:276] 0709 13:07:54.508403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.902199 (+393796us) service_pool.cc:224] Handling call
0709 13:07:54.911171 (+  8972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.909646 (+998475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.085164 (+175518us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400175cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.085433 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218840832}
I20260709 13:07:56.087390 16234 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.006353 16097 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.031782 16157 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.032692 15933 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.037344 16232 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.039202 15999 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.041090 16162 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:55.990265 15929 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:56.045949 16229 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:56.051100 16215 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260709 13:07:55.961755 15637 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.062960 12696 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:56.060434 16159 raft_consensus.cc:740] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:56.069854 16168 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:55.999925 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:56.070695 12807 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:56.094069 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 83630.8us
W20260709 13:07:56.143282 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 143447us
I20260709 13:07:56.143437 12807 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:56.101909 16237 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.414s	user 0.005s	sys 0.000s
I20260709 13:07:56.079609 15928 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:56.103508 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 226277us
W20260709 13:07:56.154688 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 214642us
I20260709 13:07:56.144961 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:56.149164 15944 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:56.183157 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.120352 16143 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.195701 12808 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:56.101051 16097 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:56.158674 12771 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:07:56.192894 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:56.197065 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:56.197240 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:56.197750 12808 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.197888 12804 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:07:56.122283 15929 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.197731 12799 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:56.214457 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 55907.2us
W20260709 13:07:56.216866 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 154041us
I20260709 13:07:56.220002 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 290) took 1022 ms. Trace:
I20260709 13:07:56.220712 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:56.223431 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:56.220505 13516 rpcz_store.cc:276] 0709 13:07:55.197759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.197924 (+   165us) service_pool.cc:224] Handling call
0709 13:07:55.274015 (+ 76091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.600608 (+326593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.600653 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.600712 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:55.608141 (+  7429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.219736 (+611595us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54006a0c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.219792 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.219935 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689822080}
I20260709 13:07:56.221716 12804 raft_consensus.cc:2376] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10. Re-sending same reply.
I20260709 13:07:56.149959 16168 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:56.229044 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:56.234478 12802 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.231204 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:56.232594 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:56.235673 12808 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
W20260709 13:07:56.228417 12629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 74) took 14279 ms (client timeout 15000 ms). Trace:
I20260709 13:07:56.151950 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1198) took 1791 ms. Trace:
I20260709 13:07:56.160200 16096 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.241106 12799 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:56.162285 16176 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.195358 15588 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.239689 12801 rpcz_store.cc:276] 0709 13:07:54.360699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.360808 (+   109us) service_pool.cc:224] Handling call
0709 13:07:54.402088 (+ 41280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.543280 (+1141192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.151656 (+608376us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001b6a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.151880 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506910976}
I20260709 13:07:56.252465 16207 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.253233 16207 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.219319 16088 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.120339 16018 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.260893 16018 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.233541 16083 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.261176 15999 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.261838 12799 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:07:56.262288 12799 pending_rounds.cc:85] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 3
I20260709 13:07:56.262534 12799 pending_rounds.cc:107] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:07:56.262434 15999 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:56.263017 12799 raft_consensus.cc:2889] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.264278 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:56.213099 16097 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.264462 12806 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.265496 12808 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:56.265508 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48612.6us
I20260709 13:07:56.251940 12807 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:56.268473 12807 pending_rounds.cc:85] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 5
I20260709 13:07:56.268908 12807 pending_rounds.cc:107] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:56.269268 12807 raft_consensus.cc:2889] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.269302 12799 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:56.264298 15588 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.274040 15588 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:56.275259 16126 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.006s
W20260709 13:07:56.275875 16214 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:56.261231 15637 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.276803 15637 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.277719 16229 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:56.277415 15637 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.188903 16027 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:56.276880 16207 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.222636 16174 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:07:56.250175 16206 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.007s
I20260709 13:07:56.142441 16215 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.288636 12799 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:56.322337 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:56.245499 16250 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.283113 12802 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:56.249389 16096 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.142683 15862 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:56.237748 12629 rpcz_store.cc:269] 0709 13:07:41.949309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.949992 (+   683us) service_pool.cc:224] Handling call
0709 13:07:42.093269 (+143277us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b54001c0610. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eacf640 00007f0f479a6b76 00007f0f47ab0c3e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.228293 (+14135024us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:53.602348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:53.603135 (+   787us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:53.603194 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:53.603226 (+    32us) tablet.cc:662] Decoding operations
0709 13:07:53.603957 (+   731us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:53.604064 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:53.604102 (+    38us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:53.604559 (+   457us) tablet.cc:701] Row locks acquired
0709 13:07:53.604626 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:07:53.604818 (+   192us) write_op.cc:270] Start()
0709 13:07:53.604977 (+   159us) write_op.cc:276] Timestamp: P: 1783602473604739 usec, L: 0
0709 13:07:53.604994 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:07:53.605777 (+   783us) log.cc:844] Serialized 1344 byte log entry
0709 13:07:54.132967 (+527190us) op_driver.cc:464] REPLICATION: finished
0709 13:07:54.582826 (+449859us) write_op.cc:301] APPLY: starting
0709 13:07:54.582964 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:54.583179 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:54.583349 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:54.584016 (+   667us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:54.622961 (+ 38945us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:07:54.623028 (+    67us) write_op.cc:312] APPLY: finished
0709 13:07:54.623402 (+   374us) log.cc:844] Serialized 34 byte log entry
0709 13:07:54.623617 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.623730 (+   113us) write_op.cc:454] Released schema lock
0709 13:07:54.623805 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:54.624268 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.624295 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":991954,"reported_tablets":9,"spinlock_wait_cycles":2305792,"child_traces":[["op",{"apply.queue_time_us":424117,"apply.run_cpu_time_us":3089,"apply.run_wall_time_us":47803,"num_ops":3,"prepare.queue_time_us":215925,"prepare.run_cpu_time_us":41519,"prepare.run_wall_time_us":203941,"raft.queue_time_us":157009,"raft.run_cpu_time_us":24164,"raft.run_wall_time_us":395827,"replication_time_us":433227,"spinlock_wait_cycles":9984,"thread_start_us":526909,"threads_started":4,"wal-append.queue_time_us":242278,"wal-append.run_cpu_time_us":15602,"wal-append.run_wall_time_us":1813893}]]}
I20260709 13:07:56.293418 16088 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:07:56.300477 16226 consensus_meta.cc:287] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.007s
I20260709 13:07:56.285422 16223 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:56.251143 16185 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:56.289657 12801 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.275857 16126 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.326704 16096 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.305117 15931 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:56.335961 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.352984 12802 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:56.353715 15931 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.354300 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:56.355029 12802 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:56.355911 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.332531 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:56.332821 16226 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.340422 13513 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:56.340736 16084 raft_consensus.cc:3055] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:56.341876 15862 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.374221 13512 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:56.376619 12771 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:56.376974 12771 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.371331 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:56.378509 12724 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:56.344357 16238 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.398s	user 0.000s	sys 0.005s
I20260709 13:07:56.244861 15929 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.360157 12799 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:07:56.357878 16162 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.357937 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:56.363770 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 485744us
I20260709 13:07:56.387029 12801 pending_rounds.cc:85] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 5
I20260709 13:07:56.387235 12725 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:07:56.387631 12801 pending_rounds.cc:107] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:56.391537 12801 raft_consensus.cc:2889] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.361403 16143 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.331522 16229 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:56.366726 16179 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.365199 13518 raft_consensus.cc:2368] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:56.363933 16161 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:56.354334 15931 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.365962 16084 raft_consensus.cc:740] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:56.363548 16223 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:56.409590 13486 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:56.414561 15862 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.415120 15862 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.415567 15862 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.407042 16185 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:07:56.421751 16256 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:56.422326 16256 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.422631 15931 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.425176 16084 consensus_queue.cc:260] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.427068 16084 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:56.384011 16150 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.325160 16159 consensus_queue.cc:260] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.372349 12802 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:56.446597 12724 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
W20260709 13:07:56.479518 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 63641.6us
I20260709 13:07:56.480667 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:56.428877 16255 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:56.482820 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:56.397593 16162 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.479444 16258 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:56.408445 16143 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.615845 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:56.617486 12724 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.410702 16179 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:56.615803 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 397310us
I20260709 13:07:56.497180 16185 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 13:07:56.629241 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 381425us
I20260709 13:07:56.478538 16150 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.438093 16223 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.500720 15890 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:07:56.580677 15944 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.606019 16226 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.502744 16097 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.659060 12724 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:07:56.423292 16256 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:56.669415 16017 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.003s
I20260709 13:07:56.665086 16234 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.702926 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:56.660972 15637 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:56.712496 12731 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.664598 16209 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:56.631582 16260 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:07:56.711601 16017 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:56.733242 16229 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:56.737533 16017 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.711946 16206 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.718187 16226 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:56.719018 16185 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.710237 16234 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.665999 16264 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:07:56.714723 16215 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.717577 15944 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:56.728951 16256 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:56.747195 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.701570 15588 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.742843 16226 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.723773 16209 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.726856 16096 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:56.783018 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 302477us
I20260709 13:07:56.754065 16206 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:56.785267 16215 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.747337 16185 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.772746 16212 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:56.813534 16168 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 13:07:56.821072 16179 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.821269 16168 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.822314 16096 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.823551 16168 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.813175 16250 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.824455 16250 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.824988 16097 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:56.826099 16162 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.802382 16234 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.827893 16234 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.828122 16215 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:56.829020 16215 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.805562 15882 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.830320 15882 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.832327 15882 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.833734 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 291) took 1293 ms. Trace:
I20260709 13:07:56.834124 13513 rpcz_store.cc:276] 0709 13:07:55.552162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.552358 (+   196us) service_pool.cc:224] Handling call
0709 13:07:55.552797 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.364446 (+811649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.833447 (+469001us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400339ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:56.833658 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809222528}
I20260709 13:07:56.835620 16212 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.836623 16250 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.826738 16226 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:07:56.837587 16226 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.838521 16212 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.839056 16212 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.839457 16212 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.805316 16206 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.841012 16267 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:07:56.841358 16262 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:07:56.842032 16261 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:07:56.879102 16212 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.880434 16143 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.881386 16143 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:56.869464 16275 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.882018 16143 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.882915 16275 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.883689 16150 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.885187 16275 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:56.873611 16018 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:07:56.875526 16267 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.816465 16266 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.844355 16268 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.002s
W20260709 13:07:56.922927 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 442150us
I20260709 13:07:56.873669 16206 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.891225 16209 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.909726 16260 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.930703 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:56.937397 12807 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:07:56.932302 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:56.932861 15588 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.888334 15944 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:56.935299 16267 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.941390 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:56.957057 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.958662 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:56.943583 13513 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:56.915266 16266 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:56.966333 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.935819 15933 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:07:56.966858 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 264077us
I20260709 13:07:56.955943 13512 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:56.969175 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 233203us
I20260709 13:07:56.945182 16206 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.965977 16220 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.953034 16143 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.963267 15588 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:56.942322 16260 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:56.972395 16209 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.962502 16282 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:56.970594 16275 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:56.998448 16283 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.020730 16266 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:57.021871 16280 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:57.001529 16226 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.024866 16282 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.025482 16282 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:56.985903 16220 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.026763 16282 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.029104 16220 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:57.028915 16226 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:57.030171 16273 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:07:57.032929 16185 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:56.993155 15588 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.034775 16260 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:57.034693 16282 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.036691 15588 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:56.985019 16206 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.039178 16206 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:57.008730 15977 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:57.045846 15977 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.001363 16209 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.008561 16212 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.063848 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:57.064735 12877 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.065891 16212 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.068142 16212 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.068089 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:57.068939 12879 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:57.069828 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.066665 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:57.070479 16275 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.070776 12873 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:57.071077 12876 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:57.070979 16275 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.066913 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:57.070056 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.067595 16286 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.074506 16286 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.042037 16283 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:57.075344 16213 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.075969 16213 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:57.076750 15977 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:57.077054 16213 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:57.078183 16286 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:57.078985 15862 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.004s
I20260709 13:07:57.080482 12875 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:57.082058 16223 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:07:57.134516 16240 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.256s	user 0.002s	sys 0.009s
W20260709 13:07:57.136271 16274 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.300s	user 0.005s	sys 0.000s
I20260709 13:07:57.137660 16212 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:57.044215 16226 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:57.079566 15862 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:57.152393 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2076) took 1687 ms. Trace:
I20260709 13:07:57.152948 12803 rpcz_store.cc:276] 0709 13:07:55.465140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.465269 (+   129us) service_pool.cc:224] Handling call
0709 13:07:55.465663 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.547142 (+ 81479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.547197 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.555171 (+  7974us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.683064 (+127893us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:55.943088 (+260024us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.430701 (+487613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.151865 (+721164us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54001b5654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:57.151932 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.151986 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:57.152116 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.152308 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37954,"prepare.queue_time_us":275111,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":49591,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":256,"spinlock_wait_cycles":116164864,"thread_start_us":802928,"threads_started":3,"wal-append.queue_time_us":388584,"wal-append.run_cpu_time_us":2505,"wal-append.run_wall_time_us":1099110}
W20260709 13:07:57.144505 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 185958us
W20260709 13:07:57.179198 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 226479us
I20260709 13:07:57.190691 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.191474 12727 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:57.203064 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.203339 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.338443 12727 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:57.338635 12728 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:57.338675 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.339717 12881 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:07:57.205211 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:57.413501 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.226679 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.456228 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 388813us
I20260709 13:07:57.424626 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.349458 12880 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:57.474586 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:57.203155 15637 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.409121 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.362845 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1214) took 1158 ms. Trace:
I20260709 13:07:57.360380 12877 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:07:57.435077 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.409261 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.409188 12873 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:07:57.362299 13518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 278) took 1883 ms (client timeout 1710 ms). Trace:
I20260709 13:07:57.410730 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.458248 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.453991 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.340966 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2098) took 1146 ms. Trace:
I20260709 13:07:57.449131 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:57.481282 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:57.340863 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:57.484542 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.244074 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1920) took 1183 ms. Trace:
W20260709 13:07:58.244786 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.561384 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.246289 12874 raft_consensus.cc:2410] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 13:07:58.190472 16298 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:07:57.549881 16137 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.926702 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:57.450403 16281 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:58.249631 16281 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:57.657269 13521 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.251684 16281 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:57.520012 12807 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:57.344535 15862 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:57.488582 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:57.472568 12724 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:58.252658 12733 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:58.269666 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.489353 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:57.576104 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.270447 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.270987 12882 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:58.271238 12875 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:58.271462 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 1820) took 1066 ms. Trace:
I20260709 13:07:58.254477 12726 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.272086 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:57.501348 12728 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:58.254472 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:57.616487 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.273942 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:57.683375 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.272001 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1928) took 1206 ms. Trace:
I20260709 13:07:58.274967 12803 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.275270 12875 rpcz_store.cc:276] 0709 13:07:57.168541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.486660 (+318119us) service_pool.cc:224] Handling call
0709 13:07:58.271930 (+785270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.248273 16137 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:58.251752 13518 rpcz_store.cc:269] 0709 13:07:55.478476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.487502 (+  9026us) service_pool.cc:224] Handling call
0709 13:07:57.361930 (+1874428us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54005118d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:57.362141 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854885248}
I20260709 13:07:58.259258 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.285830 12807 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.649088 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.287221 12801 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:57.575752 12806 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:58.289629 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.260210 12731 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.001s	sys 0.009s
I20260709 13:07:58.260102 12732 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.590653 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:58.290370 12731 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.001s	sys 0.010s
I20260709 13:07:58.290814 12881 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:57.582456 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.291895 12727 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:07:58.243829 12808 rpcz_store.cc:276] 0709 13:07:56.204469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.237076 (+ 32607us) service_pool.cc:224] Handling call
0709 13:07:56.265310 (+ 28234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.266038 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.362626 (+1096588us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54000334d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:57.362778 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64144640}
I20260709 13:07:57.626487 16015 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.247288 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.253825 12873 pending_rounds.cc:85] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 3
I20260709 13:07:58.293160 12873 pending_rounds.cc:107] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:58.293572 12873 raft_consensus.cc:2889] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.348275 16209 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:57.425781 16230 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:58.272255 12724 rpcz_store.cc:276] 0709 13:07:57.204895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.204995 (+   100us) service_pool.cc:224] Handling call
0709 13:07:58.271386 (+1066391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.274282 12802 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.275012 12729 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:58.244942 12880 rpcz_store.cc:276] 0709 13:07:57.060813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.060928 (+   115us) service_pool.cc:224] Handling call
0709 13:07:57.348923 (+287995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.243714 (+894791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.243987 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.345469 16275 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:57.787123 15929 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.255409 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1927) took 1192 ms. Trace:
I20260709 13:07:58.324585 12877 rpcz_store.cc:276] 0709 13:07:57.063378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.063511 (+   133us) service_pool.cc:224] Handling call
0709 13:07:58.255338 (+1191827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.276669 12800 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.697057 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:58.325659 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.270480 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.256223 12725 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:57.343155 16283 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.256618 12804 rpcz_store.cc:276] 0709 13:07:56.194961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.230013 (+ 35052us) service_pool.cc:224] Handling call
0709 13:07:56.230455 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.324652 (+ 94197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.324689 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.339339 (+ 14650us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.711660 (+372321us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:56.711709 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.711787 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.135438 (+423651us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:07:57.137597 (+  2159us) raft_consensus.cc:1685] finished
0709 13:07:57.137622 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.340899 (+203277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105053,"raft.queue_time_us":94069,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7798,"spinlock_wait_cycles":78030592,"thread_start_us":330895,"threads_started":1,"wal-append.queue_time_us":451671,"wal-append.run_cpu_time_us":7356,"wal-append.run_wall_time_us":1318705}
I20260709 13:07:57.402513 16223 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.357475 16213 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.206007 16234 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:58.280715 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.268433 16281 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.379062 16258 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.739037 16215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.022s	sys 0.013s
I20260709 13:07:57.928119 13520 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 14. Ops: []
I20260709 13:07:57.373039 16159 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:58.295758 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.295840 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:57.365355 16126 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:57.350992 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:58.297297 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.329339 16275 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.301671 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.308673 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.373924 12806 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.374185 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.252349 15637 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:58.310207 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.375730 12727 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:58.310012 16015 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.310936 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.378206 12882 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:07:57.576557 15977 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.549222 16144 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:07:58.284373 13512 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:58.268395 12630 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 3 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.382531 12803 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:07:58.383575 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.310050 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.384207 12803 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.379151 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.387138 12882 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:58.338568 16234 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:07:58.388329 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.389066 12882 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.318657 16137 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.319422 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.320536 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.322533 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.393158 12801 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:58.323240 12732 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:07:57.896857 16212 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:57.425776 16255 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.327677 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.328006 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:57.425503 16181 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.876s
I20260709 13:07:58.328606 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.325590 16230 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.325861 13516 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:07:58.330137 12805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.002s	sys 0.018s
W20260709 13:07:58.337734 12772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.015s	sys 0.016s
W20260709 13:07:58.405092 12772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.016s
I20260709 13:07:58.408280 12882 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
W20260709 13:07:58.356374 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4175515580000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 13:07:58.359045 12802 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:58.363305 12879 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:07:58.364464 12807 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
W20260709 13:07:58.369473 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.369359 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.297919 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.371290 12726 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
W20260709 13:07:58.372701 13486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.010s	sys 0.032s
I20260709 13:07:58.374902 12808 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
W20260709 13:07:58.348279 16215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.516s	user 0.046s	sys 0.019s
I20260709 13:07:58.294584 16250 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.347433 16209 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.379642 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 307) took 1039 ms. Trace:
I20260709 13:07:58.379172 16144 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.397222 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.397646 12800 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:58.431563 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.431685 12881 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:58.400163 12804 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.400350 12877 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:58.432224 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.433619 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.281469 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.434235 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.434607 12878 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:58.435060 12800 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:58.435101 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1938) took 1023 ms. Trace:
I20260709 13:07:58.435557 12878 rpcz_store.cc:276] 0709 13:07:57.411734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.280492 (+868758us) service_pool.cc:224] Handling call
0709 13:07:58.435039 (+154547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.435926 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.436462 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.437134 12878 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:58.401117 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:07:58.438067 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:07:58.420611 13486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.011s	sys 0.033s
I20260709 13:07:58.354179 16258 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:58.421904 12805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.007s	sys 0.018s
W20260709 13:07:58.421373 12696 connection.cc:256] RPC call timeout handler was delayed by -1.2644632819999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:07:58.423350 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 263) took 1001 ms. Trace:
I20260709 13:07:58.424324 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2061) took 1001 ms. Trace:
I20260709 13:07:58.424698 12730 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:58.422247 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.348667 16223 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.400118 16293 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:58.427933 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:07:58.400910 16137 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.430181 12806 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:07:58.355983 16281 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.398104 15977 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.465027 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.465796 12881 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:58.466226 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1939) took 1054 ms. Trace:
I20260709 13:07:58.466539 12881 rpcz_store.cc:276] 0709 13:07:57.471476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.432848 (+961372us) service_pool.cc:224] Handling call
0709 13:07:58.466161 (+ 33313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.389134 16275 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.445959 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.449393 12875 raft_consensus.cc:2393] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:07:58.422793 12774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.001s	sys 0.028s
I20260709 13:07:58.445122 12724 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:58.448657 12882 rpcz_store.cc:276] 0709 13:07:57.421855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.387957 (+966102us) service_pool.cc:224] Handling call
0709 13:07:58.423279 (+ 35322us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.473343 12774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.001s	sys 0.028s
I20260709 13:07:58.448791 12879 rpcz_store.cc:276] 0709 13:07:57.423200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.253487 (+830287us) service_pool.cc:224] Handling call
0709 13:07:58.424254 (+170767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.448225 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:58.448498 12696 connection.cc:256] RPC call timeout handler was delayed by -1.2638801819999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:07:58.426460 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:58.474309 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0802816059999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:07:58.474704 12880 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:58.457142 16127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.015s	sys 0.020s
I20260709 13:07:58.475970 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:58.474732 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0615818919999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:07:58.386029 15637 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.481948 12875 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:58.460770 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.461943 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.462860 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.485174 12806 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:58.468416 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:07:58.469766 12800 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.473278 12877 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 4.
I20260709 13:07:58.486449 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.427300 16201 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:58.440737 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.495548 12807 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:58.480911 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.441207 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:58.467586 16293 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.487141 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1940) took 1015 ms. Trace:
I20260709 13:07:58.450038 16126 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.491806 12630 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 6, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.496860 12882 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:58.505406 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 261) took 1084 ms. Trace:
I20260709 13:07:58.505741 12882 rpcz_store.cc:276] 0709 13:07:57.421368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.480593 (+1059225us) service_pool.cc:224] Handling call
0709 13:07:58.505338 (+ 24745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.506711 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.506832 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.507457 12882 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:07:58.497576 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.507700 12807 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:07:58.488766 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1946) took 1015 ms. Trace:
I20260709 13:07:58.508417 12880 rpcz_store.cc:276] 0709 13:07:57.473581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.395998 (+922417us) service_pool.cc:224] Handling call
0709 13:07:58.488674 (+ 92676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.500919 12803 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:58.477259 16127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.016s	sys 0.021s
I20260709 13:07:58.501330 12799 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
W20260709 13:07:58.497648 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56508.9us
I20260709 13:07:58.514621 12800 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:58.515327 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.516283 12732 raft_consensus.cc:2410] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:58.518046 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.518055 12807 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:58.518879 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 260) took 1097 ms. Trace:
I20260709 13:07:58.519261 12882 rpcz_store.cc:276] 0709 13:07:57.421127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.517789 (+1096662us) service_pool.cc:224] Handling call
0709 13:07:58.518807 (+  1018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.502967 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.501197 15637 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.520473 12879 raft_consensus.cc:2376] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
I20260709 13:07:58.521057 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 256) took 1101 ms. Trace:
I20260709 13:07:58.499516 12877 rpcz_store.cc:276] 0709 13:07:57.471992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.445707 (+973715us) service_pool.cc:224] Handling call
0709 13:07:58.487071 (+ 41364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.427320 13512 rpcz_store.cc:276] 0709 13:07:57.340301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.340482 (+   181us) service_pool.cc:224] Handling call
0709 13:07:58.379508 (+1039026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.433379 16209 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.512470 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.407536 16255 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.538574 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.543267 12800 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:58.545169 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.520939 13513 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:07:58.522121 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.429339 16250 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.532681 12804 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
I20260709 13:07:58.534729 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.536628 12732 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:58.537492 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.538563 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:58.547071 16301 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:58.551930 16144 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.522393 16126 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.502010 16212 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:58.560657 12799 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:58.521417 12879 rpcz_store.cc:276] 0709 13:07:57.419894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.476254 (+1056360us) service_pool.cc:224] Handling call
0709 13:07:58.520997 (+ 44743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.560667 12877 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:58.539695 13487 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:58.473122 16137 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.583200 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.584075 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2062) took 1160 ms. Trace:
I20260709 13:07:58.584365 12877 rpcz_store.cc:276] 0709 13:07:57.423456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.582843 (+1159387us) service_pool.cc:224] Handling call
0709 13:07:58.583995 (+  1152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.584829 16137 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.563856 12880 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:07:58.573164 12873 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:58.585917 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1948) took 1111 ms. Trace:
I20260709 13:07:58.570858 12803 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:07:58.586376 12880 rpcz_store.cc:276] 0709 13:07:57.474026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.509095 (+1035069us) service_pool.cc:224] Handling call
0709 13:07:58.585862 (+ 76767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.572603 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.464577 16234 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.586165 12806 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:58.585253 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.589926 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.595285 16293 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.596513 16304 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.525297 15862 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:58.629863 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 259) took 1209 ms. Trace:
I20260709 13:07:58.630394 12873 rpcz_store.cc:276] 0709 13:07:57.420841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.295163 (+874322us) service_pool.cc:224] Handling call
0709 13:07:58.629609 (+334446us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54003a0054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:58.629775 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433795840}
I20260709 13:07:58.502517 16201 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.610909 12877 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:07:58.613165 12882 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:58.617200 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.641533 12880 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:58.641621 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1956) took 1154 ms. Trace:
I20260709 13:07:58.621441 16250 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:58.643711 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.644256 12876 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:58.644601 12876 pending_rounds.cc:85] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 5
I20260709 13:07:58.622900 16297 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:58.571141 16306 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:58.616007 12630 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.635262 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.628309 16275 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:58.587174 16144 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:58.646248 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.644637 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1937) took 1233 ms. Trace:
I20260709 13:07:58.667016 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.667663 12880 rpcz_store.cc:276] 0709 13:07:57.411426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.643431 (+1232005us) service_pool.cc:224] Handling call
0709 13:07:58.644583 (+  1152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.668768 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.633401 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:58.626052 16281 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.626919 16258 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.669989 12732 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
I20260709 13:07:58.669389 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.669348 12880 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:07:58.586777 16015 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.585253 16255 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.598191 16126 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:58.672068 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.658370 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.672747 13486 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:58.673242 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.674288 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.675469 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.676016 12880 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.600497 15977 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.685997 15977 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.598502 16223 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.585350 16137 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:58.642235 12877 rpcz_store.cc:276] 0709 13:07:57.486760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.585004 (+1098244us) service_pool.cc:224] Handling call
0709 13:07:58.641535 (+ 56531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.585549 16127 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:58.705618 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.706640 12877 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:58.670710 12879 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:07:58.656493 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1947) took 1182 ms. Trace:
I20260709 13:07:58.708313 12882 rpcz_store.cc:276] 0709 13:07:57.473813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.572278 (+1098465us) service_pool.cc:224] Handling call
0709 13:07:58.656274 (+ 83996us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400381b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:58.656418 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59433344}
I20260709 13:07:58.709666 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.649744 12876 pending_rounds.cc:107] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:58.710824 12876 raft_consensus.cc:2889] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.682310 16126 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:58.682816 16258 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:58.685086 16209 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.661413 16234 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.661617 16293 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.686748 15977 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.697922 13513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 293) took 1347 ms. Trace:
I20260709 13:07:58.733572 16293 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.734052 13513 rpcz_store.cc:276] 0709 13:07:57.350478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.350643 (+   165us) service_pool.cc:224] Handling call
0709 13:07:58.697683 (+1347040us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400770454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:58.697840 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292726656}
I20260709 13:07:58.735003 15977 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.639761 16304 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.713075 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.717943 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1930) took 1310 ms. Trace:
I20260709 13:07:58.728881 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.730757 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.662415 16297 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:58.742288 16304 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:58.742228 16297 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:58.743242 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.738382 12881 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:07:58.715070 16126 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.746318 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.746934 12877 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.744537 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2066) took 1291 ms. Trace:
I20260709 13:07:58.692340 16144 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.747627 12881 rpcz_store.cc:276] 0709 13:07:57.453045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.467254 (+1014209us) service_pool.cc:224] Handling call
0709 13:07:58.744467 (+277213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.744259 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:07:58.748952 12882 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:58.749265 12882 raft_consensus.cc:614] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:58.660264 16306 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.743666 16305 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.741076 16293 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.757544 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57450 (request call id 8) took 1262 ms. Trace:
I20260709 13:07:58.759783 12882 rpcz_store.cc:276] 0709 13:07:57.487092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.744139 (+1257047us) service_pool.cc:224] Handling call
0709 13:07:58.749606 (+  5467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.737905 12876 rpcz_store.cc:276] 0709 13:07:57.407918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.408133 (+   215us) service_pool.cc:224] Handling call
0709 13:07:57.408690 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.711469 (+1302779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.717615 (+  6146us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400047254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:07:58.717865 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841014144}
I20260709 13:07:58.763585 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1936) took 1340 ms. Trace:
I20260709 13:07:58.764184 12881 rpcz_store.cc:276] 0709 13:07:57.411106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.749928 (+1338822us) service_pool.cc:224] Handling call
0709 13:07:58.750211 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.750593 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:58.750634 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.750692 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:58.750742 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.750819 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.750962 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114}
I20260709 13:07:58.775605 12879 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.777042 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.781477 12880 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:58.782872 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.784545 12880 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.785246 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2060) took 1362 ms. Trace:
I20260709 13:07:58.785652 12880 rpcz_store.cc:276] 0709 13:07:57.422940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.783943 (+1361003us) service_pool.cc:224] Handling call
0709 13:07:58.784307 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.784961 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.785181 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.807893 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1935) took 1397 ms. Trace:
I20260709 13:07:58.808471 12879 rpcz_store.cc:276] 0709 13:07:57.410765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.747103 (+1336338us) service_pool.cc:224] Handling call
0709 13:07:58.775346 (+ 28243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.807576 (+ 32230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.807816 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.810230 12882 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:58.810810 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2069) took 1161 ms. Trace:
I20260709 13:07:58.811147 12882 rpcz_store.cc:276] 0709 13:07:57.650824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.809673 (+1158849us) service_pool.cc:224] Handling call
0709 13:07:58.809933 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.810580 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.810742 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.814307 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:58.745034 16230 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:58.748142 16126 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.712697 16137 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:58.826913 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.728169 16258 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:58.833505 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 258) took 1413 ms. Trace:
I20260709 13:07:58.845855 12881 rpcz_store.cc:276] 0709 13:07:57.420544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.765505 (+1344961us) service_pool.cc:224] Handling call
0709 13:07:58.832965 (+ 67460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.833158 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.833180 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.833222 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:58.833251 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.833305 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.833436 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.847378 12848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.006s
W20260709 13:07:58.849937 12848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.008s	sys 0.006s
W20260709 13:07:58.851068 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.759559 16305 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:58.859388 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:58.868592 12696 leader_election.cc:400] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:58.869097 12696 leader_election.cc:403] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.869259 12881 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:07:58.870431 12846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.002s	sys 0.022s
W20260709 13:07:58.871593 12846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.022s
I20260709 13:07:58.849188 16212 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:07:58.866401 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.874307 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 338616us
W20260709 13:07:58.875315 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.885365 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:58.864708 12877 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:07:58.887797 12877 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:58.889168 12806 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:58.890395 12873 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:07:58.893481 12873 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:58.894403 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:07:58.895037 12731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.017s
I20260709 13:07:58.860576 16161 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:07:58.896415 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 356820us
W20260709 13:07:58.897025 12731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.005s	sys 0.018s
I20260709 13:07:58.900684 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:58.901624 12845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.020s	sys 0.020s
W20260709 13:07:58.902025 12845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.020s	sys 0.020s
I20260709 13:07:58.907759 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:58.925105 12630 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 1 to 5, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:58.926558 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.004s	sys 0.016s
W20260709 13:07:58.927134 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.004s	sys 0.016s
I20260709 13:07:58.932343 12877 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:58.938405 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46086us
I20260709 13:07:58.938879 12873 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:58.943272 12877 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:58.945086 12877 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:58.946559 12877 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:58.941022 12873 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:58.935243 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:58.869700 16293 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:58.931916 15637 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.012454 16201 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:07:59.016228 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 85818.9us
W20260709 13:07:59.017062 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 122755us
W20260709 13:07:59.005359 16303 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:07:59.026940 12845 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:58.985868 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:59.036113 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.038694 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.039553 12728 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:07:58.942000 16209 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.020659 16250 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.927080 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:59.077128 12727 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.017541 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:58.941000 16312 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:07:59.014287 16320 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:07:59.081624 12733 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:59.072793 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 137661us
I20260709 13:07:58.907629 16161 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:59.096980 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45919.2us
I20260709 13:07:59.097270 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:59.015426 15637 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:59.106267 12696 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.585s (SENT)
I20260709 13:07:59.106755 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:59.104650 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.099066 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1821) took 1839 ms. Trace:
I20260709 13:07:59.108440 12731 rpcz_store.cc:276] 0709 13:07:57.260071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.317922 (+ 57851us) service_pool.cc:224] Handling call
0709 13:07:57.318373 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.318652 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:58.290968 (+972316us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.968529 (+677561us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.097971 (+129442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.098764 (+   793us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:59.098824 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.098901 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.099004 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19282,"prepare.queue_time_us":1090329,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":5854,"raft.queue_time_us":124222,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14741,"thread_start_us":1670817,"threads_started":4}
I20260709 13:07:59.109494 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.112416 12727 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:07:59.124629 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 138890us
I20260709 13:07:59.083564 16209 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:59.086647 16144 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:59.142388 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:59.133402 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 106491us
I20260709 13:07:59.041644 16275 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:07:59.129798 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.085908 16223 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:59.139820 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 119847us
I20260709 13:07:59.018679 16212 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.108381 16316 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.164999 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1832) took 1493 ms. Trace:
I20260709 13:07:59.015771 16305 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.141759 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:59.086450 16255 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:07:59.099067 13512 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:07:59.142208 16209 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.177565 12725 rpcz_store.cc:276] 0709 13:07:57.671648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.339237 (+667589us) service_pool.cc:224] Handling call
0709 13:07:58.340480 (+  1243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.341041 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:58.855779 (+514738us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.164506 (+308727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.164588 (+    82us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.164649 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.164746 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.164913 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121247,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":54,"raft.queue_time_us":170205,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":32885,"thread_start_us":785180,"threads_started":3,"wal-append.queue_time_us":161510}
I20260709 13:07:59.312107 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.120844 16311 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.183257 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86031.4us
I20260709 13:07:59.334215 12773 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:07:59.183769 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.334432 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:07:59.336148 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:07:59.339241 16319 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:07:59.340060 12731 raft_consensus.cc:2410] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:59.341045 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.342123 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.342684 12731 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
I20260709 13:07:59.343221 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2100) took 1833 ms. Trace:
I20260709 13:07:59.343540 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.176831 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:07:59.138222 16306 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:59.225864 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.343760 12805 rpcz_store.cc:276] 0709 13:07:57.509695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.509802 (+   107us) service_pool.cc:224] Handling call
0709 13:07:57.625958 (+116156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.448282 (+822324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.448313 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.448823 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.860128 (+411305us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:58.860176 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.860255 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.342966 (+482711us) raft_consensus.cc:1685] finished
0709 13:07:59.342988 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.343141 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":695882,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5512,"thread_start_us":1205766,"threads_started":2,"wal-append.queue_time_us":549017}
W20260709 13:07:59.268913 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 143297us
I20260709 13:07:59.194399 16316 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:59.213222 15929 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.002s
I20260709 13:07:59.142625 16250 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:59.304536 13484 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.397s (SENT) [suppressed 52 similar messages]
I20260709 13:07:59.098518 16312 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:59.172407 16144 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:59.397254 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 92776.8us
I20260709 13:07:59.398304 12875 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:07:59.306740 13518 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:07:59.344148 16330 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.258s	user 0.000s	sys 0.014s
I20260709 13:07:59.406458 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.190923 15637 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:07:59.332005 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.350553 12727 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.363804 12733 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
W20260709 13:07:59.347687 16213 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.000s
W20260709 13:07:59.409283 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45329us
I20260709 13:07:59.304922 15977 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.366849 12771 leader_election.cc:336] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.640s (SENT)
I20260709 13:07:59.363071 12725 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:07:59.431031 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.331501 16275 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:59.441768 15637 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:59.443012 12874 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:59.443101 15637 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:59.449376 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2070) took 1733 ms. Trace:
W20260709 13:07:59.450953 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.449999 12882 rpcz_store.cc:276] 0709 13:07:57.720355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.811867 (+1091512us) service_pool.cc:224] Handling call
0709 13:07:58.812474 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.812732 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:59.013268 (+200536us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.448959 (+435691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.449021 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:59.449086 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.449165 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.449311 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25389,"prepare.queue_time_us":291379,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"thread_start_us":573776,"threads_started":2}
I20260709 13:07:59.464277 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.465235 12733 raft_consensus.cc:2393] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 7: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:07:59.465711 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2074) took 1326 ms. Trace:
I20260709 13:07:59.466122 12876 rpcz_store.cc:276] 0709 13:07:58.139254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.844999 (+705745us) service_pool.cc:224] Handling call
0709 13:07:58.857645 (+ 12646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.857913 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:59.026051 (+168138us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.465383 (+439332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.465440 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:59.465492 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.465553 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.465658 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14554,"prepare.queue_time_us":246450,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":14660,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":572165,"threads_started":2}
W20260709 13:07:59.473709 12802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.045s
W20260709 13:07:59.474292 12802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.045s
I20260709 13:07:59.399085 16250 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.408430 16230 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.417522 16258 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:59.406173 16144 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:59.168390 16223 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.521521 16144 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.416417 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:59.308007 16309 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.523603 16309 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.525451 16309 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.523655 12805 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
W20260709 13:07:59.527943 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.448607 15929 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.436682 16137 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:59.487264 16250 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.442344 16275 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:07:59.516131 12881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.003s
W20260709 13:07:59.529278 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 162489us
I20260709 13:07:59.531432 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 277) took 1406 ms. Trace:
I20260709 13:07:59.556269 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:59.564106 12805 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:07:59.395274 16311 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:07:59.533843 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 202370us
I20260709 13:07:59.535784 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:07:59.576134 12806 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:59.536484 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.567014 12727 raft_consensus.cc:2410] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:59.444640 15977 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:59.562613 12802 rpcz_store.cc:276] 0709 13:07:58.125061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.456381 (+331320us) service_pool.cc:224] Handling call
0709 13:07:58.459887 (+  3506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.462371 (+  2484us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:58.860909 (+398538us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.530870 (+669961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.530987 (+   117us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:59.531055 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.531164 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.531349 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1046236,"raft.queue_time_us":108,"spinlock_wait_cycles":39490176,"thread_start_us":984596,"threads_started":2}
W20260709 13:07:59.561316 12881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.005s	sys 0.003s
I20260709 13:07:59.521935 16223 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:59.584124 16327 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:07:59.586272 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:07:59.654208 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68020.6us
W20260709 13:07:59.587543 16328 log.cc:927] Time spent T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:07:59.587473 16213 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:59.555855 16347 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.588967 16351 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.595610 16275 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:59.598481 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.551954 16312 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:59.515015 16230 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:59.660672 16126 consensus_meta.cc:287] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 13:07:59.709395 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:59.709924 12771 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.851s (SENT)
I20260709 13:07:59.550557 15929 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:59.710650 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:59.711851 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:59.677834 16307 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.015s
I20260709 13:07:59.680920 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:07:59.722491 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:59.685194 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1943) took 2212 ms. Trace:
W20260709 13:07:59.686414 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 511657us
I20260709 13:07:59.541611 16306 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.652398 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.725502 12727 raft_consensus.cc:2410] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:59.700456 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 302398us
I20260709 13:07:59.725867 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:59.657049 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:59.731566 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:07:59.733332 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 76363.5us
I20260709 13:07:59.739126 16316 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:59.745622 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.734407 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:59.747366 12728 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.741010 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.749902 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:59.750602 12882 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.749636 12732 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:07:59.689321 16335 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.724552 12879 rpcz_store.cc:276] 0709 13:07:57.472890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.809197 (+1336307us) service_pool.cc:224] Handling call
0709 13:07:58.853985 (+ 44788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.854543 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.854585 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.855222 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.930670 (+ 75448us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:59.443716 (+513046us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.684703 (+240987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.684823 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.684887 (+    64us) raft_consensus.cc:1685] finished
0709 13:07:59.684907 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.685110 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18895,"prepare.queue_time_us":263694,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":68,"raft.queue_time_us":20591,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":3900,"thread_start_us":732134,"threads_started":3,"wal-append.queue_time_us":724392}
I20260709 13:07:59.678694 16201 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:07:59.687176 16341 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:59.755177 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:07:59.735123 16307 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.015s
I20260709 13:07:59.787307 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:07:59.788439 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:59.755280 16159 consensus_meta.cc:287] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.393s	user 0.016s	sys 0.000s
W20260709 13:07:59.790235 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 63566.1us
W20260709 13:07:59.792130 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 66407us
I20260709 13:07:59.790776 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:59.796592 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:59.731485 16311 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:59.745738 15862 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.747177 16126 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.808741 16275 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.792661 16351 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.795187 16201 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:07:59.797137 16305 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.790717 16348 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:59.832015 12874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1944) took 2358 ms (client timeout 1788 ms). Trace:
I20260709 13:07:59.755074 16312 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:59.755872 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:59.745913 16324 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.840440 12882 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:07:59.898604 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:07:59.904631 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.905905 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:59.906620 12882 raft_consensus.cc:2376] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
I20260709 13:07:59.907613 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:59.815846 16328 log.cc:927] Time spent T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:59.689347 16347 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.752936 16355 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:59.879724 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 143375us
I20260709 13:07:59.792550 16316 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.753827 16317 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:59.897843 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:59.899377 12874 rpcz_store.cc:269] 0709 13:07:57.473113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.300184 (+827071us) service_pool.cc:224] Handling call
0709 13:07:59.831642 (+1531458us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003a07d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:07:59.831900 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402893184}
I20260709 13:07:59.932369 12873 raft_consensus.cc:2376] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7. Re-sending same reply.
I20260709 13:07:59.752664 16306 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.874877 15944 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.933416 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:07:59.904374 16331 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.513s	user 0.001s	sys 0.001s
I20260709 13:07:59.914033 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:07:59.916220 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.899308 16348 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.893519 15862 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:07:59.899991 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:59.934480 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.798259 16338 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:07:59.933054 13513 raft_consensus.cc:2368] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:07:59.916458 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:07:59.939980 13487 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:07:59.912158 16312 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.941154 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.932053 16320 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.942777 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.963728 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1941) took 2491 ms. Trace:
I20260709 13:07:59.964226 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:07:59.943485 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 187716us
I20260709 13:07:59.943825 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.965513 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:07:59.931891 16316 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.944780 16311 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.945333 16126 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:59.894410 16351 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:07:59.951258 15977 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:07:59.942346 15862 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:07:59.961109 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61196.4us
W20260709 13:07:59.961767 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45389.3us
I20260709 13:07:59.966167 12879 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
W20260709 13:07:59.944170 16325 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:59.964116 12880 rpcz_store.cc:276] 0709 13:07:57.472298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.786540 (+1314242us) service_pool.cc:224] Handling call
0709 13:07:58.786961 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.787524 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.787549 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.788149 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.881627 (+ 93478us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.018225 (+136598us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.019211 (+   986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.019298 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.963514 (+944216us) raft_consensus.cc:1685] finished
0709 13:07:59.963536 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.963672 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6736,"prepare.queue_time_us":286839,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":4777,"raft.queue_time_us":54999,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":21537,"thread_start_us":183345,"threads_started":2,"wal-append.queue_time_us":389421}
I20260709 13:07:59.970760 15929 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:07:59.970693 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:07:59.972949 16350 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:59.974308 16144 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.976791 16306 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:07:59.963505 12874 raft_consensus.cc:2376] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9. Re-sending same reply.
W20260709 13:07:59.980959 16354 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:59.940323 15944 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:07:59.984671 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:07:59.985781 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 170280us
W20260709 13:07:59.986956 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.098291 12726 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:00.098680 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.948004 16234 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.212s	user 0.015s	sys 0.000s
W20260709 13:07:59.998600 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.947623 16348 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.016012 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:00.120834 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 104916us
I20260709 13:08:00.121793 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:00.122838 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.123730 16360 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.124346 16360 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.124583 15929 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:00.124708 16360 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.125257 15929 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.125691 15929 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.004801 16311 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.128338 16311 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.963011 16312 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.008808 16316 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.986183 16337 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.022504 12805 raft_consensus.cc:3060] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.021046 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:07:59.987893 16159 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.099265 12873 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:00.105836 12725 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:00.105808 16338 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.106596 16223 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.110249 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.151402 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.113155 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2076) took 1789 ms. Trace:
I20260709 13:07:59.945343 16341 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:00.155033 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.155373 16341 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.156488 16223 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.159227 16201 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.018036 16351 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:00.019804 16297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.013s	sys 0.022s
I20260709 13:08:00.130828 12878 raft_consensus.cc:2410] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:00.136544 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 412) took 1331 ms. Trace:
I20260709 13:08:00.176605 12730 rpcz_store.cc:276] 0709 13:07:58.805006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.805800 (+   794us) service_pool.cc:224] Handling call
0709 13:07:58.806207 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.806652 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.806691 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.834172 (+ 27481us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.968990 (+134818us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:58.969047 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.969149 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.136267 (+1167118us) raft_consensus.cc:1685] finished
0709 13:08:00.136297 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.136472 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":581,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":28531,"thread_start_us":100453,"threads_started":1,"wal-append.queue_time_us":298667}
W20260709 13:08:00.135852 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 302332us
W20260709 13:08:00.141577 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120570us
I20260709 13:08:00.145092 12731 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.152732 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.180751 12880 raft_consensus.cc:2376] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6. Re-sending same reply.
I20260709 13:08:00.181773 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.183231 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.148151 16234 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.011266 16320 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:00.162454 12874 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:00.163560 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.189325 12804 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:00.190383 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.191020 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:00.164589 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.152299 12881 rpcz_store.cc:276] 0709 13:07:58.324004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.870335 (+546331us) service_pool.cc:224] Handling call
0709 13:07:58.892727 (+ 22392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.908526 (+ 15799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.908554 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.909137 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:07:59.604190 (+695053us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.704312 (+100122us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.711744 (+  7432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.711815 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.112792 (+400977us) raft_consensus.cc:1685] finished
0709 13:08:00.112826 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.113060 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18044,"prepare.queue_time_us":104175,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":23495,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":13135,"thread_start_us":590686,"threads_started":1,"wal-append.queue_time_us":753125}
I20260709 13:08:00.193114 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.193866 12799 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:00.174858 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.130002 16347 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:00.185233 12878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 257) took 2765 ms (client timeout 2150 ms). Trace:
I20260709 13:08:00.156370 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:00.195600 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 92344.8us
I20260709 13:08:00.186003 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.153252 16340 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:00.196405 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:00.142961 16337 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:00.176342 16297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.013s	sys 0.022s
I20260709 13:08:00.195813 12803 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:00.205442 15637 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.219079 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.191908 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.235392 15637 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.236354 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:00.233206 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.196743 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.237783 12879 raft_consensus.cc:2410] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:08:00.195837 12878 rpcz_store.cc:269] 0709 13:07:57.420230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.447748 (+1027518us) service_pool.cc:224] Handling call
0709 13:08:00.185007 (+1737259us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400208ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:00.185153 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3809230592}
W20260709 13:08:00.240644 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44323.6us
I20260709 13:08:00.239313 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.241802 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.242187 12881 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:00.240751 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:00.244025 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.169137 16161 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.025614 16359 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:08:00.252696 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.247705 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.261199 12880 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:00.220063 16213 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.265367 16213 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.274210 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.274974 12881 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:00.275929 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.277050 12881 raft_consensus.cc:2368] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:08:00.278083 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.280341 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 410) took 1642 ms. Trace:
I20260709 13:08:00.273154 12878 raft_consensus.cc:2376] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10. Re-sending same reply.
I20260709 13:08:00.280767 12728 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:00.280784 12724 rpcz_store.cc:276] 0709 13:07:58.637764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.638060 (+   296us) service_pool.cc:224] Handling call
0709 13:07:58.638463 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.638735 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.638794 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.647521 (+  8727us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.899324 (+251803us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.899352 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.899399 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.280074 (+1380675us) raft_consensus.cc:1685] finished
0709 13:08:00.280102 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.280283 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":249790,"threads_started":1,"wal-append.queue_time_us":1053584}
I20260709 13:08:00.233083 15977 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:00.275856 12805 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:08:00.239143 16337 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.219180 16364 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.264077 16314 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.263504 16126 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:00.349714 16144 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:00.351408 16309 consensus_meta.cc:287] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.004s
I20260709 13:08:00.352674 16309 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.354224 12807 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:08:00.354947 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.272840 15862 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.356443 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.357798 12807 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:08:00.298319 13487 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:00.358491 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:00.312985 16209 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.939s	user 0.011s	sys 0.003s
I20260709 13:08:00.365234 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.315591 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:00.317876 16320 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.317610 15929 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.322149 12806 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:00.321882 16316 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.327507 16335 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 13:08:00.249357 16201 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:08:00.415015 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.333930 16255 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:00.320251 12726 raft_consensus.cc:2468] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7.
I20260709 13:08:00.336573 15944 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.341200 13513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 308) took 1460 ms (client timeout 1904 ms). Trace:
W20260709 13:08:00.420451 13513 rpcz_store.cc:269] 0709 13:07:58.880608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.887426 (+  6818us) service_pool.cc:224] Handling call
0709 13:08:00.340875 (+1453449us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540036cc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:00.341122 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848016256}
I20260709 13:08:00.279727 16161 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:08:00.292887 16359 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.343420 16234 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:00.344959 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:00.345319 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1267) took 1172 ms. Trace:
I20260709 13:08:00.347019 16379 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.351444 16213 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.298185 15977 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.315201 16369 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:08:00.367038 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:00.380365 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 86365.7us
I20260709 13:08:00.415874 12879 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:00.426277 12724 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 4.
I20260709 13:08:00.426167 12727 rpcz_store.cc:276] 0709 13:07:59.172941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.838744 (+665803us) service_pool.cc:224] Handling call
0709 13:07:59.941445 (+102701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.963569 (+ 22124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.963602 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.964170 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.201566 (+237396us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.201631 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.201749 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.345063 (+143314us) raft_consensus.cc:1685] finished
0709 13:08:00.345085 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.345252 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7933,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":97135,"threads_started":1,"wal-append.queue_time_us":320021}
I20260709 13:08:00.439595 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.440678 12879 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:00.441994 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:00.331352 16311 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.444136 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.440336 13486 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:00.446235 12879 raft_consensus.cc:2393] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:00.378997 16340 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:00.418174 16335 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.450500 12806 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:08:00.418951 15862 raft_consensus.cc:2804] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:00.419926 16255 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:00.425631 16359 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:00.379908 16209 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.474447 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 233924us
I20260709 13:08:00.430733 16234 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:00.459321 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1261) took 1355 ms. Trace:
I20260709 13:08:00.445466 16144 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.446542 16379 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:00.458964 16201 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.457999 16212 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:00.365443 16314 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.498332 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:00.480773 16359 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.483420 12732 rpcz_store.cc:276] 0709 13:07:59.104065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.751996 (+647931us) service_pool.cc:224] Handling call
0709 13:07:59.752344 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.752547 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:59.816904 (+ 64357us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.458940 (+642036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.458995 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.459051 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.459122 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.459262 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37119,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":156147,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":122,"thread_start_us":618377,"threads_started":2,"wal-append.queue_time_us":516516}
I20260709 13:08:00.449358 16213 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.445091 16348 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.494872 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.516561 12803 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.473263 15862 raft_consensus.cc:697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:00.499729 16347 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.531615 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 351793us
I20260709 13:08:00.505709 16212 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.496589 16201 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:00.535004 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.536474 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 294494us
I20260709 13:08:00.545710 12696 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.548081 12733 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:00.487799 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.551023 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63247.4us
I20260709 13:08:00.555313 12880 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:00.498703 16144 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.557049 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:00.549129 16275 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.006s
W20260709 13:08:00.561573 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.541047 16223 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.563648 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:00.564571 12880 raft_consensus.cc:2376] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 7. Re-sending same reply.
I20260709 13:08:00.544615 16212 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.567092 12876 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:00.567586 12699 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:00.557796 15944 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.580220 15862 consensus_queue.cc:237] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:00.581163 16383 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:00.581202 15977 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:00.582226 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.539499 16213 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:00.547363 16347 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.588582 12875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 266) took 3165 ms (client timeout 2397 ms). Trace:
W20260709 13:08:00.592634 12875 rpcz_store.cc:269] 0709 13:07:57.422644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.482842 (+1060198us) service_pool.cc:224] Handling call
0709 13:08:00.588236 (+2105394us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540006c7d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:00.588453 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988349696}
I20260709 13:08:00.529640 16255 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.590094 16316 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.551805 16360 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.535789 16340 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:00.579185 16335 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:00.600028 12875 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:08:00.597990 16250 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.020s	user 0.014s	sys 0.001s
I20260709 13:08:00.613492 16255 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.576077 16309 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.575363 16201 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.615031 16314 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.596444 15929 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.619421 16360 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.621826 16381 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:00.571349 16223 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:00.631469 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55186us
I20260709 13:08:00.573764 16384 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:00.632766 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 87116.7us
I20260709 13:08:00.633364 16394 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.566572 16382 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:00.673127 16394 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:00.584513 16379 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.674973 16223 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:00.677047 16394 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.677589 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:00.677605 12805 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.635263 16347 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.636968 16311 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.639427 16318 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 1.138s	user 0.006s	sys 0.007s
I20260709 13:08:00.643280 16316 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.643186 16392 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.643537 15637 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.645824 16348 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.646808 16230 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:00.615844 16209 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.649387 16351 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.650622 16234 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.605597 16335 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:00.695803 12771 leader_election.cc:400] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:08:00.696393 12771 leader_election.cc:403] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.696666 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.668198 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 424546us
I20260709 13:08:00.678381 12731 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:00.680977 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.705107 12802 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
W20260709 13:08:00.705734 12771 connection.cc:256] RPC call timeout handler was delayed by -1.314987364999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2671s for a response
W20260709 13:08:00.666168 16391 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:08:00.678328 16213 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.666450 16388 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:08:00.707077 12771 connection.cc:256] RPC call timeout handler was delayed by -1.2544448099999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:08:00.708339 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:00.705128 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:00.679420 16250 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:00.706722 13487 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:08:00.715416 12771 leader_election.cc:336] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.819s (SENT)
I20260709 13:08:00.717453 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:00.691412 16201 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.720933 12874 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:00.721372 12771 leader_election.cc:336] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.997s (SENT)
I20260709 13:08:00.722409 12771 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.695008 16326 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.237s	user 0.009s	sys 0.017s
W20260709 13:08:00.725600 12771 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.030s (SENT)
I20260709 13:08:00.726050 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:00.727209 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.727819 12882 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:00.728837 16250 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:00.725136 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:00.732023 12771 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.224s (SENT)
I20260709 13:08:00.707254 16335 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.739645 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 282) took 2275 ms. Trace:
I20260709 13:08:00.737053 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:00.733309 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.742105 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:00.743299 16316 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:00.744801 16316 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.748245 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.708384 16347 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7.
I20260709 13:08:00.753928 15637 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.756177 15637 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.756735 15637 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.741182 13520 rpcz_store.cc:276] 0709 13:07:58.448792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.448989 (+   197us) service_pool.cc:224] Handling call
0709 13:07:58.698434 (+249445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.699286 (+   852us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:58.699337 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.700212 (+   875us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.910657 (+210445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.910691 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.910748 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.830539 (+919791us) raft_consensus.cc:1685] finished
0709 13:07:59.830568 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.716377 (+885809us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400770450. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:00.724552 (+  8175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":149,"spinlock_wait_cycles":511987072,"thread_start_us":210035,"threads_started":1,"wal-append.queue_time_us":436305}
I20260709 13:08:00.716667 16234 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.761212 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:00.763227 16392 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:00.766304 16311 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.766127 16364 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:00.766741 16311 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.767127 16311 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.725939 16209 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.741055 16340 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:00.769579 15977 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.770153 16340 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.754199 16258 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.739775 16126 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.774745 16351 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.775154 16126 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.775596 16126 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.776883 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1828) took 3293 ms. Trace:
I20260709 13:08:00.777089 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:00.777390 12729 rpcz_store.cc:276] 0709 13:07:57.483604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.325870 (+842266us) service_pool.cc:224] Handling call
0709 13:07:58.354554 (+ 28684us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.372878 (+ 18324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.372908 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.395570 (+ 22662us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.859931 (+464361us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:58.859989 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.860106 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.638740 (+1778634us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:00.776544 (+137804us) raft_consensus.cc:1685] finished
0709 13:08:00.776569 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.776806 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17891,"raft.queue_time_us":22646,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3506,"spinlock_wait_cycles":33961344,"thread_start_us":412573,"threads_started":1,"wal-append.queue_time_us":969224}
I20260709 13:08:00.739565 16223 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.716259 16320 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:08:00.739931 16144 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.720201 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:00.732817 16230 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.770200 15977 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:00.750553 16213 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.802755 13512 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:00.804347 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1233) took 2397 ms. Trace:
I20260709 13:08:00.817780 12808 rpcz_store.cc:276] 0709 13:07:58.407130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.456704 (+ 49574us) service_pool.cc:224] Handling call
0709 13:07:58.457259 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.475052 (+ 17793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.475082 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.478780 (+  3698us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.871598 (+392818us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:58.871642 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.871712 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.602188 (+1730476us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:00.671240 (+ 69052us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b24001ea0b8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3e98c9c4 00007f0f3e98aacb 00007f0f3eb45dc9 00007f0f3eb45a55 00007f0f3eb4509d 00007f0f4177710e 00007f0f4178e88c 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221
0709 13:08:00.803984 (+132744us) raft_consensus.cc:1685] finished
0709 13:08:00.804016 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.804231 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202049,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":24967,"spinlock_wait_cycles":75527936,"thread_start_us":207634,"threads_started":1,"wal-append.queue_time_us":647310}
I20260709 13:08:00.750838 16309 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.803350 16359 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:00.825582 16312 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.004s
I20260709 13:08:00.839769 16312 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.840598 13514 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:00.842505 16312 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:00.844707 12881 raft_consensus.cc:2368] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 4. Current term is 5.
I20260709 13:08:00.845273 15977 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:00.847255 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1275) took 1505 ms. Trace:
I20260709 13:08:00.847816 12733 rpcz_store.cc:276] 0709 13:07:59.342246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.465851 (+123605us) service_pool.cc:224] Handling call
0709 13:08:00.846988 (+1381137us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003b1854. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:00.847174 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399469440}
I20260709 13:08:00.851969 16258 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.821861 16213 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.853068 16213 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.793787 16351 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:08:00.794070 16337 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.860929 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:00.863090 16337 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:00.852258 13514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 304) took 1286 ms. Trace:
I20260709 13:08:00.863092 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:00.866293 15637 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:00.875339 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.876746 12802 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:08:00.878077 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:00.879385 12808 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:08:00.869072 13514 rpcz_store.cc:276] 0709 13:07:59.556961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.688582 (+131621us) service_pool.cc:224] Handling call
0709 13:07:59.831065 (+142483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.841151 (+1010086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.842857 (+  1706us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004e8c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:00.843134 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320620288}
W20260709 13:08:00.870361 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 152228us
W20260709 13:08:00.888554 13484 leader_election.cc:336] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.173s (SENT)
I20260709 13:08:00.889400 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.894240 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 133711us
I20260709 13:08:00.796974 16209 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:08:00.900887 15637 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.911492 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.867722 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 171144us
I20260709 13:08:00.915275 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.931031 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.932693 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.899094 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:00.860951 16359 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:00.942891 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60495.8us
I20260709 13:08:00.829161 15929 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:08:00.895843 16159 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.898240 16392 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:00.958897 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43853.5us
I20260709 13:08:00.962386 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:00.959354 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60397.7us
I20260709 13:08:00.899564 16258 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:08:00.966336 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:00.972616 15977 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:01.031813 16402 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:01.074245 16335 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:01.097635 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 131442us
I20260709 13:08:01.103955 16309 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.033890 16337 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.109393 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.111027 12881 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:01.111040 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.116914 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.119431 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.121464 12875 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:01.036438 16406 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:01.096896 16212 consensus_meta.cc:287] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.003s
I20260709 13:08:00.976625 16316 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:08:00.965034 16409 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 13:08:01.098796 15977 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.138120 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.139218 12881 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:01.139561 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.139331 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:01.123620 16335 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:00.974215 16392 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.107383 16209 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.141793 12877 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:08:01.028980 16403 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:08:01.073534 16126 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:01.114362 16351 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.114759 16337 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:01.067783 16405 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:08:01.141017 15977 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.141530 16406 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:01.144949 16209 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.136735 16212 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:01.165024 16209 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.153117 16337 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:01.165948 16386 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.449s	user 0.007s	sys 0.000s
I20260709 13:08:01.154736 16351 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.179021 16351 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.178699 16406 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.184242 16392 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:01.241309 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 278882us
W20260709 13:08:01.234490 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 260215us
W20260709 13:08:01.251746 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 143812us
I20260709 13:08:01.277539 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1257) took 1109 ms. Trace:
I20260709 13:08:01.281797 12801 rpcz_store.cc:276] 0709 13:08:00.166360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.166800 (+   440us) service_pool.cc:224] Handling call
0709 13:08:00.189083 (+ 22283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.189502 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.189557 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.255386 (+ 65829us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.532953 (+277567us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.533004 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.533077 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.074039 (+540962us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:01.275269 (+201230us) raft_consensus.cc:1685] finished
0709 13:08:01.275330 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.275992 (+   662us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30364,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5353,"spinlock_wait_cycles":9597696,"thread_start_us":267885,"threads_started":1,"wal-append.queue_time_us":406231}
I20260709 13:08:01.305042 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.311434 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.311560 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.317833 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.319257 12873 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:01.319548 12875 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:01.320937 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.323405 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:01.315415 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.323547 12733 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:01.323931 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:01.325683 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.327888 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.329488 12881 raft_consensus.cc:2410] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:01.317035 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.334388 12878 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:01.331270 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:01.338676 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.330859 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.341399 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:01.350245 16126 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.357563 16144 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:01.358980 16201 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.361696 13518 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:01.364066 16212 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.365715 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:01.366456 16255 consensus_meta.cc:287] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.003s
I20260709 13:08:01.373906 16340 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:01.375468 16316 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:01.375590 16320 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:01.377514 16311 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.007s
I20260709 13:08:01.341670 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:01.343277 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:01.273842 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:01.262099 12773 leader_election.cc:336] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.692s (SENT)
I20260709 13:08:01.391448 16144 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.397253 12878 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:01.400329 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 140183us
I20260709 13:08:01.400909 16311 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:01.402616 12773 leader_election.cc:336] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.749s (SENT)
I20260709 13:08:01.408627 12733 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.415213 12881 raft_consensus.cc:2410] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:01.407013 16360 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.392751 16340 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:01.416770 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 99571.3us
I20260709 13:08:01.403985 16311 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.405267 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:01.413714 16320 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:01.423569 16320 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.426198 12802 raft_consensus.cc:1275] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:01.394249 16415 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:01.419499 16316 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:01.433447 12731 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.434574 16316 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.407675 16201 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:01.417929 16360 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.426767 16337 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.398908 16144 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:01.419559 16340 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:01.446419 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 104190us
I20260709 13:08:01.448854 16258 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.450356 16258 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:01.450493 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.445842 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 172704us
I20260709 13:08:01.454950 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:01.456487 16337 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.457573 16347 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.459633 16347 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.460207 16347 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.461309 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.442652 16201 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:01.467020 16403 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.448454 16144 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.453444 16258 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.476372 16360 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.479837 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 1969) took 1292 ms. Trace:
W20260709 13:08:01.482321 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.481209 12874 rpcz_store.cc:276] 0709 13:08:00.187179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.252343 (+ 65164us) service_pool.cc:224] Handling call
0709 13:08:01.479326 (+1226983us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000c85d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.479591 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074284928}
I20260709 13:08:01.473178 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.470270 16144 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.500784 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.502828 16223 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.503055 16312 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.504329 16312 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.507445 16234 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.508076 16312 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:01.473031 15977 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:01.523254 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50326.8us
I20260709 13:08:01.526178 12696 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:01.502869 16314 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.512655 16234 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:01.532120 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.547072 16334 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:01.558486 16334 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:01.558949 16334 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.562775 16312 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:01.537478 16314 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:01.548158 16415 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:01.548168 12696 leader_election.cc:400] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
W20260709 13:08:01.544957 12773 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.889s (SENT)
W20260709 13:08:01.567539 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46706.9us
I20260709 13:08:01.567229 12696 leader_election.cc:403] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.570451 16379 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8.
I20260709 13:08:01.539510 16234 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.575035 16234 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.549790 15977 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.531850 16365 consensus_queue.cc:1048] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:01.578377 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.579278 12802 raft_consensus.cc:3060] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.536641 16293 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:01.537122 16223 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:01.581331 16223 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:01.587110 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.588083 12799 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.589026 12808 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:01.576665 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.592222 12801 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.596640 16405 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:01.597896 16405 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.600868 16360 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:01.601459 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:01.601722 16360 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.602789 16359 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.603200 16359 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.603657 16359 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.604748 16360 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:01.607090 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.578416 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1255) took 2540 ms. Trace:
I20260709 13:08:01.608359 12728 rpcz_store.cc:276] 0709 13:07:59.037407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.748363 (+710956us) service_pool.cc:224] Handling call
0709 13:08:00.280299 (+531936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.281585 (+  1286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.577827 (+1296242us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400245750. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.578141 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222731008}
I20260709 13:08:01.605985 16405 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.610739 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1264) took 1440 ms. Trace:
I20260709 13:08:01.611229 12805 rpcz_store.cc:276] 0709 13:08:00.169786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.300691 (+130905us) service_pool.cc:224] Handling call
0709 13:08:00.677387 (+376696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.678898 (+  1511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.610233 (+931335us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54001d4cd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.610494 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840632192}
I20260709 13:08:01.566114 16314 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.526635 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:01.612728 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0816095139999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 13:08:01.613855 16297 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:01.619405 12882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 280) took 1866 ms (client timeout 2173 ms). Trace:
I20260709 13:08:01.563990 16312 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:01.620635 12876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 267) took 1871 ms (client timeout 1673 ms). Trace:
I20260709 13:08:01.543764 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.522007 12733 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:01.650815 12731 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
W20260709 13:08:01.649094 12882 rpcz_store.cc:269] 0709 13:07:59.753650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.915965 (+162315us) service_pool.cc:224] Handling call
0709 13:08:01.618717 (+1702752us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400138b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.619087 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817412480}
W20260709 13:08:01.652541 12876 rpcz_store.cc:269] 0709 13:07:59.749227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.749376 (+   149us) service_pool.cc:224] Handling call
0709 13:08:01.620180 (+1870804us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54000703d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.620430 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598241152}
I20260709 13:08:01.656345 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.665978 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.666209 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.667703 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.667774 12724 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:01.674706 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.671619 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 1970) took 1483 ms. Trace:
W20260709 13:08:01.660091 16397 log.cc:927] Time spent T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.841s	user 0.000s	sys 0.004s
W20260709 13:08:01.669102 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 142680us
I20260709 13:08:01.690181 12879 rpcz_store.cc:276] 0709 13:08:00.187458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.459625 (+272167us) service_pool.cc:224] Handling call
0709 13:08:00.556121 (+ 96496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.556393 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.556429 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.561829 (+  5400us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.683404 (+121575us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.727920 (+ 44516us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.752598 (+ 24678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.752695 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.884914 (+132219us) raft_consensus.cc:1685] finished
0709 13:08:00.884954 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.670985 (+786031us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b5400220e50. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:01.671279 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24279,"prepare.queue_time_us":177683,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":24395,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":31905,"spinlock_wait_cycles":220804352,"thread_start_us":100242,"threads_started":2,"wal-append.queue_time_us":219571}
I20260709 13:08:01.695142 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:01.670588 16387 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.699294 16387 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:01.700112 16387 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:01.678607 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0837810289999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:08:01.705689 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0693810289999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:08:01.706043 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0414810290000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 13:08:01.668826 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 127361us
I20260709 13:08:01.683650 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.691175 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1263) took 1522 ms. Trace:
W20260709 13:08:01.682734 16209 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.010s
I20260709 13:08:01.670034 13486 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:01.671277 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.731312 12806 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.734503 12801 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:01.684382 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.684859 15977 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.743244 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.739343 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.672154 16314 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.740214 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.647987 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.680351 16223 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:01.686551 16312 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:01.745663 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 75918.1us
I20260709 13:08:01.725406 12803 rpcz_store.cc:276] 0709 13:08:00.169250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.244271 (+ 75021us) service_pool.cc:224] Handling call
0709 13:08:00.244633 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.529678 (+285045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.690218 (+1160540us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54001d3dd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:01.690876 (+   658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624823168}
I20260709 13:08:01.667783 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:01.759438 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:01.765812 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.768843 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:01.771003 16347 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.773869 16347 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.777472 12804 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:01.682081 16340 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.741951 15977 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.766952 12808 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:01.758641 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:01.784690 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.784929 16412 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:01.792236 16390 raft_consensus.cc:2804] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:01.792560 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97633.4us
I20260709 13:08:01.793102 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.784785 12802 raft_consensus.cc:2468] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 6.
W20260709 13:08:01.802909 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51715.4us
I20260709 13:08:01.815019 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:01.816440 12731 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:01.818104 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.818959 12800 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:01.819746 16297 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.823004 12799 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:08:01.830415 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.753512 16209 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:01.822671 16213 consensus_meta.cc:287] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.876s	user 0.015s	sys 0.010s
I20260709 13:08:01.805061 15977 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.820451 16297 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:01.842442 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:01.845625 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.846701 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.849090 12806 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:01.867848 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.869045 12732 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:01.870296 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.871668 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.872541 12732 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:01.873482 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:01.874117 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.874598 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.875731 12730 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:01.875965 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.876392 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.877410 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:01.878034 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.879326 16223 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.880292 16347 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.880550 12731 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.881985 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.882879 12731 raft_consensus.cc:2393] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 6: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:01.879573 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.883926 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:01.874202 12732 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.878110 12733 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.888732 12805 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.897058 12726 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:01.845427 16412 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:01.908603 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.845255 16390 raft_consensus.cc:697] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:01.913574 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.920007 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.925191 12804 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:01.926555 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.927322 12804 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:01.929315 12800 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.930166 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.931002 12806 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.931478 16387 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.928750 16412 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.891403 16258 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.945382 12799 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:01.952729 12727 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:01.954125 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74628.8us
I20260709 13:08:01.955564 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:01.956297 12725 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:01.859009 16213 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.956790 16359 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.957412 16297 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:01.958629 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.958846 12731 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.957944 16370 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.973555 12806 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:01.981457 16317 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.991025 16317 consensus_queue.cc:1243] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:01.991468 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.984810 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:01.992357 12806 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:01.986929 12771 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:08:01.993242 16209 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.993295 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.994210 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:01.994130 16334 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:01.994793 16340 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:01.988440 12802 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:01.994917 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.995201 12733 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:01.992479 12803 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:01.990197 16347 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.000411 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:01.987635 16213 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:02.002182 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.004164 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:01.998039 16347 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:02.011620 16347 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.012485 12728 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.998193 16390 consensus_queue.cc:237] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:02.015813 12806 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:02.017406 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.018276 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.019358 12802 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:02.020257 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.034590 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.037083 12805 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:02.040162 16144 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.047739 12802 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:08:02.053207 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 213979us
I20260709 13:08:02.065907 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.007593 16209 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:02.085271 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.088181 16428 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:08:02.088368 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94344.6us
I20260709 13:08:02.083837 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.094761 12726 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:02.112252 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:02.122092 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.122822 16429 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
I20260709 13:08:02.125898 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.127125 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.127667 12803 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:02.129962 16312 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.130656 16312 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.131160 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.131757 12805 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.133534 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:02.134944 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:02.136256 16311 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:02.137048 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.136930 16311 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:02.137442 16359 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:02.139097 16311 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:02.140341 16314 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.140980 16314 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.141373 16314 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:02.142372 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53185.1us
I20260709 13:08:02.144909 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.153759 12803 pending_rounds.cc:85] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:08:02.158738 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.165766 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.167552 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.159777 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.168607 12876 raft_consensus.cc:2368] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:08:02.169209 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.169760 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:02.170850 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:02.171391 16250 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.138433 16359 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:02.171891 16144 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.172646 16359 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.173043 16359 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:02.174033 16359 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.175583 16359 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.179499 12732 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:08:02.169934 12726 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:02.190444 12807 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.197000 16334 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.198179 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.198814 16258 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.199260 12876 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:02.201347 12879 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:02.202046 12806 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:02.205127 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:02.205658 16431 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.216s	user 0.001s	sys 0.002s
I20260709 13:08:02.206198 12874 raft_consensus.cc:2376] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9. Re-sending same reply.
I20260709 13:08:02.207542 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.208463 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.208581 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.208772 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.209414 12878 raft_consensus.cc:2376] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12. Re-sending same reply.
I20260709 13:08:02.209621 12881 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:02.210520 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.211496 12877 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:02.212607 12875 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:02.214049 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.214795 12882 raft_consensus.cc:2376] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10. Re-sending same reply.
I20260709 13:08:02.215003 16258 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.215646 16258 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.217048 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.217761 12878 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:02.207684 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.209932 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.220115 12873 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.224444 16387 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.211817 12881 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.228466 12805 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:02.157173 12803 pending_rounds.cc:107] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:02.234710 12873 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:02.241065 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.241830 12731 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5.
I20260709 13:08:02.242270 12873 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:02.232462 12803 raft_consensus.cc:2889] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.246944 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.248952 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.249859 12876 raft_consensus.cc:2410] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:02.255519 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.268682 12800 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:02.270747 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.273253 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:02.274096 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.274261 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.274843 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.275439 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:02.275518 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.273413 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.277189 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.275784 12728 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:02.277266 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.279021 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.277421 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.217872 16312 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:02.254069 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:02.217804 16258 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.283812 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:02.292006 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:02.302747 16297 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:02.303774 16297 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:02.308768 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.313341 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.320206 16297 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:02.290463 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 130051us
I20260709 13:08:02.289631 12879 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:02.333609 12801 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:02.336239 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 60282us
I20260709 13:08:02.252218 15977 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.336764 16234 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.345764 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:02.354287 12800 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:02.342238 16334 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.360926 12881 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:02.334694 16347 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.350915 16312 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:02.389720 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.360363 16334 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.405103 12881 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:08:02.408598 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:02.395686 16311 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:02.361867 16234 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.420197 12800 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:02.401517 16334 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.427256 16311 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:02.427546 16390 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.428807 16311 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:02.430953 12876 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:02.395955 16360 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:08:02.414711 16250 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:02.458388 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.467906 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.483637 13486 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:02.501067 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:02.518817 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.488919 16250 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:02.542407 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.536279 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.551474 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:02.573113 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.574162 12808 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.559193 12627 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.540316 16250 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.535432 15977 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.630530 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.631522 12805 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:02.644618 12801 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:02.645431 12799 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.647171 16417 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.654430 16234 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:02.643095 16347 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:02.656962 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.657472 12729 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.658529 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 287) took 1938 ms. Trace:
I20260709 13:08:02.659283 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.660326 12725 raft_consensus.cc:2410] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:02.659017 12880 rpcz_store.cc:276] 0709 13:08:00.569425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.569641 (+   216us) service_pool.cc:224] Handling call
0709 13:08:01.621479 (+1051838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.622252 (+   773us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:01.748674 (+126422us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.908840 (+160166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.908896 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:01.908942 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.913991 (+  5049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.476493 (+562502us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000703d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:02.507380 (+ 30887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16119,"prepare.queue_time_us":242164,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":17695,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":41726,"spinlock_wait_cycles":2418062208,"thread_start_us":237378,"threads_started":2,"wal-append.queue_time_us":234842}
I20260709 13:08:02.621165 16250 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.696238 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.697595 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:02.698395 12799 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:02.699157 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.701536 12873 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:02.702131 12806 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:02.707262 12806 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:02.709903 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:02.701525 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.713023 12874 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:02.713244 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:02.702472 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:02.715976 12878 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:02.715291 12806 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:02.685545 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:02.723455 12799 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:02.740634 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.735106 12627 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:02.746447 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:02.748685 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.795960 12876 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:02.800251 12806 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:02.807140 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:02.808841 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 147074us
I20260709 13:08:02.809042 12806 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:02.810132 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:02.812367 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.816519 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.821089 12806 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.821967 12874 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:02.799485 16347 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:02.834980 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 440678us
I20260709 13:08:02.837368 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:02.838420 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:02.805023 12627 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 10, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 10 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:02.852340 12725 raft_consensus.cc:2410] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:02.859218 12799 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:02.854440 12848 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:02.863863 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 484544us
I20260709 13:08:02.864439 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.867347 12627 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 11, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.858007 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.873508 12729 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:02.835724 16312 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:02.875731 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.876106 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:02.876461 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.876876 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.873697 12876 pending_rounds.cc:85] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 8
I20260709 13:08:02.878711 12876 pending_rounds.cc:107] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:02.878963 12876 raft_consensus.cc:2889] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.879302 12725 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 8: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:02.866415 16314 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.007s
I20260709 13:08:02.890152 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:02.891767 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 408303us
I20260709 13:08:02.895175 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.896582 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.885844 16360 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.908596 12627 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:02.945205 12730 raft_consensus.cc:2410] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:08:02.932914 12848 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:02.950903 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:02.956718 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.962077 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:02.962879 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.912119 16347 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.968824 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:02.929518 16360 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.888335 16314 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:02.984228 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.991641 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 93487.2us
I20260709 13:08:02.990393 12727 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:02.993741 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.897550 16334 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.004920 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.005911 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.000545 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1296) took 1076 ms. Trace:
I20260709 13:08:02.982769 16347 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:02.989171 16412 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.992786 16360 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.027824 12733 raft_consensus.cc:2368] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:03.021703 12882 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:03.040673 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.072101 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:03.010032 12804 rpcz_store.cc:276] 0709 13:08:01.923965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.079895 (+155930us) service_pool.cc:224] Handling call
0709 13:08:02.111532 (+ 31637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.253648 (+142116us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:02.833799 (+580151us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.000162 (+166363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.000213 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:03.000268 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.000339 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.000477 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":373718,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":623179,"threads_started":2}
I20260709 13:08:03.081064 12627 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 5, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 5 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:03.065155 15637 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
I20260709 13:08:03.099666 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.029068 16347 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:03.100807 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 53855.3us
I20260709 13:08:03.039369 16250 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.101715 15637 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.118721 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.015750 16453 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.103051 12627 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 8 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:03.119040 12696 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.131s (SENT)
I20260709 13:08:03.120673 12729 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:03.125167 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.066886 15977 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.123893 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:03.142139 12773 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.632s (SENT)
I20260709 13:08:03.148605 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.151329 12627 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 4 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:03.158316 12773 leader_election.cc:336] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.645s (SENT)
I20260709 13:08:03.158968 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.158162 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.078104 16412 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.143141 16387 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:03.141691 16446 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.168336 12627 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.172465 15637 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.079492 16312 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.197525 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:03.200773 12847 connection.cc:256] RPC call timeout handler was delayed by -1.3092854279999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31520000000000004s for a response
W20260709 13:08:03.201417 12847 connection.cc:256] RPC call timeout handler was delayed by -1.1785238139999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:08:03.214864 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0594670479999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:08:03.215370 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0321839420000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:08:03.164194 16453 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:03.221829 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0258839420000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:08:03.224666 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66396.1us
I20260709 13:08:03.227893 16450 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:03.228508 16450 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:03.229900 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.225670 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:03.230373 16443 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:08:03.224723 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:03.237170 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0182891059999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:08:03.241123 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:03.241603 12847 connection.cc:256] RPC call timeout handler was delayed by -1.0069839420000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:08:03.242199 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 155827us
I20260709 13:08:03.247440 12724 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:03.248733 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.197093 16334 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:03.253412 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:03.259843 16460 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:03.272984 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.287338 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.287516 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:03.288879 12808 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.003s
I20260709 13:08:03.289305 12808 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:03.291576 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:03.294750 16455 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:03.294967 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:03.297586 16473 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:03.302572 16454 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
W20260709 13:08:03.316311 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.299993 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:03.339715 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51234.4us
I20260709 13:08:03.341734 12729 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:03.342861 16314 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:03.343384 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89190.5us
I20260709 13:08:03.195009 16446 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.290364 16469 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.347796 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.346554 12627 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:03.341253 15637 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.356348 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.366729 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:03.367973 12730 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.377624 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.384984 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.340378 16317 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:03.390406 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.364444 15637 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.401095 16317 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.402364 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 306) took 1336 ms. Trace:
I20260709 13:08:03.402522 12696 leader_election.cc:400] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7.
I20260709 13:08:03.403622 16317 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:03.402856 12803 rpcz_store.cc:276] 0709 13:08:02.065876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.143786 (+ 77910us) service_pool.cc:224] Handling call
0709 13:08:02.151957 (+  8171us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:02.266652 (+114695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.266702 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:02.267793 (+  1091us) log.cc:844] Serialized 78 byte log entry
0709 13:08:02.746630 (+478837us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:02.814216 (+ 67586us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.829661 (+ 15445us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.041919 (+212258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.042009 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.402112 (+360103us) raft_consensus.cc:1685] finished
0709 13:08:03.402132 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.402294 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34560,"prepare.queue_time_us":118221,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":6482,"raft.queue_time_us":11565,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":22979,"spinlock_wait_cycles":7740416,"thread_start_us":680119,"threads_started":2,"wal-append.queue_time_us":663239}
W20260709 13:08:03.408219 16461 log.cc:927] Time spent T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.184s	user 0.000s	sys 0.004s
I20260709 13:08:03.408617 16309 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.409116 16451 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.416539 12725 raft_consensus.cc:1275] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:03.411118 12728 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:03.418395 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.402704 16250 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:03.409714 16462 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.129s	user 0.003s	sys 0.002s
I20260709 13:08:03.432802 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.427175 12627 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 9, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.438446 12727 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:03.426065 16309 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.433094 16314 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.458420 15637 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:03.445034 16451 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:03.535710 12627 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 10, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 10 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:03.538241 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 312) took 1102 ms. Trace:
W20260709 13:08:03.524057 16464 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:03.541767 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:03.531394 16439 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:08:03.542866 12627 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 1 to 9. New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.351549 16450 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.538709 12800 rpcz_store.cc:276] 0709 13:08:02.435828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.440897 (+  5069us) service_pool.cc:224] Handling call
0709 13:08:02.441375 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.457405 (+ 16030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.457455 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.518038 (+ 60583us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.894696 (+376658us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:02.894734 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.894820 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.537991 (+643171us) raft_consensus.cc:1685] finished
0709 13:08:03.538014 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.538168 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15601,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":329334,"threads_started":1,"wal-append.queue_time_us":536408}
I20260709 13:08:03.547510 12627 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:03.550643 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 127668us
I20260709 13:08:03.552517 16317 consensus_queue.cc:1048] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:03.553617 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.556445 16144 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.556835 16347 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.558737 16309 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:03.546542 16359 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.364s	user 0.004s	sys 0.014s
I20260709 13:08:03.559266 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.545760 16314 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:03.551891 12630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 162) took 31599 ms (client timeout 15000 ms). Trace:
W20260709 13:08:03.566010 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 109805us
I20260709 13:08:03.543669 16481 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.569439 12627 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:03.380956 16469 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:03.586743 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 240087us
I20260709 13:08:03.586208 12627 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 7, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 7 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:03.598028 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:03.599007 16458 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:03.599736 16458 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.600551 16452 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.600338 16451 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.436172 16453 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.602008 16314 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.604453 16446 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:03.605038 16234 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:03.605270 16489 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.586391 16311 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.609093 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 309164us
W20260709 13:08:03.609597 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50482.5us
I20260709 13:08:03.609347 16489 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:03.620399 16489 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.594893 16412 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:03.605747 16234 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:03.633901 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:03.636374 16469 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:03.637198 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:03.638142 12727 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:03.638533 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 49840.9us
W20260709 13:08:03.637444 16475 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:03.640793 12875 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:03.646106 16449 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.627s	user 0.000s	sys 0.006s
I20260709 13:08:03.632833 16446 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:03.651619 16446 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.648957 16234 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.653926 16446 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:03.654989 16486 log.cc:927] Time spent T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.062s	user 0.001s	sys 0.002s
I20260709 13:08:03.655407 16412 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.655929 16412 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.659353 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:03.661684 16412 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:03.665750 16347 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:03.667644 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:03.676800 13514 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.670359 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.684676 16234 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:03.672559 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 96911.5us
I20260709 13:08:03.690948 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.691777 16347 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:03.574080 12630 rpcz_store.cc:269] 0709 13:07:31.766189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.766501 (+   312us) service_pool.cc:224] Handling call
0709 13:08:03.354943 (+31588442us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:59.588474 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:59.589073 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:59.589112 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:59.589124 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:59.589722 (+   598us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:59.589782 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:59.589808 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:59.590198 (+   390us) tablet.cc:701] Row locks acquired
0709 13:07:59.590216 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:59.590363 (+   147us) write_op.cc:270] Start()
0709 13:07:59.590478 (+   115us) write_op.cc:276] Timestamp: P: 1783602479590317 usec, L: 0
0709 13:07:59.590497 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:59.793161 (+202664us) log.cc:844] Serialized 1677 byte log entry
0709 13:08:00.644457 (+851296us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:08:00.693211 (+ 48754us) op_driver.cc:464] REPLICATION: finished
0709 13:08:01.090134 (+396923us) write_op.cc:301] APPLY: starting
0709 13:08:01.097360 (+  7226us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:01.132336 (+ 34976us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:01.132379 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:01.168981 (+ 36602us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:01.169206 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:01.169258 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:01.182162 (+ 12904us) log.cc:844] Serialized 40 byte log entry
0709 13:08:01.182777 (+   615us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.183079 (+   302us) write_op.cc:454] Released schema lock
0709 13:08:01.183140 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:01.183796 (+   656us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.183833 (+    37us) write_op.cc:454] Released schema lock
0709 13:08:01.583403 (+399570us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf032a 00007f0f41b75f14 00007f0f41b75ec3 00007f0f41b75e38 00007f0f41b75df3 00007f0f41b750dc 00007f0f41b9ee16 00007f0f41b86cbb 00007f0f41b7139d 00007f0f41b74d75
Metrics: {"dns_us":18029,"mutex_wait_us":36049,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":372015,"apply.run_cpu_time_us":5314,"apply.run_wall_time_us":103211,"num_ops":4,"prepare.queue_time_us":542202,"prepare.run_cpu_time_us":51479,"prepare.run_wall_time_us":1056197,"raft.queue_time_us":186868,"raft.run_cpu_time_us":40412,"raft.run_wall_time_us":919922,"replication_time_us":1088239,"spinlock_wait_cycles":149834752,"thread_start_us":558821,"threads_started":4,"wal-append.queue_time_us":216664,"wal-append.run_cpu_time_us":77804,"wal-append.run_wall_time_us":2177722}]]}
I20260709 13:08:03.695562 12730 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:03.682900 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:03.708911 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 74503.6us
I20260709 13:08:03.730173 13514 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:03.732366 12771 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:08:03.733491 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 121054us
W20260709 13:08:03.736851 16360 consensus_meta.cc:287] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
W20260709 13:08:03.737565 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46690.3us
I20260709 13:08:03.737330 16360 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:03.738322 12773 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.739292 16309 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.739897 16309 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:03.739984 12773 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:03.741349 12880 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:08:03.741945 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 71707.5us
I20260709 13:08:03.755257 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:03.756098 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:03.615269 16311 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.764576 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:03.765504 12800 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.740582 15977 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.741300 16144 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:03.770026 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:03.741715 16481 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.741151 16250 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.777247 12808 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.770223 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:03.778951 12803 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.740399 16466 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.741530 16340 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:03.741371 16387 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:03.781301 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:03.756183 16347 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.790796 12804 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:03.739988 16360 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:03.780745 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:03.791199 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:03.798765 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.799851 12807 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.800660 12876 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:03.767695 16359 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:03.807034 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67142us
I20260709 13:08:03.804736 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.805516 12802 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:03.809370 12877 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:03.776688 16471 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:03.805423 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.740795 16309 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.814427 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.740818 16446 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:08:03.776597 16144 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:03.816771 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.810261 16340 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.830224 12879 pending_rounds.cc:85] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 6
I20260709 13:08:03.830716 12879 pending_rounds.cc:107] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:08:03.830978 12879 raft_consensus.cc:2889] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.821555 12808 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:08:03.822523 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 139752us
W20260709 13:08:03.834066 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 71379.9us
I20260709 13:08:03.829337 12882 raft_consensus.cc:2368] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11.
I20260709 13:08:03.770748 16403 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:08:03.805153 16250 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:03.842496 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91603.3us
I20260709 13:08:03.790390 16334 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:08:03.849359 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:03.802340 16387 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:03.861352 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.865104 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:03.869599 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:03.848752 16453 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:03.871343 16360 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.845631 15977 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.879727 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:03.880435 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63742us
I20260709 13:08:03.796170 12874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a839b697aea46da87cb69b00515389e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:03.885001 12874 raft_consensus.cc:606] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:03.885473 12874 raft_consensus.cc:614] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:03.886857 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:03.853170 16466 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:03.892256 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:03.887094 16360 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:03.911473 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:03.913003 12874 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:03.914429 12873 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:03.851423 16417 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:08:03.924726 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:03.925467 12882 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.882869 16482 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:03.912446 16360 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:03.925529 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.872895 16446 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:03.913558 16412 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.979080 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:03.984524 12881 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.838827 16471 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:03.986878 12874 raft_consensus.cc:2410] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
W20260709 13:08:03.992312 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 105556us
I20260709 13:08:03.997547 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.012632 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:04.014792 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 171548us
I20260709 13:08:04.019249 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.020951 12873 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:08:04.027685 16498 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:08:04.029258 16450 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.029075 16360 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.031134 16360 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.916460 16144 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.033237 16144 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:04.035135 16497 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:08:04.036899 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.037706 16453 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.038100 16453 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.038434 16453 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.042043 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2143) took 1359 ms. Trace:
I20260709 13:08:04.042538 12880 rpcz_store.cc:276] 0709 13:08:02.700270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.702668 (+  2398us) service_pool.cc:224] Handling call
0709 13:08:02.702987 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.757628 (+1054641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.041754 (+284126us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400207bd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:04.041968 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387491200}
I20260709 13:08:04.043015 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.044260 12879 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:04.046141 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.047214 16412 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:04.047876 16412 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.050241 16412 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.052417 16488 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.052975 16488 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.053324 16488 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.054418 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.055166 16359 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.055533 16359 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.055863 16359 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.057155 12848 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.010959 16481 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.048200 16446 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:04.062595 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69288.5us
I20260709 13:08:04.063434 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:04.029870 16493 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.931808 16489 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.066951 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:03.927699 16466 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.067687 12873 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
W20260709 13:08:04.072528 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 205347us
I20260709 13:08:04.073199 12800 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:04.074165 12807 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:04.075495 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:04.019534 16258 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.089530 16334 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.106598 16334 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:04.098820 16452 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.068358 16451 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:04.099310 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 117558us
I20260709 13:08:04.100482 16489 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.029263 16502 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:04.104384 15977 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.071758 16481 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.075385 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.098326 16471 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:03.981987 16482 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:04.128690 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65349.3us
I20260709 13:08:04.073005 16412 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:04.132510 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57268.5us
I20260709 13:08:03.997638 16250 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.108471 16446 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.142633 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.121702 16334 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.150506 12727 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:04.159103 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:04.159627 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:04.167771 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 78988.1us
I20260709 13:08:04.133919 16451 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:04.129798 16502 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.189049 12771 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.141137 16450 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.136193 16458 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.211688 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:04.213128 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 194047us
I20260709 13:08:04.214285 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.217856 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:04.222854 12805 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:04.142208 16511 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.182969 16340 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.207196 16489 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:04.221683 12808 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:04.222879 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.132586 15977 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.227720 16511 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:04.228410 16446 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.229801 16502 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.230996 16334 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.232296 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:04.129498 16452 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.213163 16403 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:08:04.206188 16387 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.261595 12882 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:04.264725 16489 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.294936 13514 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.226085 16471 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.243033 16412 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:04.297019 16412 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.299425 16412 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.288887 16144 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:04.300263 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.289134 16309 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:04.301208 16309 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:04.301698 12773 leader_election.cc:336] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.616s (SENT)
I20260709 13:08:04.302291 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.304160 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.304387 16144 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.303687 16309 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.304920 16510 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:08:04.312335 16453 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.295607 16489 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.314425 16489 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.317744 16501 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:04.318156 16501 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.319018 16501 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.322575 16334 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.324914 16451 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:08:04.328461 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 105688us
W20260709 13:08:04.328689 12773 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.685s (SENT)
I20260709 13:08:04.329100 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.331480 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:04.332226 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 112652us
W20260709 13:08:04.332571 12803 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:08:04.332863 12803 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:08:04.333458 12807 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.294457 16502 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:04.344458 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 214811us
I20260709 13:08:04.295536 15977 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.349227 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:04.355371 12882 raft_consensus.cc:606] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:04.355782 12882 raft_consensus.cc:614] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.269644 16511 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.356422 16450 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:04.358475 16450 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:04.350374 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 136204us
I20260709 13:08:04.351202 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.360814 12696 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.361665 16309 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:04.361718 12771 leader_election.cc:400] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11.
I20260709 13:08:04.364176 12771 leader_election.cc:403] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:04.310463 16500 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.381s	user 0.005s	sys 0.005s
I20260709 13:08:04.286761 16314 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:04.366920 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.372747 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:08:04.373713 12802 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:04.349824 16317 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.314646 16452 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.390159 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:04.390645 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46399.6us
W20260709 13:08:04.366991 16507 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:04.392591 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.395887 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.397469 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.391606 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.372124 16340 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.405709 12881 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:04.375167 16501 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.376729 15977 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11.
I20260709 13:08:04.363168 16390 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:04.421387 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.428251 12805 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:04.402326 16412 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.402249 16471 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.407389 16312 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.434360 12803 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:04.410332 16453 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:04.451795 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:04.452255 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:04.459115 12882 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.469683 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.431887 16481 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.444089 16466 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.449467 16340 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:04.471587 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88686.4us
I20260709 13:08:04.472235 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:04.426242 16510 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:08:04.489667 12878 raft_consensus.cc:606] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:04.470579 16144 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.475586 16516 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:04.493362 16509 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:08:04.494997 16513 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.496063 16508 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:04.497385 16526 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
I20260709 13:08:04.499377 15637 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:04.501678 16312 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:04.464672 16488 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.509799 16360 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:04.470192 16471 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.513362 12882 raft_consensus.cc:2410] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:04.514099 16144 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.515049 16450 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.517102 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 156463us
I20260709 13:08:04.526870 15637 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.509532 12878 raft_consensus.cc:614] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.481670 16525 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.515728 16516 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.544719 16144 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.544977 16516 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.546532 16516 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.546739 16312 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.536762 16360 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:04.535524 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.535948 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.521152 16340 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.539142 16488 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:04.541821 16511 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.471439 16518 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:08:04.542567 16450 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.523249 16508 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.559201 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.560173 12801 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:04.553649 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 156226us
I20260709 13:08:04.549564 16360 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:04.564881 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 183501us
I20260709 13:08:04.571818 12803 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:04.572635 12699 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:04.556547 16522 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.579800 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:04.575021 13484 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.151s (SENT) [suppressed 54 similar messages]
I20260709 13:08:04.583885 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:04.586175 16533 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:08:04.588573 16518 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:04.591480 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.594041 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:04.594841 12878 raft_consensus.cc:606] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:04.595184 12878 raft_consensus.cc:614] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.589895 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:04.576013 16403 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.601346 16297 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:04.601663 16518 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:04.607255 16508 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.608258 16489 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.608615 16508 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.609295 16489 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.610476 15637 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.601704 16530 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:08:04.611999 16530 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:04.589506 13512 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.578969 16529 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:04.620447 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:04.614076 16530 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.573885 16347 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:08:04.625555 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.613564 16518 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:04.597101 16481 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:04.614439 15977 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.598006 16144 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:04.636157 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54264.5us
W20260709 13:08:04.673238 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 98251.9us
W20260709 13:08:04.679478 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91136.7us
W20260709 13:08:04.679791 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52296.2us
I20260709 13:08:04.681589 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:04.682418 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47585.7us
I20260709 13:08:04.683135 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.685472 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.686935 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.687836 16502 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.688547 16502 raft_consensus.cc:2764] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:04.689281 16502 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:04.689437 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:04.688402 16403 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:04.691807 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:04.631821 16518 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.694140 12800 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:04.696782 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.697131 12801 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:04.692207 12771 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.698700 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:04.699561 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.671886 16144 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.633885 16481 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.691190 16359 consensus_meta.cc:287] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.006s
I20260709 13:08:04.705185 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.706598 16513 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.633450 16531 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:08:04.712421 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.691064 16471 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.699880 16502 consensus_queue.cc:1243] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:04.720330 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:04.721949 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.706733 16541 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.715832 16144 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.717775 16481 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.631889 16340 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.734236 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.736647 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.691288 16446 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:08:04.749752 16547 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:04.750340 16547 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:04.750722 16547 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.634470 16529 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.826637 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.827105 16529 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.681197 15977 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.827481 12802 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:04.828815 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.829761 15977 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.829993 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:04.830664 12802 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.833758 12803 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:04.836270 12803 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:04.838434 12803 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:04.838624 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:04.840422 16493 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.840862 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.841123 16493 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:04.841691 16541 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.842041 16541 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.842361 16541 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.844689 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:04.846146 16387 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:04.846336 16488 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.740576 16518 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.848297 16518 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.685497 16501 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:08:04.721649 16530 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.852980 16530 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:04.748126 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.739173 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57697.3us
I20260709 13:08:04.726902 16513 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:04.856858 16535 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:04.857344 16535 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.728590 16471 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:04.857472 16513 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.858332 16535 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.858700 16471 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.759063 16511 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.738348 16466 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:04.760462 12773 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.038s (SENT)
I20260709 13:08:04.861085 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.763082 12808 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:04.764914 12806 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:04.761562 12807 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:04.861641 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:04.766299 16525 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.767235 16334 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:04.774256 16547 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:04.722620 16359 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.792635 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:04.880024 12878 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:04.732848 16482 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:04.806325 12801 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:04.808960 16522 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:04.809664 16523 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.810626 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:04.883383 12805 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:04.811957 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 75377.9us
I20260709 13:08:04.884083 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.892416 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:04.894860 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.895730 12882 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:04.897380 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.882910 16412 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.891811 16466 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:04.908511 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 148103us
I20260709 13:08:04.908679 16547 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:04.909665 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:04.910501 12876 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:04.910537 12730 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:04.914902 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.915796 12882 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:04.918968 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.921515 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.922637 12881 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:04.814613 16144 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.846547 16387 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.927871 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:04.928793 13514 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:04.861164 16311 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:04.733418 16502 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:04.759677 16450 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:04.862730 15637 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:04.881515 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:04.859840 16535 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.877686 16334 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:04.952123 16334 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:04.934695 12802 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:04.926240 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.919205 16466 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:04.944183 16537 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.883183 16493 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:04.947743 16387 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:04.948879 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 64903us
I20260709 13:08:04.944201 16536 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:04.956409 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:04.931635 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:04.982221 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 50686.6us
W20260709 13:08:04.983801 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.957322 12877 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:04.973620 13514 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:04.975834 12805 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:04.937000 16312 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:04.983541 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:04.987458 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:04.960412 12800 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:05.002012 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:05.004336 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:05.005156 12805 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.961078 16511 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:05.018705 12847 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:04.978376 16509 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:05.009691 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.996414 16412 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.985939 16502 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:05.032050 16347 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:05.020417 16258 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.998679 16309 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.034209 16412 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:05.036196 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.030282 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:05.017324 16387 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:05.040602 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 352550us
I20260709 13:08:04.986043 16489 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:04.985845 16547 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:08:04.981053 16537 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.016752 16334 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.025365 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:04.999353 16501 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:05.001708 16531 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:08:05.062868 12805 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:05.057520 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:05.043529 16314 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:05.020167 16529 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:08:04.985983 16466 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:05.068655 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 157467us
I20260709 13:08:05.050786 16412 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.043181 16347 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:05.048875 16493 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.045480 16309 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.069859 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.070369 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.072326 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.022006 16482 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:05.077836 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.080621 12799 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:05.108372 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.025878 16511 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.084420 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.081174 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:05.027616 16509 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.109525 12727 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:05.109426 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.110235 12730 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:08:05.065394 16488 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:05.140200 16488 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:05.141263 16488 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.146788 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.148123 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.148672 12725 raft_consensus.cc:2376] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
I20260709 13:08:05.149552 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.108604 12726 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:05.115231 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46881.3us
I20260709 13:08:05.154366 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.155444 16522 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:05.112670 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.121548 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.125994 16509 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.126564 16450 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:05.159248 16450 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:05.160809 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.160365 16450 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.017032 16516 consensus_queue.cc:1175] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "83d2731c4bc049b3929d6c39670f5fd8" responder_term: 10 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:05.131722 16502 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.164230 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.133672 16537 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.137038 16551 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:05.138196 16446 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:05.085807 16347 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.074633 16258 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:05.113955 16541 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.229621 12733 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:05.150244 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:05.150719 16312 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:05.151528 16510 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.233065 16312 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.233196 16510 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.152170 16501 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.158533 12724 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:05.236353 12725 raft_consensus.cc:2376] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 5. Re-sending same reply.
I20260709 13:08:05.237694 16312 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:05.125509 16466 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:05.167562 12727 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:05.168118 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 166913us
I20260709 13:08:05.240298 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:05.235958 16501 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.242205 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:05.175096 16359 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:05.191114 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.081992 16314 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:05.245918 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.200757 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.083711 16536 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:05.197403 12773 leader_election.cc:336] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.399s (SENT)
I20260709 13:08:05.197522 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:05.116418 16309 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.139403 16417 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:05.246311 12731 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:05.250558 12732 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
W20260709 13:08:05.229251 16360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.013s	sys 0.010s
I20260709 13:08:05.198716 16446 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:05.204525 16551 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:05.244278 16506 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.249s	user 0.000s	sys 0.004s
I20260709 13:08:05.290693 16501 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.254402 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:05.247864 16523 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:05.293336 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51316.4us
I20260709 13:08:05.268162 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.269019 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:05.230494 16258 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:05.251794 16536 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.274600 16551 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.248327 16312 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:05.303782 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:05.267232 16360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.014s	sys 0.010s
W20260709 13:08:05.305606 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 108257us
W20260709 13:08:05.316651 12773 leader_election.cc:336] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 2.089s (SENT)
I20260709 13:08:05.317152 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:05.312860 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.313108 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:05.318835 13514 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.313828 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.264887 16144 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.260092 16417 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:05.300165 16481 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.324978 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 294811us
I20260709 13:08:05.327543 13518 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:05.318534 16403 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.006s
I20260709 13:08:05.301308 16258 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.304605 16536 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.320225 16511 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.307499 16551 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:05.385928 12729 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:05.390161 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:05.395548 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:05.363091 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:05.374004 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:05.366664 16513 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.394594 16446 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:05.396138 16144 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:05.409554 12881 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.419137 13514 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:05.371727 16466 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.360404 12728 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:05.410094 12873 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:05.415791 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52828.7us
I20260709 13:08:05.419723 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:05.421336 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:05.417866 13487 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:05.356789 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.425115 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0594125630000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:08:05.428711 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.514628 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.516981 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:05.518199 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 86673.9us
I20260709 13:08:05.425343 16527 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.423606 16312 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:05.432497 16550 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:05.432806 16390 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.432087 16493 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:05.530143 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:05.554284 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:05.391633 16314 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.430332 16466 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.576474 12881 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:05.578014 15637 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.579733 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:05.580503 15637 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.555529 16516 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.584252 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:05.562743 16446 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:05.591513 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 218624us
I20260709 13:08:05.562280 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:05.572489 16541 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:05.537560 16527 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.629521 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:05.634236 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:05.586539 16522 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:05.634344 12877 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:05.632077 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 327) took 1015 ms. Trace:
W20260709 13:08:05.638744 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59128us
I20260709 13:08:05.641081 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:05.641937 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.589445 16525 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.645569 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:05.638724 12804 rpcz_store.cc:276] 0709 13:08:04.616605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.616840 (+   235us) service_pool.cc:224] Handling call
0709 13:08:04.628441 (+ 11601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.631967 (+  3526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.632004 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.677932 (+ 45928us) log.cc:844] Serialized 487 byte log entry
0709 13:08:04.864064 (+186132us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:04.864099 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.864162 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.631772 (+767610us) raft_consensus.cc:1685] finished
0709 13:08:05.631793 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.631983 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":163587,"threads_started":1,"wal-append.queue_time_us":616297}
I20260709 13:08:05.650802 12807 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:05.652557 15637 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:05.640538 16549 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:05.624617 16481 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.540779 16417 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:05.675666 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 257975us
I20260709 13:08:05.729440 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:05.656530 16334 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.004s
I20260709 13:08:05.733850 16466 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.720196 12807 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:08:05.736132 12807 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:08:05.738018 12807 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:05.727666 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57948us
I20260709 13:08:05.746892 12847 leader_election.cc:400] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:05.747465 12847 leader_election.cc:403] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.721268 16502 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.725572 12805 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:05.630272 16555 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:05.649802 16493 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.617149 16516 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.732553 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:05.751297 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 225249us
I20260709 13:08:05.662413 16451 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.787231 12877 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:08:05.753404 12726 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.024s
W20260709 13:08:05.788002 12726 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.013s	sys 0.025s
W20260709 13:08:05.720494 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.769871 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:05.749418 16522 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.785737 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.756379 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:05.783887 16563 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
W20260709 13:08:05.799518 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.871639 12805 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:05.875675 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:05.800419 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:05.812214 16557 log.cc:927] Time spent T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.533s	user 0.003s	sys 0.003s
I20260709 13:08:05.813197 12732 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:05.842310 16560 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:08:05.875941 16568 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:08:05.876377 16574 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:08:05.799377 12727 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:05.888626 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:05.889392 12731 raft_consensus.cc:2376] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
W20260709 13:08:05.798977 16553 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 13:08:05.894145 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:05.918208 12801 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:05.894551 12802 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:05.897048 15977 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.922727 15977 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:05.923197 15977 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.923627 12802 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:05.901136 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59886 (request call id 321) took 1047 ms. Trace:
I20260709 13:08:05.924201 13512 rpcz_store.cc:276] 0709 13:08:04.853353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.853505 (+   152us) service_pool.cc:224] Handling call
0709 13:08:04.854134 (+   629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.854544 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.854577 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.855611 (+  1034us) log.cc:844] Serialized 487 byte log entry
0709 13:08:05.085285 (+229674us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:05.098847 (+ 13562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.120097 (+ 21250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.811156 (+691059us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:05.900757 (+ 89601us) raft_consensus.cc:1685] finished
0709 13:08:05.900790 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.901062 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51703552,"thread_start_us":210677,"threads_started":1,"wal-append.queue_time_us":422955}
I20260709 13:08:05.926471 13517 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:05.906008 16565 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:08:05.906692 16566 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.334s	user 0.000s	sys 0.000s
I20260709 13:08:05.870473 16471 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:05.909760 16516 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:05.910741 16564 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:08:05.880828 16312 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.891505 16511 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.916600 16527 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:05.928349 16523 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:05.904455 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 157780us
W20260709 13:08:06.009455 16536 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.002s
I20260709 13:08:06.009696 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:06.009905 16536 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:05.932785 13512 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:06.011983 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.015019 16360 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.015704 16360 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:05.938439 16417 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.019579 16511 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.941342 16575 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:08:05.950708 16387 consensus_meta.cc:287] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 13:08:05.877029 16510 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:05.792445 16334 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.027515 12733 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:08:05.959403 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.028157 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.960770 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.965080 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:06.031122 12805 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:05.976477 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120832us
I20260709 13:08:05.779647 16502 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.956725 16562 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:08:05.964176 16340 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.996093 16551 consensus_meta.cc:287] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.003s
W20260709 13:08:06.001960 16412 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.002s
I20260709 13:08:06.025238 12873 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:05.984606 16258 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.005s
I20260709 13:08:05.796391 16522 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:05.975783 16571 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 13:08:06.031011 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:05.877056 16572 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:08:06.032193 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:06.034108 12881 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:06.025847 16309 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.722s	user 0.004s	sys 0.007s
I20260709 13:08:06.041148 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.021723 16511 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.046375 12800 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:06.091642 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:06.092259 12800 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.039597 16471 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.049256 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:06.033556 16347 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.788s	user 0.007s	sys 0.003s
I20260709 13:08:06.103657 12805 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:06.056198 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.070015 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:06.021718 16536 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:06.051916 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.036095 16334 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:06.131551 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 69914.7us
I20260709 13:08:06.091741 16580 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:06.129755 16511 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.140632 16466 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:06.147488 12800 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:06.109356 16347 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.148093 16539 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:06.149592 16502 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:06.164004 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.054728 16412 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.170524 16511 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.173730 12729 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:08:06.175117 12806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.054s	sys 0.114s
W20260709 13:08:06.176839 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.177543 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.059219 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:06.040695 15977 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.176146 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2025) took 1270 ms. Trace:
I20260709 13:08:06.100533 16309 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.181736 12875 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:06.155885 16582 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:06.167833 16572 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:06.042833 16340 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.176574 16580 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:06.194629 12879 rpcz_store.cc:276] 0709 13:08:04.906152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.906323 (+   171us) service_pool.cc:224] Handling call
0709 13:08:04.923981 (+ 17658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.925947 (+  1966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.925978 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.950822 (+ 24844us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.196986 (+246164us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:05.197030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.197112 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.175745 (+978633us) raft_consensus.cc:1685] finished
0709 13:08:06.175799 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.176048 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1529,"raft.queue_time_us":2662,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":18121,"thread_start_us":245737,"threads_started":1,"wal-append.queue_time_us":445048}
I20260709 13:08:06.106945 16567 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:08:06.058219 16258 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:06.200605 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 141457us
I20260709 13:08:06.201354 15637 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.233460 12881 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:06.256057 15637 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.249114 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.242642 12803 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.110918 16471 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.256740 15637 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.190068 12806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.054s	sys 0.114s
W20260709 13:08:06.250259 16250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.100s
I20260709 13:08:06.269438 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.270038 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2160) took 1564 ms. Trace:
I20260709 13:08:06.276901 12808 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.274902 12848 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:06.278986 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:06.273397 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1904) took 1187 ms. Trace:
I20260709 13:08:06.180724 16466 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.198886 16539 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:06.275651 16250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.024s	sys 0.100s
I20260709 13:08:06.295462 12880 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.267740 16144 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:06.304986 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.306118 12875 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:06.293385 16493 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.267943 16311 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:06.322247 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.271154 16488 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:06.329625 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.330492 12875 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:06.331334 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.323817 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.332494 16580 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.333232 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.316751 16502 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.334602 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.335495 12879 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:06.335086 16502 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.319257 16144 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.337327 16502 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:06.338050 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.339682 12876 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:06.341001 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:06.341187 12876 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.341681 12729 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.342401 16583 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:06.342998 16583 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.345044 16340 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.345224 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.322669 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:06.325067 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.346158 12880 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.347373 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.348577 12727 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:06.349740 12879 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:06.319370 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.296660 16525 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.324147 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:06.325006 12732 raft_consensus.cc:2368] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
W20260709 13:08:06.325304 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 555581us
I20260709 13:08:06.361402 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:06.275594 13484 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.052s
I20260709 13:08:06.366788 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.367724 12733 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:06.367595 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:06.369148 13484 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.013s	sys 0.056s
W20260709 13:08:06.369500 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 610201us
I20260709 13:08:06.370831 12727 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:06.374565 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.375491 12727 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:06.377004 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 335) took 1255 ms. Trace:
I20260709 13:08:06.379278 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.309119 16527 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:08:06.392158 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.393772 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.272548 12806 rpcz_store.cc:276] 0709 13:08:04.705462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.764325 (+ 58863us) service_pool.cc:224] Handling call
0709 13:08:04.764583 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.764782 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:04.974852 (+210070us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.572468 (+597616us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180005ac40. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c065e5 00007f0f41c06568
0709 13:08:06.258363 (+685895us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.264595 (+  6232us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.265666 (+  1071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.265746 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:06.265819 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.265923 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.269930 (+  4007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674,"prepare.queue_time_us":323168,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":79,"raft.queue_time_us":283,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":29540,"spinlock_wait_cycles":3600384,"thread_start_us":922992,"threads_started":2,"wal-append.queue_time_us":412623}
I20260709 13:08:06.377475 12808 rpcz_store.cc:276] 0709 13:08:05.121566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.279656 (+158090us) service_pool.cc:224] Handling call
0709 13:08:05.279911 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.277469 (+997558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.376721 (+ 99252us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54001d42d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:06.376929 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292585728}
I20260709 13:08:06.397696 12731 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 5: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:06.398736 12727 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.404701 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:06.387230 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:08:06.405768 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.406256 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:06.359743 16493 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:06.413034 12878 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:06.412863 12727 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:06.260869 16450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.021s
I20260709 13:08:06.415884 12873 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.417565 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.421078 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.421229 12696 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:06.366297 16522 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:06.424387 12876 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:06.381289 16525 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:06.581809 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2168) took 1195 ms. Trace:
I20260709 13:08:06.713719 12727 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:06.714592 12879 pending_rounds.cc:85] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 6
I20260709 13:08:06.715040 12879 pending_rounds.cc:107] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:06.715339 12879 raft_consensus.cc:2889] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.628378 12729 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:06.716818 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:06.440851 12731 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:06.408535 16334 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.411187 16502 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.439280 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:06.745329 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:06.757786 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.758167 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:06.758424 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.758361 12725 raft_consensus.cc:2410] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:08:06.763021 15637 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.001s
I20260709 13:08:06.763468 15637 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.765792 15637 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:06.491305 12728 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:06.769805 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.771088 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.568010 16537 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:06.772899 16537 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:06.773587 16537 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.435989 12878 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:06.440196 16347 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.777902 16347 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:06.778424 16347 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:06.780695 16347 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:06.707655 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 301082us
I20260709 13:08:06.546379 16340 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:06.916603 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.917590 12875 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
W20260709 13:08:06.704599 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 425713us
W20260709 13:08:06.424927 16450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.009s	sys 0.022s
I20260709 13:08:06.621878 16513 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:06.784632 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:06.943014 12731 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.786984 16598 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.712215 12807 rpcz_store.cc:276] 0709 13:08:05.386773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.738994 (+352221us) service_pool.cc:224] Handling call
0709 13:08:05.739355 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:05.881919 (+142564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.881960 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:05.913882 (+ 31922us) log.cc:844] Serialized 52 byte log entry
0709 13:08:06.291291 (+377409us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.308176 (+ 16885us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.308428 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.308510 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.581525 (+273015us) raft_consensus.cc:1685] finished
0709 13:08:06.581550 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.581730 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141589,"prepare.queue_time_us":16953,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":142839,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":23285,"thread_start_us":362738,"threads_started":1,"wal-append.queue_time_us":662492}
W20260709 13:08:06.439214 16591 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:08:06.788015 16334 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.788352 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.788493 16502 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.789958 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.505172 16511 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.796463 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:06.816874 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.838604 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.420302 16387 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:06.425762 16551 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.689175 16595 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.759057 16599 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260709 13:08:06.435032 16403 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.994982 16403 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.995543 16403 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.942564 16340 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.997876 16403 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:06.863057 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.998508 16523 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.993s	user 0.009s	sys 0.000s
W20260709 13:08:06.998796 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.999712 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.000409 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1335) took 1716 ms. Trace:
I20260709 13:08:07.000608 16539 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.001331 16539 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.000891 12799 rpcz_store.cc:276] 0709 13:08:05.283610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.666173 (+382563us) service_pool.cc:224] Handling call
0709 13:08:05.666526 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.763618 (+ 97092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.763655 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.789614 (+ 25959us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.385062 (+595448us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.385137 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.385239 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.000127 (+614888us) raft_consensus.cc:1685] finished
0709 13:08:07.000153 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.000337 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163909,"raft.queue_time_us":122658,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":80650,"thread_start_us":477739,"threads_started":1,"wal-append.queue_time_us":616080}
I20260709 13:08:06.919708 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:06.760690 16471 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:06.939172 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.003203 13512 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:07.003715 12729 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:06.940311 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:06.785753 16567 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:06.949222 12877 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:06.796713 16525 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.849046 16309 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:06.990593 16596 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
W20260709 13:08:06.991642 16601 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
I20260709 13:08:06.501434 16493 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.997941 16340 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.002169 16539 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:06.862473 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:07.053352 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 190973us
I20260709 13:08:07.053611 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:06.939459 16347 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.010560 12880 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.001s
I20260709 13:08:07.055639 12880 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:07.056633 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.057374 12878 raft_consensus.cc:2376] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8. Re-sending same reply.
I20260709 13:08:07.012279 12728 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:07.014459 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:07.004662 16537 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:06.860303 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 455675us
I20260709 13:08:07.050941 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.008562 16387 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:07.071687 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.072472 12874 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:08:07.038852 16551 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.074090 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:07.079070 12729 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:06.956229 16334 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:07.080116 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 320843us
I20260709 13:08:07.046206 16314 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.952732 16598 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.093946 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.095417 12875 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:07.076814 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.098024 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.131888 12878 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:07.107220 16606 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.067082 16340 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.072321 16591 log.cc:927] Time spent T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:08:07.106361 16417 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.089s	user 0.010s	sys 0.001s
W20260709 13:08:07.107425 12774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.035s	sys 0.057s
I20260709 13:08:07.107897 12727 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:07.137552 12774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.035s	sys 0.058s
I20260709 13:08:07.008294 16595 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.093896 16511 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.144500 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.145380 12878 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:08:07.146489 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.148449 16340 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.153843 16540 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.154733 16540 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.157306 16334 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.157681 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2169) took 1768 ms. Trace:
I20260709 13:08:07.158124 16334 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:07.159255 16334 consensus_queue.cc:1243] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:08:07.134027 16312 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.141s	user 0.009s	sys 0.004s
I20260709 13:08:07.147751 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.158308 12804 rpcz_store.cc:276] 0709 13:08:05.389739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.741765 (+352026us) service_pool.cc:224] Handling call
0709 13:08:05.742088 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.271031 (+528943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.271080 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.296131 (+ 25051us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.608696 (+312565us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:06.608755 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.608878 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.157360 (+548482us) raft_consensus.cc:1685] finished
0709 13:08:07.157392 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.157596 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36418,"raft.queue_time_us":138086,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":25024,"thread_start_us":756186,"threads_started":2,"wal-append.queue_time_us":731913}
I20260709 13:08:07.100407 16403 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.122608 12724 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:07.166500 12724 pending_rounds.cc:85] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:08:07.166621 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:07.098423 12725 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:08:07.073460 16347 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:07.135234 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58665.9us
I20260709 13:08:07.080812 16482 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.094203 16551 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.098929 16314 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.163962 12729 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:07.166777 12724 pending_rounds.cc:107] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:07.136781 16537 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.124752 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.186875 12875 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:07.168764 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.176908 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.178016 12724 raft_consensus.cc:2889] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.167133 12725 pending_rounds.cc:85] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 3
I20260709 13:08:07.189986 12725 pending_rounds.cc:107] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:07.190404 12725 raft_consensus.cc:2889] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.151943 16340 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.191210 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.191741 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.187538 12731 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.168643 16334 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.198031 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:07.199048 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.199297 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:07.200074 13517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 296) took 1400 ms. Trace:
I20260709 13:08:07.197018 12731 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:07.171895 16312 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:07.175663 16609 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.207137 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.178905 16471 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:07.211011 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.211572 12875 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:07.140384 16606 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.218854 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 323) took 1081 ms. Trace:
I20260709 13:08:07.165043 16511 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.201728 12731 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.221338 12731 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.245589 12773 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:07.219246 13520 rpcz_store.cc:276] 0709 13:08:06.137247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.144190 (+  6943us) service_pool.cc:224] Handling call
0709 13:08:06.144553 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.144890 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.144915 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.145390 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.602025 (+456635us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:06.602068 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.602160 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.218648 (+616488us) raft_consensus.cc:1685] finished
0709 13:08:07.218671 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.218798 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1073,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":456199,"threads_started":1,"wal-append.queue_time_us":862527}
I20260709 13:08:07.176471 16403 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.209762 16609 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:07.200711 16614 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:07.259536 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 185572us
W20260709 13:08:07.260659 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.179462 16611 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:07.245810 16340 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.281461 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.286645 12806 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:07.289420 12731 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:07.289981 12731 pending_rounds.cc:85] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:08:07.290299 12731 pending_rounds.cc:107] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:07.290616 12731 raft_consensus.cc:2889] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.220151 16616 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:08:07.302079 12728 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.302368 16403 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.304885 16583 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.305012 16551 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.294697 16555 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.307363 16466 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:07.309054 16604 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:08:07.309929 16606 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.310343 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1344) took 1265 ms. Trace:
I20260709 13:08:07.310763 12801 rpcz_store.cc:276] 0709 13:08:06.044655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.046979 (+  2324us) service_pool.cc:224] Handling call
0709 13:08:06.047318 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.047585 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.047621 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.055162 (+  7541us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.779824 (+724662us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.779865 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.779951 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.310097 (+530146us) raft_consensus.cc:1685] finished
0709 13:08:07.310119 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.310278 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":468661,"threads_started":1,"wal-append.queue_time_us":1020823}
I20260709 13:08:07.312881 12806 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:07.302591 12728 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:07.314911 12728 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.315971 12728 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.283500 16614 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.317021 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.318019 16540 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.179553 16387 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.318318 16614 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:07.311950 12627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 192) took 13464 ms (client timeout 15000 ms). Trace:
I20260709 13:08:07.252839 16523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37656 (request call id 66) took 3821 ms. Trace:
I20260709 13:08:07.222923 16471 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.208240 16334 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:07.278690 16609 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.325081 12727 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:07.267920 12882 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:07.322074 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 457) took 2139 ms. Trace:
W20260709 13:08:07.332386 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 231243us
I20260709 13:08:07.277072 16613 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:07.318864 12627 rpcz_store.cc:269] 0709 13:07:53.848164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.873843 (+ 25679us) service_pool.cc:224] Handling call
0709 13:07:54.834642 (+960799us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.311851 (+12477209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.363210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.433815 (+ 70605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.433872 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:08:04.433891 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:04.500331 (+ 66440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:04.500432 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:04.500465 (+    33us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:08:04.501961 (+  1496us) tablet.cc:701] Row locks acquired
0709 13:08:04.502020 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:08:04.502242 (+   222us) write_op.cc:270] Start()
0709 13:08:04.502418 (+   176us) write_op.cc:276] Timestamp: P: 1783602484502152 usec, L: 0
0709 13:08:04.502447 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:04.503330 (+   883us) log.cc:844] Serialized 6311 byte log entry
0709 13:08:05.107588 (+604258us) op_driver.cc:464] REPLICATION: finished
0709 13:08:05.562434 (+454846us) write_op.cc:301] APPLY: starting
0709 13:08:05.562579 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:05.747931 (+185352us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:05.779379 (+ 31448us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:05.898244 (+118865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:05.898663 (+   419us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:08:05.898723 (+    60us) write_op.cc:312] APPLY: finished
0709 13:08:05.899225 (+   502us) log.cc:844] Serialized 112 byte log entry
0709 13:08:05.986445 (+ 87220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.008212 (+ 21767us) write_op.cc:454] Released schema lock
0709 13:08:06.008299 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.008736 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.008768 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1268764,"reported_tablets":55,"spinlock_wait_cycles":705265024,"child_traces":[["op",{"apply.queue_time_us":441108,"apply.run_cpu_time_us":7837,"apply.run_wall_time_us":446318,"num_ops":16,"prepare.queue_time_us":427542,"prepare.run_cpu_time_us":15933,"prepare.run_wall_time_us":200464,"raft.queue_time_us":325508,"raft.run_cpu_time_us":13231,"raft.run_wall_time_us":258737,"replication_time_us":572239,"thread_start_us":736486,"threads_started":4,"wal-append.queue_time_us":76860,"wal-append.run_cpu_time_us":28009,"wal-append.run_wall_time_us":2334110}]]}
I20260709 13:08:07.332875 12730 rpcz_store.cc:276] 0709 13:08:05.150114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.191559 (+ 41445us) service_pool.cc:224] Handling call
0709 13:08:05.191904 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.200223 (+  8319us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:05.623534 (+423311us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.043904 (+420370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.089906 (+ 46002us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.090049 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:06.090290 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.090469 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.090541 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.143518 (+ 52977us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b180044a220. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:07.289233 (+1145715us) raft_consensus.cc:1685] finished
0709 13:08:07.289272 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.289470 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5381,"prepare.queue_time_us":229858,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":106,"raft.queue_time_us":9403,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":71441,"spinlock_wait_cycles":10991872,"thread_start_us":745881,"threads_started":2,"wal-append.queue_time_us":631399}
I20260709 13:08:07.339562 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:07.340312 12806 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.292634 16340 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:07.281867 16539 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.334338 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.343772 12730 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.285774 16620 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:07.347000 12724 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:08:07.347723 12724 pending_rounds.cc:85] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 4
I20260709 13:08:07.347960 12724 pending_rounds.cc:107] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:07.348198 12724 raft_consensus.cc:2889] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.349244 12730 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.354628 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2160) took 1224 ms. Trace:
I20260709 13:08:07.354733 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.356175 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2159) took 1264 ms. Trace:
I20260709 13:08:07.358196 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.356596 12873 rpcz_store.cc:276] 0709 13:08:06.092276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.107014 (+ 14738us) service_pool.cc:224] Handling call
0709 13:08:06.137261 (+ 30247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.420698 (+283437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.355907 (+935209us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400139554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.356112 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640385920}
I20260709 13:08:07.367271 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.355607 12877 rpcz_store.cc:276] 0709 13:08:06.130379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.137434 (+  7055us) service_pool.cc:224] Handling call
0709 13:08:06.178190 (+ 40756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.007718 (+829528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.354287 (+346569us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54000708d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.354541 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772788480}
I20260709 13:08:07.368095 12732 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
W20260709 13:08:07.371383 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.339071 16613 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:07.384527 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.384954 12728 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:07.385519 12728 pending_rounds.cc:85] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:08:07.386456 12728 pending_rounds.cc:107] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:07.386776 12728 raft_consensus.cc:2889] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.359696 16616 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.338320 16551 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:08:07.413460 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:07.360278 16623 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.384296 16595 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.453472 16617 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:07.454375 16617 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.456223 16340 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.458019 16340 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.460309 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.461203 12878 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.418094 16482 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.418818 16513 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:07.200505 13517 rpcz_store.cc:276] 0709 13:08:05.799427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.883427 (+ 84000us) service_pool.cc:224] Handling call
0709 13:08:05.926061 (+ 42634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.926303 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:06.369011 (+442708us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.193697 (+824686us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.198663 (+  4966us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.199618 (+   955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.199677 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.199725 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.199807 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.199938 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369215,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":3396,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":21080,"thread_start_us":678695,"threads_started":2,"wal-append.queue_time_us":670163}
I20260709 13:08:06.280422 12726 rpcz_store.cc:276] 0709 13:08:05.086999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.167992 (+ 80993us) service_pool.cc:224] Handling call
0709 13:08:05.168328 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.168532 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:05.788528 (+619996us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.272991 (+484463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.273051 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:06.273105 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.273187 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.273327 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218624,"prepare.run_cpu_time_us":608,"prepare.run_wall_time_us":5976,"raft.queue_time_us":3433,"thread_start_us":1072798,"threads_started":2}
I20260709 13:08:07.470464 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.425266 16144 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.427168 16606 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.433655 16258 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.435504 16597 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:07.448948 16417 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:07.392457 16613 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.458029 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.396835 16620 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:07.400981 16466 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:07.477099 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.464385 16616 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.456362 16450 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.499264 16450 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.502084 16450 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.449034 15977 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.459331 16314 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.462714 16615 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.503398 16466 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.506208 16466 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.463270 16511 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.464673 16482 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.507287 16482 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.481009 16502 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.509528 16417 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.496639 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.469138 16513 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:07.497375 16614 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.498126 16334 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.522634 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.485510 16412 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.526839 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:07.526172 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.535606 12875 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.483786 16144 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:07.537737 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 292227us
I20260709 13:08:07.534840 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.538724 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.540228 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.543175 12800 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:07.551041 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.552505 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:07.552851 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.489115 16606 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.557916 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:07.556584 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 172125us
I20260709 13:08:07.563616 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1354) took 1062 ms. Trace:
I20260709 13:08:07.567297 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.568310 12802 raft_consensus.cc:2410] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:07.565644 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1357) took 1062 ms. Trace:
I20260709 13:08:07.493120 16597 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.569414 12727 rpcz_store.cc:276] 0709 13:08:06.503043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.796147 (+293104us) service_pool.cc:224] Handling call
0709 13:08:07.565434 (+769287us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400246154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:07.565571 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356823424}
I20260709 13:08:07.565438 12724 rpcz_store.cc:276] 0709 13:08:06.501477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.205865 (+704388us) service_pool.cc:224] Handling call
0709 13:08:07.242128 (+ 36263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.383106 (+140978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.563390 (+180284us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000b4ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.563553 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239961984}
W20260709 13:08:07.583920 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 154233us
I20260709 13:08:07.578656 12878 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:07.523865 16614 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.594362 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.603952 16387 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.604692 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1350) took 1105 ms. Trace:
I20260709 13:08:07.605381 12729 rpcz_store.cc:276] 0709 13:08:06.499673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.083300 (+583627us) service_pool.cc:224] Handling call
0709 13:08:07.131817 (+ 48517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.178585 (+ 46768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.604378 (+425793us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400309154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.604612 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73286016}
I20260709 13:08:07.605778 16387 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.579938 12806 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:07.604846 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.617344 12724 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:07.612522 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.611815 16387 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.629179 12724 pending_rounds.cc:85] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:08:07.630129 12724 pending_rounds.cc:107] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:07.630620 12724 raft_consensus.cc:2889] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.632283 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:07.613004 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.635162 12873 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:08:07.613806 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1355) took 1112 ms. Trace:
I20260709 13:08:07.617425 12732 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.636356 12732 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:07.636130 12725 rpcz_store.cc:276] 0709 13:08:06.501938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.215633 (+713695us) service_pool.cc:224] Handling call
0709 13:08:07.246262 (+ 30629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.291147 (+ 44885us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:07.291192 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.291255 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:07.291307 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.613536 (+322229us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b540040f954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:07.613602 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.613740 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6874,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":102321408}
I20260709 13:08:07.637944 12732 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.611697 16598 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.639173 12732 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.639850 16359 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:07.640493 16359 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.642307 16347 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.642874 16359 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.642314 12847 leader_election.cc:400] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
I20260709 13:08:07.622676 12728 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:07.643805 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.643694 16525 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.644789 12847 leader_election.cc:403] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.616580 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:07.647617 16525 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.645128 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.648530 16525 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.648974 16541 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8.
I20260709 13:08:07.648835 12729 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.651736 12878 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:07.653308 16541 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:07.654281 16541 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.656538 16541 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.658093 16598 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.659184 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2158) took 1603 ms. Trace:
W20260709 13:08:07.663081 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73294.6us
I20260709 13:08:07.663329 12882 rpcz_store.cc:276] 0709 13:08:06.055729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.055883 (+   154us) service_pool.cc:224] Handling call
0709 13:08:07.659002 (+1603119us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400071cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:07.659122 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558247808}
I20260709 13:08:07.664116 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:07.666115 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.667495 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:07.675491 12732 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:07.708472 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 114072us
I20260709 13:08:07.700974 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:07.712873 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.550276 16144 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:07.722026 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 64735.9us
I20260709 13:08:07.662566 16403 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.750754 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86750.9us
I20260709 13:08:07.752169 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.588797 16583 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:08:07.709344 16623 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.757135 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.758277 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.758534 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.770366 12882 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:07.715098 16617 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.776371 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:07.720006 16250 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:07.781011 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 69054.3us
I20260709 13:08:07.326125 16523 rpcz_store.cc:276] 0709 13:08:03.426556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.435987 (+  9431us) service_pool.cc:224] Handling call
0709 13:08:03.754321 (+318334us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fba0a 00007f0f404fb693 00007f0f404fb631 00007f0f41c2e3f1 00007f0f41b679fe 00007f0f41bee749 00007f0f41bef76a 00007f0f41bee91b 00007f0f41bfa03c 00007f0f41bf96b3
0709 13:08:03.802872 (+ 48551us) log.cc:844] Serialized 487 byte log entry
0709 13:08:04.790965 (+988093us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b58003afdd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41b4d43c 00007f0f41b53d53 00007f0f41b53cd9 00007f0f41b53c69 00007f0f41b53c31 00007f0f41b52dfd 000000000038f354 000000000038f199 00007f0f3eb06475 00007f0f3eb087c1
0709 13:08:07.243062 (+2452097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5862,"raft.queue_time_us":226356,"raft.run_cpu_time_us":4110,"raft.run_wall_time_us":321783,"spinlock_wait_cycles":787666048,"thread_start_us":686067,"threads_started":3,"wal-append.queue_time_us":634037,"wal-append.run_cpu_time_us":2475,"wal-append.run_wall_time_us":1052268}
I20260709 13:08:07.768873 12876 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:07.785741 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:07.786535 12873 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:07.751837 16471 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:07.767058 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.747320 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.791620 16634 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.806063 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
W20260709 13:08:07.815637 16629 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 13:08:07.816169 16592 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.470s	user 0.006s	sys 0.013s
I20260709 13:08:07.772650 16403 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.716924 16598 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.752396 16360 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:08:07.820189 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc76143509f64c4faa68973765829aec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:07.794663 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.774303 16623 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.764899 12729 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:07.766539 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:07.839882 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.840695 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.768121 16312 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:08:07.840683 12732 pending_rounds.cc:85] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 3
I20260709 13:08:07.841127 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:07.841710 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.912744 12732 pending_rounds.cc:107] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:08:07.913089 12732 raft_consensus.cc:2889] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.913486 12726 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:07.913645 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.842290 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.754698 16632 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:08:07.779769 16412 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.817840 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.785236 16250 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.837267 16493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.023s	sys 0.049s
I20260709 13:08:07.802346 12629 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 9, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:07.824023 16605 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.904469 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:07.812132 16595 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:07.909574 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 118769us
I20260709 13:08:07.833650 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:07.915614 12615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 95606.6us
W20260709 13:08:07.916339 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.917807 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.940418 12728 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:07.918558 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.909040 16623 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.920426 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:07.847668 16603 log.cc:927] Time spent T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:07.914927 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.707132 16620 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:07.922307 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:07.926594 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.929808 12804 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:07.919618 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:07.930110 16250 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.930279 16493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.024s	sys 0.049s
I20260709 13:08:07.929620 16640 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:08:07.938298 16359 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:07.942237 16595 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:07.943456 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:07.943984 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 110505us
I20260709 13:08:07.944418 16605 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:07.935619 12629 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 8 to 11, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 11 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.945183 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:07.952468 16412 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:07.953310 12696 leader_election.cc:336] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.522s (SENT)
I20260709 13:08:07.953583 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:07.957921 12799 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:07.869982 16628 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:08:07.968855 12726 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:07.924988 13512 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:07.983794 12730 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.958822 16525 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:07.992417 12727 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:07.993014 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:07.973905 12724 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:07.984114 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 135839us
W20260709 13:08:07.989606 12879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.014s
I20260709 13:08:07.994244 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.007776 12725 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:07.994110 12629 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 8 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 14 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.009335 12629 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 6 to 7, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 7 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:08.007014 12879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.014s
W20260709 13:08:07.998091 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 221820us
I20260709 13:08:08.014253 12629 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.023788 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.037992 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:08.042398 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1338) took 1642 ms. Trace:
W20260709 13:08:08.043659 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90159.7us
I20260709 13:08:08.077594 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:08.045833 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.002978 16312 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.040619 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:07.980741 16613 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.013929 16606 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:08.071816 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.994561 16597 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:07.991760 16595 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:08.021449 12629 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 6 to 10, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), pending config changed. New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:08.076128 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49251.8us
I20260709 13:08:08.078845 12806 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:07.994866 16614 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.070845 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.036556 16608 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:08.031271 16360 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.108232 12805 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:08.079854 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:08.039001 16632 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.115960 12629 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.128050 12629 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 9, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 9 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.073607 16466 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:08.124580 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44860.2us
I20260709 13:08:08.140420 12800 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:08.140841 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63360.7us
I20260709 13:08:07.989892 16359 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:08.130710 12629 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.107394 16628 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:08.134198 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:08.145416 12629 catalog_manager.cc:5697] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.115236 16347 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.118878 16493 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:08.137209 16482 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.001s
W20260709 13:08:08.156598 12875 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:08:08.114619 16144 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:08.139994 16649 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 13:08:08.169117 12875 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:08.155001 16539 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.132764 16360 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.158260 16466 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:08.160332 16412 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.993816 16605 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.156082 16628 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:08.179684 16539 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:08.188318 16539 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:08.190071 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45610.1us
I20260709 13:08:08.169858 16634 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.192914 16466 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.193683 16360 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:08.193430 16628 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:08.222645 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.173004 16482 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:08.197134 16359 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:08.197860 16537 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.004s
I20260709 13:08:08.197532 16412 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.198271 16663 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.199748 16595 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.219379 16634 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:08.202500 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.204103 16513 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:08:08.174306 16525 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:08:08.207573 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.209133 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1360) took 1641 ms. Trace:
I20260709 13:08:08.213479 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.253439 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:08.190989 16403 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:08.200476 16645 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:08:08.218003 16617 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:08.230471 16652 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:08:08.319088 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 98890.4us
W20260709 13:08:08.369496 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.677842 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.604435 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.352690 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 107928us
I20260709 13:08:08.680003 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:08.457056 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.685014 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.253897 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 98455.8us
W20260709 13:08:08.235423 16636 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 13:08:08.688267 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 474887us
I20260709 13:08:08.678596 12731 rpcz_store.cc:276] 0709 13:08:06.568290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.325731 (+757441us) service_pool.cc:224] Handling call
0709 13:08:07.326886 (+  1155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.557493 (+230607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.557536 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.563550 (+  6014us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.998211 (+434661us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.081073 (+ 82862us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.081383 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.081477 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.208928 (+127451us) raft_consensus.cc:1685] finished
0709 13:08:08.208948 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.209077 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3663,"prepare.queue_time_us":84022,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3378,"raft.queue_time_us":96088,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":5435,"spinlock_wait_cycles":56045824,"thread_start_us":580022,"threads_started":2,"wal-append.queue_time_us":606140}
I20260709 13:08:08.701256 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:08.531821 16658 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:08:08.704802 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:08.678773 16660 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.375s	user 0.001s	sys 0.001s
I20260709 13:08:08.231443 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:08.400271 16608 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:08.321727 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:08.590982 16250 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:08:08.706348 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:08.707350 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:08.527654 16667 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:08.524694 16653 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.355s	user 0.000s	sys 0.000s
W20260709 13:08:08.408526 16637 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.373s	user 0.002s	sys 0.000s
I20260709 13:08:08.596390 16613 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.251236 16537 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.706436 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:08.535801 16642 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 13:08:08.712363 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:08.714062 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.714916 12730 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:08.251577 16144 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.714987 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.715569 16359 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:08.716248 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.724398 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.244580 16314 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.471s
I20260709 13:08:08.680919 16634 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.399859 16412 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.530644 16482 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.729344 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.319159 16628 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.707587 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.702805 16662 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.709242 16614 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.346767 16360 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.380s
I20260709 13:08:08.724921 16403 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.761883 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57153.3us
I20260709 13:08:08.745478 16613 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.730923 16608 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:08.687872 16513 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.725675 16334 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.742137 12803 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.699782 16595 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.751041 12725 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:08.732154 16250 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.751494 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 299) took 2332 ms. Trace:
I20260709 13:08:08.753894 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:08.746977 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:08.764835 16340 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.262241 16663 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.739789 12731 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.739820 16670 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:08:08.737726 16667 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:08.769932 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.761462 16527 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.775743 12881 rpcz_store.cc:276] 0709 13:08:06.418954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.419121 (+   167us) service_pool.cc:224] Handling call
0709 13:08:06.419483 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.442810 (+ 23327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.442862 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.450508 (+1007646us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:07.459428 (+  8920us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.720832 (+261404us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.720954 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.721162 (+   208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.748606 (+1027444us) raft_consensus.cc:1685] finished
0709 13:08:08.748642 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.751379 (+  2737us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15807,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":42663,"spinlock_wait_cycles":61477888,"thread_start_us":227585,"threads_started":1,"wal-append.queue_time_us":488002}
I20260709 13:08:08.750036 12728 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:08.778986 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.779687 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:08.784498 12807 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:08.784497 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.789501 12799 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:08.789870 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.795373 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.796126 12807 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:08.796996 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.793139 16613 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.763862 16652 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:08.803619 12807 raft_consensus.cc:2410] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:08.814124 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.814874 12807 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:08.765726 16403 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.816712 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.829152 16684 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:08.829840 16684 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.833186 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.783255 16617 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:08.840166 16493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.013s
W20260709 13:08:08.840785 16493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.013s
I20260709 13:08:08.845389 12731 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:08:08.847016 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:08.849259 12875 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:08.849809 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:08.793094 16359 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.791419 16527 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:08.856166 13484 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.547s (SENT)
I20260709 13:08:08.773563 16334 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.794896 16679 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.864737 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.815917 16614 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.869884 12807 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:08.865535 12727 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:08.868444 13484 leader_election.cc:336] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.625s (SENT)
I20260709 13:08:08.871275 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.846062 16684 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:08.787771 16340 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.881443 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.873806 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:08.887622 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.889732 12696 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.942s (SENT)
I20260709 13:08:08.890303 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:08.891193 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:08.893198 12807 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:08.846635 16617 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.898985 12873 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:08.861260 16359 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.902079 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.856469 16613 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:08.904636 16359 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.904748 16613 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:08.905184 16613 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.909781 16663 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.860548 16675 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:08.911861 16667 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.912541 16675 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:08.913733 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:08.913604 16675 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:08.914682 12731 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:08.878300 16671 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:08.912485 12807 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:08.867718 16527 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.876490 16625 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.873313 16687 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.931061 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.892508 16539 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.704s	user 0.004s	sys 0.008s
I20260709 13:08:08.932775 16692 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:08.862627 16620 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:08:08.903429 16617 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:08.933310 12696 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.072s (SENT)
I20260709 13:08:08.957954 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.953963 16672 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.175s	user 0.000s	sys 0.003s
I20260709 13:08:08.077461 12733 rpcz_store.cc:276] 0709 13:08:06.399620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.400255 (+   635us) service_pool.cc:224] Handling call
0709 13:08:07.280877 (+880622us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:08:07.281084 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.281281 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:07.744815 (+463534us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.041898 (+297083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.041979 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.042044 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.042143 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.042311 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8529,"prepare.queue_time_us":634525,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4205,"raft.queue_time_us":511,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11359,"spinlock_wait_cycles":3126016,"thread_start_us":628951,"threads_started":2}
W20260709 13:08:08.936122 16609 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.594s	user 0.013s	sys 0.003s
I20260709 13:08:08.940793 16250 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:08.949241 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1356) took 1665 ms. Trace:
I20260709 13:08:09.027546 12803 rpcz_store.cc:276] 0709 13:08:07.284128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.284355 (+   227us) service_pool.cc:224] Handling call
0709 13:08:07.308394 (+ 24039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.771984 (+1463590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.948853 (+176869us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:08.949146 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3297066880}
I20260709 13:08:08.981503 16616 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:09.031338 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1374) took 1012 ms. Trace:
I20260709 13:08:09.034072 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.943712 16608 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:08.947386 16539 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:08.947165 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 196082us
I20260709 13:08:08.985440 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1365) took 1395 ms. Trace:
I20260709 13:08:09.008895 16359 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:08.988660 16513 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:08.989127 16680 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.995481 16679 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.030805 16616 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:09.010874 16340 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.012928 16613 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.014210 16595 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.014482 16598 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.016729 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:09.013028 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 767520us
I20260709 13:08:09.051735 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:08.984400 16623 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.011s	user 0.012s	sys 0.001s
I20260709 13:08:09.021806 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.056614 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:08.934876 12807 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:09.057547 12880 raft_consensus.cc:2410] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:08:09.024705 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 190313us
I20260709 13:08:09.035672 12804 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:08.987669 16403 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.036767 12802 rpcz_store.cc:276] 0709 13:08:07.589967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.590127 (+   160us) service_pool.cc:224] Handling call
0709 13:08:07.590501 (+   374us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:07.662993 (+ 72492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.663026 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:07.719437 (+ 56411us) log.cc:844] Serialized 78 byte log entry
0709 13:08:07.961084 (+241647us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.003427 (+ 42343us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.964430 (+961003us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18003cc9a0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c0d0bf 00007f0f41c0d038
0709 13:08:08.964759 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.983935 (+ 19176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.984086 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.985084 (+   998us) raft_consensus.cc:1685] finished
0709 13:08:08.985102 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.985374 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1024729,"prepare.queue_time_us":1008975,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":5070,"raft.queue_time_us":137649,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":33022,"spinlock_wait_cycles":40865408,"thread_start_us":177236,"threads_started":1,"wal-append.queue_time_us":351333}
W20260709 13:08:09.060850 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 127579us
I20260709 13:08:09.061190 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.042649 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:08.969652 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.062867 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.047053 12879 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:09.054090 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:09.054994 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:09.062309 12799 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:09.026752 16334 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.069423 16527 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.073905 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1377) took 1049 ms. Trace:
I20260709 13:08:08.947569 16687 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.058332 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.074872 16613 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.040963 16605 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:08:09.074407 12806 rpcz_store.cc:276] 0709 13:08:08.024947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.137310 (+112363us) service_pool.cc:224] Handling call
0709 13:08:08.159490 (+ 22180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.168003 (+  8513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.168081 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.175059 (+  6978us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.345842 (+170783us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.345903 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.346007 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.952793 (+606786us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:09.073556 (+120763us) raft_consensus.cc:1685] finished
0709 13:08:09.073585 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.073838 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1655,"raft.queue_time_us":913,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4938,"spinlock_wait_cycles":4633472,"thread_start_us":151138,"threads_started":1,"wal-append.queue_time_us":561871}
I20260709 13:08:09.076766 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1362) took 1530 ms. Trace:
I20260709 13:08:09.077049 16687 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:09.055568 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:09.049229 16360 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:08:09.073326 16359 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:09.078886 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.079092 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:09.079305 16689 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.079843 16689 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.080224 16689 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.080243 16679 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.077278 12806 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.045921 16493 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:09.080940 16679 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:09.082159 12806 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:09.081913 16679 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.043164 16250 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:09.064142 16623 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.085464 16623 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:09.056725 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.065058 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.055176 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:09.086578 12805 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 4.
I20260709 13:08:09.068361 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:09.074023 16527 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:09.044369 16314 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:09.045569 16684 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:09.046689 16680 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.085934 16412 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:08:09.096103 16680 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.071946 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.078816 16595 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.096902 12807 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:09.097440 16595 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.098210 12807 raft_consensus.cc:1240] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:09.086723 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.087270 12878 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.100502 16613 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.066452 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.101948 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.102298 12802 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:09.086807 12799 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:09.101468 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:09.080576 12803 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:09.087898 12881 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:09.069085 16403 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:09.061635 12696 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.197s (SENT)
W20260709 13:08:09.086624 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.077212 12800 rpcz_store.cc:276] 0709 13:08:07.546305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.546694 (+   389us) service_pool.cc:224] Handling call
0709 13:08:07.547100 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.140888 (+593788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.076524 (+935636us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400034654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:09.076712 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359760768}
I20260709 13:08:09.108176 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.091713 12805 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:09.088629 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:09.032160 16609 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.107739 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:09.117678 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56040.6us
W20260709 13:08:09.118781 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.118963 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.119685 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.127595 16359 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.127928 16626 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.128304 16359 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.128770 16626 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.129655 16626 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:09.117146 16412 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:08:09.130218 16626 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.130825 16359 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:09.131110 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1360) took 1590 ms. Trace:
I20260709 13:08:09.116830 16513 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.133929 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.143649 12727 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:09.134467 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.134783 12724 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.134907 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.144912 12729 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:08:09.145138 12731 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:09.136511 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.146759 12726 raft_consensus.cc:2410] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:09.136794 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:09.147841 12730 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.137221 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.152480 12732 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:09.138710 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.154800 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:09.154071 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 108945us
I20260709 13:08:09.156255 16615 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.157130 16615 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.158193 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:09.159461 16412 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:09.160378 16412 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.161616 12699 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.160116 16623 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.164301 16623 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.164772 16623 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.164974 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:09.131458 12801 rpcz_store.cc:276] 0709 13:08:07.540449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.540662 (+   213us) service_pool.cc:224] Handling call
0709 13:08:07.541075 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.767137 (+226062us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:07.790193 (+ 23056us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.966876 (+1176683us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.985381 (+ 18505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.985443 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:08.985518 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.130879 (+145361us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400032d54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:09.130927 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.131051 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":797589,"prepare.queue_time_us":807735,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":107,"raft.queue_time_us":31010,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"spinlock_wait_cycles":519205632,"thread_start_us":386720,"threads_started":2,"wal-append.queue_time_us":205052}
I20260709 13:08:09.168756 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:09.169519 12733 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.190208 12802 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:09.181466 12878 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:08:09.184973 12730 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:09.177729 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:09.192426 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.173076 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.077450 16605 consensus_queue.cc:1059] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:08:09.194049 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:09.200774 13513 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.194015 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.196969 12799 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:09.099957 16595 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.206032 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:09.121876 16527 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.214718 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58270.3us
I20260709 13:08:09.168107 16412 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:09.229158 16598 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:09.229809 16598 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.230248 16598 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.142781 16466 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.170291 16403 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.232892 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:09.131876 16613 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.196224 16684 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:09.306600 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.317291 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:09.317503 12805 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:09.190384 16537 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.318079 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:09.304159 16691 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.278s	user 0.004s	sys 0.000s
I20260709 13:08:09.268918 12725 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:09.328066 16609 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.329736 16387 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.189471 16616 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.290997 16466 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:09.306615 16647 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.293s	user 0.010s	sys 0.000s
I20260709 13:08:09.334340 13513 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:09.317950 12733 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:09.324894 12803 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:09.191491 16615 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:09.334231 16656 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:09.357191 16417 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.360743 16314 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:09.361650 16314 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:09.291255 16689 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.305629 16692 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.180583 16634 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.375160 16541 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.375613 16541 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:09.348776 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.372938 16689 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.342329 16387 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.353381 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:09.320744 16684 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.252286 16527 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.354696 16466 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.356545 16616 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.365648 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:09.363031 16314 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.337803 16537 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.267028 16502 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:08:09.232934 16340 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 13:08:09.369493 16347 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.372716 16692 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.376499 16541 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.322579 16613 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.377138 12806 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.715135 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:09.552740 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 319916us
W20260709 13:08:09.556846 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.525000 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:09.033783 12808 rpcz_store.cc:276] 0709 13:08:08.019382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.019489 (+   107us) service_pool.cc:224] Handling call
0709 13:08:08.019793 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.020060 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:08.965361 (+945301us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.030357 (+ 64996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.030975 (+   618us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:09.031039 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.031124 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.031274 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945515,"prepare.queue_time_us":946038,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":112,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":1600,"spinlock_wait_cycles":2503424,"thread_start_us":64498,"threads_started":1,"wal-append.queue_time_us":65390}
W20260709 13:08:09.668126 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.401732 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:09.721058 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:09.586628 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 348490us
W20260709 13:08:09.534662 13513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38680 (request call id 326) took 2340 ms (client timeout 2451 ms). Trace:
W20260709 13:08:09.723344 13513 rpcz_store.cc:269] 0709 13:08:07.193881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.194105 (+   224us) service_pool.cc:224] Handling call
0709 13:08:09.534386 (+2340281us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54006a0c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:09.534548 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4604521856}
I20260709 13:08:09.715832 12725 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.731340 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2199) took 1533 ms. Trace:
I20260709 13:08:09.736928 13520 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:09.448542 16651 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 1.315s	user 0.011s	sys 0.016s
I20260709 13:08:09.380636 16634 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.342834 16539 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:09.769963 12696 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.868s (SENT) [suppressed 29 similar messages]
W20260709 13:08:09.746883 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.781566 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56050.9us
I20260709 13:08:09.782204 12806 rpcz_store.cc:276] 0709 13:08:08.197519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.082880 (+885361us) service_pool.cc:224] Handling call
0709 13:08:09.083165 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.714884 (+631719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.731025 (+ 16141us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002b20d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:09.731274 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675703168}
W20260709 13:08:09.704429 16699 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:09.741305 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:09.382172 16657 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:09.786803 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:09.802251 13513 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.473275 16359 raft_consensus.cc:3055] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:09.381435 16525 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:09.350507 16617 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:09.809392 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68185.5us
I20260709 13:08:09.725082 16387 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.378970 16580 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:09.481769 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:09.724673 16347 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.784547 15977 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.481252 16626 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.777060 16541 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.535017 16644 consensus_queue.cc:1059] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.277s
I20260709 13:08:09.661512 16623 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.787379 16471 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.855150 16471 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.855623 16471 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.532820 16417 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.265s
W20260709 13:08:09.426543 16702 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:09.856562 16623 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.851773 13512 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:09.825039 16580 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:09.862169 16580 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.816807 16539 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.863667 16539 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.864189 16539 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.787609 16628 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.870867 16417 raft_consensus.cc:3055] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:09.871353 16417 raft_consensus.cc:740] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:09.872150 16692 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.872372 16417 consensus_queue.cc:260] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.873487 16417 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:09.876117 16661 consensus_queue.cc:1175] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 13:08:09.871063 16628 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.879038 16628 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.475622 16450 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.326s
I20260709 13:08:09.791469 16466 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:09.739599 16638 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:08:09.808492 16525 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:09.882797 13513 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:09.802048 16657 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:09.894976 16525 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.895505 16657 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.896540 16525 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.896853 16657 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.802130 16403 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:09.901738 16387 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.880112 15977 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.904387 16466 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.906347 15977 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.807319 16359 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:09.478286 16598 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:09.811843 16314 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.908114 16537 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.908951 16598 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.906574 16466 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.909812 16613 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.821029 16527 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:09.477517 16611 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:09.913219 16684 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:09.937822 16617 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:09.952895 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.960140 12725 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
W20260709 13:08:09.967113 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.907752 16359 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:09.961716 16340 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:09.961040 16680 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.976212 16334 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.985558 16340 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:10.039391 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 260886us
I20260709 13:08:09.987576 16387 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:09.994757 16359 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.046263 13513 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:09.991986 16680 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.049360 16663 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.051229 16663 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:10.052636 16707 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:10.053753 16663 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:10.064481 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.065586 12696 leader_election.cc:336] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.961s (SENT)
I20260709 13:08:10.066315 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:10.078966 16712 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.079051 16717 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:10.079908 16712 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.082571 16387 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.085136 16712 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.086988 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:10.088150 16340 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.089252 16340 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.092689 16347 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.100986 16347 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:10.106658 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.050101 16539 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.114929 16539 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.067744 16471 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.139051 16471 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.067620 16638 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:10.148408 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 332512us
I20260709 13:08:10.150616 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.152698 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.154111 16716 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.154721 16716 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.167212 16511 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:10.168414 16511 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:10.170190 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.175004 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:10.171219 16680 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.179167 16634 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.182646 16634 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.183255 16634 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.188215 16679 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.155282 16716 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.179967 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52660 (request call id 0) took 5894 ms. Trace:
I20260709 13:08:10.181071 16511 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.192281 16611 rpcz_store.cc:276] 0709 13:08:04.281149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.281461 (+   312us) service_pool.cc:224] Handling call
0709 13:08:04.299045 (+ 17584us) log.cc:844] Serialized 487 byte log entry
0709 13:08:04.546219 (+247174us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18003fdf00. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41b4cb0b 00007f0f41bd1b63 00007f0f41bf9752 00007f0f41bf19fa
0709 13:08:10.175507 (+5629288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22709,"raft.run_cpu_time_us":2043,"raft.run_wall_time_us":181501,"spinlock_wait_cycles":5010816,"thread_start_us":118289,"threads_started":2,"wal-append.queue_time_us":75557,"wal-append.run_cpu_time_us":3732,"wal-append.run_wall_time_us":1161524}
I20260709 13:08:10.188835 16679 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.196745 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.194828 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.198428 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:10.201799 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.206795 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.215010 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.215255 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.215569 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.215687 12730 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:10.215956 12724 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:08:10.216145 12725 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:08:10.218116 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.218729 12732 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:10.218752 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.219940 12726 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.203034 16689 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.221443 12804 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.227596 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.205601 16631 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:10.203562 16334 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:10.222386 12730 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:10.223801 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.224349 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.239209 12808 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.239786 12799 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:10.240211 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.240823 12808 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.241074 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.241784 12799 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.225630 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.226292 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.210604 16511 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.228524 12800 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:10.229772 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.256716 12727 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.211234 16715 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:10.206333 16347 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:10.264374 16334 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:10.265831 12730 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:10.244238 12801 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:10.267163 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.244009 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.222390 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.268500 12802 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.268651 12805 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:10.244967 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.236961 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.270411 12804 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.247403 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.272372 12803 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:10.204365 16471 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:10.251403 16679 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.252386 12808 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:10.252372 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.258551 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.274222 12800 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:10.265569 16334 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.222520 16611 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:10.247288 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.271723 12804 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:10.287302 12732 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.276010 12696 leader_election.cc:336] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.189s (SENT)
W20260709 13:08:10.302973 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.306382 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.213996 16638 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:08:10.259579 16631 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:10.324416 16663 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.296686 16347 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:10.333993 16697 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:10.336342 16340 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:10.304595 16616 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.321842 12727 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:10.352883 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.353868 12725 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:10.341719 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.343218 12732 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:10.287031 16611 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:08:10.345808 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 1.12833e+06us
I20260709 13:08:10.339803 12802 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:10.286402 16540 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:08:10.361876 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2076) took 1245 ms. Trace:
I20260709 13:08:10.358764 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.360623 12799 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.327579 16715 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:10.363447 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:10.366307 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.367158 12845 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:10.368870 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:10.362301 12876 rpcz_store.cc:276] 0709 13:08:09.116784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.117056 (+   272us) service_pool.cc:224] Handling call
0709 13:08:09.117441 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.122017 (+  4576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.122064 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.131361 (+  9297us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.340124 (+208763us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:09.364950 (+ 24826us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.847823 (+482873us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b18003530e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:10.295805 (+447982us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003530e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f45ac758f 00007f0f3eb06571 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd
0709 13:08:10.361524 (+ 65719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.361622 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.361664 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:10.361679 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.361814 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1268207,"prepare.queue_time_us":26147,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":19767,"raft.queue_time_us":59907,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11840,"spinlock_wait_cycles":61622400,"thread_start_us":208266,"threads_started":1,"wal-append.queue_time_us":426803}
I20260709 13:08:10.364430 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.347712 16340 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:10.372318 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.359319 16713 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.370194 16144 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.348026 16663 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.352873 16609 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:10.423727 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.420789 12726 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:10.425697 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.359217 16616 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:10.398434 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.365512 16712 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:10.400627 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.402238 16717 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:10.407238 16716 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:10.394767 16713 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.408453 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.410205 16525 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.411052 12877 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:10.450167 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.450865 12877 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:10.411753 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.412652 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.451714 12873 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.452359 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.413497 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.453362 12875 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.451081 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.416138 16536 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:10.417241 12878 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:10.397151 16631 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.419325 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.419523 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.421831 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.385859 16679 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:10.427631 12726 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:10.428992 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.463284 12881 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:10.463478 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.370669 16537 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:10.430718 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.359556 16697 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.433382 12728 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:10.478076 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.479133 12728 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:10.392189 16471 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.435984 12876 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.449100 16525 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.490407 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.449163 16713 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.400063 16387 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:08:10.397105 16682 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:08:10.460665 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.464856 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.465409 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.456830 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.467227 12732 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:10.480202 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.479816 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.481590 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.483901 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.439728 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:10.492007 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.401575 16144 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.503628 12729 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:10.461663 16689 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:10.462307 16536 consensus_queue.cc:1243] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:10.509805 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.536310 16580 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.465895 16537 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.525247 12875 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:10.445284 16634 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.524320 12726 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:10.547890 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.550099 12880 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:10.551179 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.524482 12878 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.525631 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.553108 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.553640 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.525646 12733 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 5.
I20260709 13:08:10.526463 12724 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:10.455852 16715 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.527197 16652 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:10.527736 16493 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:10.539565 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 82833.7us
I20260709 13:08:10.467851 16679 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.541657 12731 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:10.430406 16347 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.465607 15977 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.444765 16712 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.545467 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.452852 16340 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.546446 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.572082 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.545547 16144 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.546651 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.591898 12877 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.555626 16698 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.595176 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.554289 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.599591 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.555962 12879 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:10.500661 16525 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.546037 16537 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.603845 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:10.544204 16689 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:10.565248 12876 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:10.563210 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.568732 12802 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:08:10.564358 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.564592 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.587795 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.482883 16471 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.588524 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:10.571602 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.546772 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.590543 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.630817 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:10.653249 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.640564 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:10.653748 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.601783 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.601516 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.655042 12804 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:10.655372 12800 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:10.559593 16536 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:10.564657 16679 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.602631 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.608886 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:10.660854 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52033.4us
I20260709 13:08:10.571267 12881 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.652556 12873 raft_consensus.cc:2410] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:10.653671 12875 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.570839 15977 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.602680 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.662452 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:10.595863 12877 raft_consensus.cc:2376] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8. Re-sending same reply.
I20260709 13:08:10.663726 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.665369 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:10.571130 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:10.666260 12800 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:10.658907 16471 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.659420 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.661008 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.610659 16466 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:10.559134 16620 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:10.666689 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 95662.1us
I20260709 13:08:10.667286 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.627704 16632 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.668371 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.689330 12876 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 5.
I20260709 13:08:10.673399 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.674386 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.571024 16652 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.699846 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.701392 12731 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:10.678825 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.677598 15977 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.677652 16536 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.680351 16334 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:10.687038 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.730950 12875 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.667547 16608 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.677709 16682 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.687062 16360 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.740345 16360 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.742741 16360 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:10.689163 16632 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.745862 16652 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:10.746654 16689 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.748239 12731 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:10.749511 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:10.750352 12731 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:10.663751 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.693320 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:10.752251 12880 raft_consensus.cc:606] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:10.724262 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.752765 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.725104 12881 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:10.650720 16616 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.650112 16697 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:10.652426 16513 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.725140 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:10.729504 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91594.9us
I20260709 13:08:10.687189 16450 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.732100 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.681238 16659 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.687649 12725 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:10.736320 12882 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:08:10.585218 16493 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.738477 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.702639 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.603204 16698 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:10.758427 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.783154 12876 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:10.762313 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.727598 16680 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.769568 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:10.785527 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83003.6us
I20260709 13:08:10.786024 12880 raft_consensus.cc:2410] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:08:10.771047 12875 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.730609 16334 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.756803 16652 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.787786 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.777742 16736 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:10.758523 16716 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:10.786571 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.756199 16682 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.791769 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:10.791975 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66917.5us
I20260709 13:08:10.797152 12731 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.798658 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.769508 16731 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.767452 16663 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:10.761514 16608 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.795190 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.785552 16680 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.800601 12874 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.778721 16659 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:10.802241 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.792325 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.789309 16334 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.814461 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.796682 16697 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.791929 12879 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:10.830168 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.820648 12731 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:10.800588 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 46956.5us
W20260709 13:08:10.803498 16725 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:08:10.822916 12805 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.822664 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.826202 12877 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.799423 16736 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:10.794452 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:10.826960 12880 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.803722 16387 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:10.783166 16450 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.827509 16659 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.839017 12731 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:10.840111 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.855201 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.841863 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.842581 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.820812 16680 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.843195 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:10.859263 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60718.5us
I20260709 13:08:10.861074 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.861410 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:10.862062 12875 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:10.816533 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 154139us
W20260709 13:08:10.847333 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.796478 16652 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.866617 16652 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:10.867985 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:10.815426 16527 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:10.875597 12873 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:10.879220 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.880474 12875 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:10.881454 12877 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.884327 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:10.827832 16608 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.888800 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.857779 16541 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.904628 12882 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:10.906147 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:10.910081 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73909us
W20260709 13:08:10.914353 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46438.3us
I20260709 13:08:10.816267 16731 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.892355 16613 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.920383 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.924386 16541 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:10.870513 16745 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:10.909895 16536 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:10.921211 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.890460 16417 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:10.933444 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.934420 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.934958 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.940583 12877 raft_consensus.cc:2410] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:10.941390 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.942147 12800 raft_consensus.cc:2393] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:10.944195 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.950013 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.950773 12877 raft_consensus.cc:2376] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11. Re-sending same reply.
I20260709 13:08:10.927207 16717 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:10.939678 16730 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:08:10.964931 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:10.922943 16613 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.980495 16613 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.913597 16537 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:10.950470 16728 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:08:10.937206 16740 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:10.931655 16745 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:10.942512 16513 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.938645 16541 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:10.989765 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:10.990558 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 117705us
I20260709 13:08:10.931236 16738 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:10.999936 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.004223 12875 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:11.018537 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:10.930083 16684 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:08:10.984855 16741 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:10.989287 16387 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:11.030021 16712 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.016402 16698 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.060684 12882 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:11.063700 16608 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.066602 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:11.071619 16746 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.076948 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:10.961483 16525 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.089993 12874 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:11.035496 16745 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:11.047662 16739 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:11.097016 12726 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:11.042775 16742 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:11.113808 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:11.129319 12726 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:08:11.141573 12726 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:11.142802 12726 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:10.935654 16736 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.040923 16740 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:11.116046 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:11.167025 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 226345us
I20260709 13:08:11.062095 16682 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:11.190685 13513 raft_consensus.cc:2393] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:11.191715 12878 raft_consensus.cc:2368] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
W20260709 13:08:11.107955 16730 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:08:11.195143 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.042462 16513 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.095415 16741 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.184222 16740 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:11.416975 12879 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.006s
I20260709 13:08:11.478675 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:11.408967 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.580390 12803 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:11.581192 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 413246us
I20260709 13:08:11.582017 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:11.151055 16661 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.197654 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:11.586800 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 389301us
W20260709 13:08:11.536227 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.204433 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:11.592723 12875 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:08:11.608774 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:11.609588 12875 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:08:11.610471 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:11.610538 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:11.611073 12875 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:11.451769 16659 consensus_meta.cc:287] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.005s
W20260709 13:08:11.505820 16713 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.982s	user 0.012s	sys 0.000s
I20260709 13:08:11.151357 16620 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:11.179334 16738 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:11.564143 16698 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.482632 16670 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.441550 16731 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.578358 16450 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:11.565639 16525 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.585536 16537 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:11.641928 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.024s	sys 0.044s
I20260709 13:08:11.635118 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:11.405691 16632 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.485390 16511 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:11.616600 16613 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
W20260709 13:08:11.639770 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.642325 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.024s	sys 0.044s
I20260709 13:08:11.614799 16608 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:11.653668 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 593116us
I20260709 13:08:11.137755 16750 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.538s
I20260709 13:08:11.148777 16746 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.613138 16757 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.635715 16466 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:11.640091 16471 consensus_meta.cc:287] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
I20260709 13:08:11.637370 16670 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:11.608176 16661 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.663720 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:11.670989 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:11.458704 16387 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.534210 16611 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.675741 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:11.675870 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:11.655421 16608 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:11.677945 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 262942us
I20260709 13:08:11.639426 16698 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.619582 16659 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.650235 16537 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:11.619561 16713 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.661036 16757 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:11.665315 16250 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:11.703704 12873 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:11.685401 16748 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.408s	user 0.000s	sys 0.005s
I20260709 13:08:11.677505 16687 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.658958 16613 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:11.684935 16144 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.080s	user 0.013s	sys 0.000s
I20260709 13:08:11.656178 16511 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.667625 16742 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:11.696007 12875 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:08:11.679934 16743 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.694960 16611 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.668069 16471 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:11.705545 16679 consensus_meta.cc:287] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.038s	user 0.013s	sys 0.000s
I20260709 13:08:11.698279 16608 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.681138 16359 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:08:11.714470 15977 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.981s	user 0.013s	sys 0.001s
I20260709 13:08:11.705083 16525 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.752916 16471 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.753309 16511 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.753734 16698 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.717473 16250 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.756892 16250 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.733027 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:11.713950 16757 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.736433 16762 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:08:11.713588 16670 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.748378 16513 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:11.750190 16613 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.750388 16713 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.699694 16738 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.710031 16731 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:11.702343 16620 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.760373 16359 consensus_queue.cc:1243] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:11.921638 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:11.762643 15977 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:11.926008 13484 leader_election.cc:336] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.921s (SENT)
I20260709 13:08:11.648005 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:11.871956 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.873417 12726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.026s
I20260709 13:08:11.874658 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 490) took 1449 ms. Trace:
I20260709 13:08:11.876973 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1980) took 1295 ms. Trace:
I20260709 13:08:11.878255 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1392) took 1394 ms. Trace:
W20260709 13:08:11.703007 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56970.7us
I20260709 13:08:11.882828 12804 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:11.884554 12698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.008s
W20260709 13:08:11.895689 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 219824us
I20260709 13:08:11.735554 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:11.899421 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:11.741504 13512 raft_consensus.cc:2368] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:11.728022 16144 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.004583 12875 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 5.
I20260709 13:08:11.824755 16661 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:12.007597 16144 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.744720 16679 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.021333 12807 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:11.826857 16741 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.030269 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:11.830879 16745 consensus_meta.cc:287] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:08:12.031792 12806 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
W20260709 13:08:12.032523 16334 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 1.195s	user 0.011s	sys 0.008s
I20260709 13:08:12.031915 16745 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.966593 12731 rpcz_store.cc:276] 0709 13:08:10.483674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.858802 (+375128us) service_pool.cc:224] Handling call
0709 13:08:10.883140 (+ 24338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.893676 (+ 10536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.893724 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.894311 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.992457 (+ 98146us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:11.112146 (+119689us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.663994 (+551848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.664530 (+   536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.877649 (+213119us) raft_consensus.cc:1685] finished
0709 13:08:11.877707 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.878012 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76204,"prepare.queue_time_us":475511,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":548980,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":240,"thread_start_us":619334,"threads_started":3,"wal-append.queue_time_us":139416}
I20260709 13:08:12.033002 16334 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.034694 12729 raft_consensus.cc:2368] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
W20260709 13:08:11.764122 16752 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:08:11.822162 16763 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:11.965710 12727 rpcz_store.cc:276] 0709 13:08:10.424654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.428701 (+  4047us) service_pool.cc:224] Handling call
0709 13:08:10.429057 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.438242 (+  9185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.438276 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.438794 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.074423 (+635629us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b18001031e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:08:11.149281 (+ 74858us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.149398 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.149556 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.873461 (+723905us) raft_consensus.cc:1685] finished
0709 13:08:11.873560 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.874343 (+   783us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8900,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3083,"spinlock_wait_cycles":8240512,"thread_start_us":74480,"threads_started":1,"wal-append.queue_time_us":980165}
W20260709 13:08:11.821048 16771 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:11.808637 16340 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.975394 12726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.004s	sys 0.026s
W20260709 13:08:11.980397 12698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.009s	sys 0.009s
W20260709 13:08:11.827592 16680 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.949s	user 0.011s	sys 0.003s
I20260709 13:08:12.043303 16680 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:11.991752 16659 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:11.992761 16769 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:11.992841 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:11.993868 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.994079 16359 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.049584 16680 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.039021 12727 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.051517 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1982) took 1463 ms. Trace:
I20260709 13:08:12.051440 16769 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:11.997004 16493 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:12.001142 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.052152 12727 rpcz_store.cc:276] 0709 13:08:10.588348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.037790 (+1449442us) service_pool.cc:224] Handling call
0709 13:08:12.038536 (+   746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.051102 (+ 12566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.051401 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.001899 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.057199 12800 raft_consensus.cc:1813] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Handling vote request from an unknown peer 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:12.057998 12800 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:12.054776 12631 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:12.058827 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.002952 12802 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:12.003404 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77701.1us
I20260709 13:08:12.060858 16580 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.809321 16670 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.062657 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1983) took 1468 ms. Trace:
I20260709 13:08:12.063251 12727 rpcz_store.cc:276] 0709 13:08:10.596580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.056877 (+1460297us) service_pool.cc:224] Handling call
0709 13:08:12.061262 (+  4385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.061740 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.061797 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.061898 (+   101us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.061950 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.062013 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.062541 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.065860 16773 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.066298 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1984) took 1461 ms. Trace:
I20260709 13:08:12.066826 16773 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:12.071923 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.007640 12875 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:08:12.015152 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.014907 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:12.015396 16757 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.016204 16387 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.016364 12808 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.016758 15977 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:12.017009 16790 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 13:08:11.966181 12728 rpcz_store.cc:276] 0709 13:08:10.581305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.488389 (+907084us) service_pool.cc:224] Handling call
0709 13:08:11.488654 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.488937 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.488982 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.489403 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.876006 (+386603us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:11.876188 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.876360 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.876455 (+    95us) raft_consensus.cc:1685] finished
0709 13:08:11.876468 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.876732 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38606,"raft.queue_time_us":74605,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"thread_start_us":385746,"threads_started":1,"wal-append.queue_time_us":247300}
I20260709 13:08:12.017320 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:12.024690 16679 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.070631 16773 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.100962 12882 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:12.101662 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 316) took 1033 ms. Trace:
I20260709 13:08:12.102031 12882 rpcz_store.cc:276] 0709 13:08:11.068081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.099802 (+1031721us) service_pool.cc:224] Handling call
0709 13:08:12.100321 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.101398 (+  1077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.101592 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:12.019750 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 375634us
I20260709 13:08:11.811375 16742 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.032027 12873 raft_consensus.cc:2368] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12.
I20260709 13:08:12.048552 16740 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.066797 12727 rpcz_store.cc:276] 0709 13:08:10.604488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.064795 (+1460307us) service_pool.cc:224] Handling call
0709 13:08:12.065592 (+   797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.065925 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.065953 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.066015 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.066049 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.066100 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.066214 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.036947 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:12.079110 13521 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 4.
W20260709 13:08:12.079555 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.081064 16387 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.089815 16757 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.090515 16334 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:12.090747 16792 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.143s	user 0.001s	sys 0.004s
I20260709 13:08:12.090924 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2227) took 1296 ms. Trace:
I20260709 13:08:12.091399 16764 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:12.148367 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73834us
I20260709 13:08:12.091733 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1401) took 1591 ms. Trace:
I20260709 13:08:12.092746 15977 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:12.054865 16769 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:12.097740 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 105586us
I20260709 13:08:12.154016 15977 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.155079 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.098333 16493 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.157043 16493 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.157301 16634 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.098713 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:12.158007 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.149446 12733 rpcz_store.cc:276] 0709 13:08:10.499836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.146061 (+646225us) service_pool.cc:224] Handling call
0709 13:08:11.146366 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.879103 (+732737us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:11.879987 (+   884us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.014002 (+134015us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.028747 (+ 14745us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.035985 (+  7238us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.073680 (+ 37695us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:12.073726 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.091175 (+ 17449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.091262 (+    87us) raft_consensus.cc:1685] finished
0709 13:08:12.091278 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.091484 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102408,"prepare.queue_time_us":50697,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2330,"raft.queue_time_us":382027,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":525,"thread_start_us":573233,"threads_started":2,"wal-append.queue_time_us":148052}
I20260709 13:08:12.158371 12728 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:12.161068 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1990) took 1216 ms. Trace:
I20260709 13:08:12.039955 16745 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.161760 16754 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.162633 16754 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.163770 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:12.068691 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2210) took 1508 ms. Trace:
I20260709 13:08:12.164891 12879 rpcz_store.cc:276] 0709 13:08:10.560010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.785763 (+225753us) service_pool.cc:224] Handling call
0709 13:08:10.786049 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.786310 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:11.579051 (+792741us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.021258 (+442207us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.021799 (+   541us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.022080 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.022168 (+    88us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:12.022273 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.068158 (+ 45885us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.068378 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6257,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":12673,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":503,"thread_start_us":383611,"threads_started":1,"wal-append.queue_time_us":324258}
I20260709 13:08:12.069018 16680 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.154073 12730 raft_consensus.cc:2410] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:12.107748 13520 raft_consensus.cc:1813] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Handling vote request from an unknown peer 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:12.168177 13520 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:12.089869 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2208) took 1531 ms. Trace:
I20260709 13:08:12.095844 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 313) took 1037 ms. Trace:
I20260709 13:08:12.106786 16775 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.170142 16775 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.126368 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 317) took 1058 ms. Trace:
I20260709 13:08:12.171420 12873 rpcz_store.cc:276] 0709 13:08:11.068362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.718676 (+650314us) service_pool.cc:224] Handling call
0709 13:08:12.126228 (+407552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.168876 12881 rpcz_store.cc:276] 0709 13:08:11.058096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.094080 (+1035984us) service_pool.cc:224] Handling call
0709 13:08:12.094770 (+   690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.095280 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.095315 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.095368 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.095412 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.095466 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.095587 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.134068 16387 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.144852 16679 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:12.148102 16740 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.092270 12876 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.146790 12880 rpcz_store.cc:276] 0709 13:08:10.794782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.794938 (+   156us) service_pool.cc:224] Handling call
0709 13:08:12.090468 (+1295530us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5400209ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.090723 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34925312}
I20260709 13:08:12.153069 12620 maintenance_manager.cc:419] P d95a6396e3d84f5fb98713ce86e01813: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033368
I20260709 13:08:12.098814 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 312) took 1033 ms. Trace:
I20260709 13:08:12.180648 12875 rpcz_store.cc:276] 0709 13:08:11.044069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.005806 (+961737us) service_pool.cc:224] Handling call
0709 13:08:12.006769 (+   963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.077036 (+ 70267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.077355 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.181744 16679 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.166894 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.183324 12724 raft_consensus.cc:2410] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:08:12.184206 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.168749 12878 rpcz_store.cc:276] 0709 13:08:10.558547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.673154 (+114607us) service_pool.cc:224] Handling call
0709 13:08:12.089330 (+1416176us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400071cd4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.089594 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152200448}
I20260709 13:08:12.185338 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.187271 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.187556 15977 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:12.170089 16745 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:12.167645 16680 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:12.189049 12874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2216) took 1601 ms (client timeout 1661 ms). Trace:
W20260709 13:08:12.189723 12874 rpcz_store.cc:269] 0709 13:08:10.587873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.588282 (+   409us) service_pool.cc:224] Handling call
0709 13:08:12.188543 (+1600261us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400138b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.188775 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343348096}
I20260709 13:08:12.191295 16680 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.161507 12728 rpcz_store.cc:276] 0709 13:08:10.944541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.159792 (+1215251us) service_pool.cc:224] Handling call
0709 13:08:12.160276 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.160546 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.160588 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.160692 (+   104us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.160768 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.160843 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.160991 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.169536 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.130577 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:12.195403 12806 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.198491 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.196543 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1991) took 1233 ms. Trace:
W20260709 13:08:12.175066 12725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.025s	sys 0.026s
I20260709 13:08:12.194526 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.198884 12732 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:12.228204 12724 rpcz_store.cc:276] 0709 13:08:10.963332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.183929 (+1220597us) service_pool.cc:224] Handling call
0709 13:08:12.184373 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.193238 (+  8865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.193269 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.193337 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.193425 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.196282 (+  2857us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b54000b5ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.196336 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.196489 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19731712}
W20260709 13:08:12.237425 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 173984us
W20260709 13:08:12.242942 12725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.030s	sys 0.027s
I20260709 13:08:12.197086 16340 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.199795 16608 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:12.264757 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.268191 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.269388 12732 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:12.271101 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.275076 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:12.281942 16797 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.282552 16797 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.283202 16797 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.283540 16617 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.284240 16617 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.192015 16680 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.193126 16775 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.235510 16679 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.194777 16773 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:08:12.189067 16745 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.261098 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 321) took 1191 ms. Trace:
W20260709 13:08:12.311878 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 124838us
W20260709 13:08:12.313185 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116307us
I20260709 13:08:12.322983 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 493) took 1197 ms. Trace:
I20260709 13:08:12.318190 12732 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.323542 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1399) took 1390 ms. Trace:
I20260709 13:08:12.312405 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1388) took 1837 ms. Trace:
I20260709 13:08:12.305271 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:12.308611 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1395) took 1643 ms. Trace:
I20260709 13:08:12.300009 12728 pending_rounds.cc:85] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 4
W20260709 13:08:12.282452 12730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1371) took 1859 ms (client timeout 2003 ms). Trace:
W20260709 13:08:12.337929 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 187212us
I20260709 13:08:12.330153 12724 rpcz_store.cc:276] 0709 13:08:11.125306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.249431 (+1124125us) service_pool.cc:224] Handling call
0709 13:08:12.322108 (+ 72677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.322507 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.322544 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.322620 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.322668 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.322737 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.322890 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.316443 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.333747 12800 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:12.302821 16611 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.296006 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:12.348376 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1989) took 1391 ms. Trace:
I20260709 13:08:12.294750 13517 raft_consensus.cc:2410] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:12.333763 12804 rpcz_store.cc:276] 0709 13:08:10.665259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.665372 (+   113us) service_pool.cc:224] Handling call
0709 13:08:10.665644 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.984145 (+1318501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.308232 (+324087us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400120a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.308528 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797809920}
I20260709 13:08:12.194089 16740 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:12.302649 16466 consensus_meta.cc:287] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.005s
W20260709 13:08:12.341594 12730 rpcz_store.cc:269] 0709 13:08:10.423294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.423461 (+   167us) service_pool.cc:224] Handling call
0709 13:08:12.282123 (+1858662us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540038e354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.282352 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3969452928}
I20260709 13:08:12.330703 12808 rpcz_store.cc:276] 0709 13:08:10.933298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.933741 (+   443us) service_pool.cc:224] Handling call
0709 13:08:10.934032 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.097855 (+1163823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.323084 (+225229us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540028d054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.323446 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2487461248}
I20260709 13:08:12.340842 12728 pending_rounds.cc:107] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:08:12.361963 12728 raft_consensus.cc:2889] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.331806 12729 rpcz_store.cc:276] 0709 13:08:10.474978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.693546 (+218568us) service_pool.cc:224] Handling call
0709 13:08:12.312068 (+1618522us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540038fc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.312302 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2884701056}
I20260709 13:08:12.348968 12733 rpcz_store.cc:276] 0709 13:08:10.944316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.158950 (+1214634us) service_pool.cc:224] Handling call
0709 13:08:12.159459 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.159834 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:12.180346 (+ 20512us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.335119 (+154773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.335186 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:12.335230 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.335307 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.335436 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75490,"prepare.queue_time_us":20934,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":63,"raft.queue_time_us":92866,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":73180,"threads_started":1}
W20260709 13:08:12.364368 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59449.7us
I20260709 13:08:12.347373 16632 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:12.257730 16608 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.294174 16314 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.257513 16746 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.306684 16613 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:12.293675 12874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:12.294008 16754 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:12.310298 13512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 328) took 1543 ms (client timeout 1876 ms). Trace:
I20260709 13:08:12.376139 12803 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:12.329341 12882 rpcz_store.cc:276] 0709 13:08:11.069525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.109770 (+1040245us) service_pool.cc:224] Handling call
0709 13:08:12.175925 (+ 66155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.181396 (+  5471us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:12.181791 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.260662 (+ 78871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.260715 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:12.260797 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.260879 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.261006 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29008,"prepare.queue_time_us":752,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":75,"raft.queue_time_us":27140,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"thread_start_us":51980,"threads_started":1,"wal-append.queue_time_us":118387}
I20260709 13:08:12.375864 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.312312 12631 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 5 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.391542 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.401160 12729 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:12.398028 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.404146 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.408535 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.408775 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:12.370213 16314 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:12.377789 13517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 327) took 1615 ms (client timeout 1837 ms). Trace:
I20260709 13:08:12.401707 12732 pending_rounds.cc:85] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 4
I20260709 13:08:12.412587 12732 pending_rounds.cc:107] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:08:12.412086 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1396) took 1746 ms. Trace:
I20260709 13:08:12.416498 16754 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:12.416960 16754 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.417361 16754 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.417441 12801 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.418820 12801 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.391340 12874 raft_consensus.cc:606] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:12.420677 12874 raft_consensus.cc:614] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:12.419914 12801 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.385159 16466 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.423197 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.364470 16611 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.413245 12732 raft_consensus.cc:2889] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.384593 16632 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:12.399430 16613 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:12.429591 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56782.3us
I20260709 13:08:12.415762 12807 rpcz_store.cc:276] 0709 13:08:10.666000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.666119 (+   119us) service_pool.cc:224] Handling call
0709 13:08:10.690097 (+ 23978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.021902 (+1331805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.397970 (+376068us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540028bc54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.412003 (+ 14033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060547328}
I20260709 13:08:12.436877 12733 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:08:12.478647 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.443313 12806 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:12.448547 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:12.450671 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 154848us
W20260709 13:08:12.463724 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81168.1us
I20260709 13:08:12.449121 12805 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.495958 12730 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:12.445876 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1397) took 1960 ms. Trace:
I20260709 13:08:12.448966 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1390) took 1973 ms. Trace:
I20260709 13:08:12.520076 12804 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.524528 16738 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.526885 16745 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:12.501781 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2214) took 1940 ms. Trace:
W20260709 13:08:12.382599 13512 rpcz_store.cc:269] 0709 13:08:10.766838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.771856 (+  5018us) service_pool.cc:224] Handling call
0709 13:08:12.309921 (+1538065us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400579754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.310088 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010624384}
I20260709 13:08:12.454212 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1397) took 1787 ms. Trace:
I20260709 13:08:12.450234 12845 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:12.449259 16782 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.464206 16617 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:12.533605 12802 rpcz_store.cc:276] 0709 13:08:10.666399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.666522 (+   123us) service_pool.cc:224] Handling call
0709 13:08:10.666828 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.060427 (+1393599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.433299 (+372872us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000334d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.454111 (+ 20812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2903366528}
W20260709 13:08:12.543445 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.544423 12806 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.545220 12801 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:12.411137 13517 rpcz_store.cc:269] 0709 13:08:10.760860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.765872 (+  5012us) service_pool.cc:224] Handling call
0709 13:08:12.130145 (+1364273us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:08:12.374680 (+244535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4471168}
I20260709 13:08:12.501104 16644 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:12.497311 12726 rpcz_store.cc:276] 0709 13:08:10.485145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.143417 (+658272us) service_pool.cc:224] Handling call
0709 13:08:11.143698 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.040689 (+896991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.040773 (+    84us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.041668 (+   895us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.113473 (+ 71805us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:12.125386 (+ 11913us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.146947 (+ 21561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.172191 (+ 25244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.445397 (+273206us) raft_consensus.cc:1685] finished
0709 13:08:12.445427 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.445755 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59217,"prepare.queue_time_us":11562,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":361437,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":242,"thread_start_us":903059,"threads_started":2,"wal-append.queue_time_us":134504}
I20260709 13:08:12.531922 12876 rpcz_store.cc:276] 0709 13:08:10.565021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.788082 (+223061us) service_pool.cc:224] Handling call
0709 13:08:12.091578 (+1303496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.180205 (+ 88627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.433009 (+252804us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400071cd0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:12.501719 (+ 68710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996964736}
W20260709 13:08:12.558832 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 133146us
I20260709 13:08:12.557593 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.561409 12799 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.561875 12801 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:12.563298 12801 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.563761 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 1981) took 1980 ms. Trace:
I20260709 13:08:12.563910 12802 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:12.564561 12806 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:08:12.564260 12731 rpcz_store.cc:276] 0709 13:08:10.583161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.034828 (+1451667us) service_pool.cc:224] Handling call
0709 13:08:12.035722 (+   894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.103105 (+ 67383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.103204 (+    99us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.103949 (+   745us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.377018 (+273069us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:12.377056 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.377128 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.563508 (+186380us) raft_consensus.cc:1685] finished
0709 13:08:12.563543 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.563696 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5084,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":11605,"thread_start_us":272567,"threads_started":1,"wal-append.queue_time_us":457183}
I20260709 13:08:12.498253 12725 rpcz_store.cc:276] 0709 13:08:10.475675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.781058 (+305383us) service_pool.cc:224] Handling call
0709 13:08:10.781448 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.117977 (+336529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.118021 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.118671 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.187124 (+ 68453us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.358116 (+1170992us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.410782 (+ 52666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.426378 (+ 15596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.426454 (+    76us) raft_consensus.cc:1685] finished
0709 13:08:12.426474 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.448909 (+ 22435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5322,"prepare.queue_time_us":316754,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":38,"raft.queue_time_us":72682,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":30625,"thread_start_us":1303867,"threads_started":3,"wal-append.queue_time_us":565388}
W20260709 13:08:12.582717 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 207835us
I20260709 13:08:12.569532 16617 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:12.585059 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.589644 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.590592 12806 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:12.589649 16450 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.591693 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.597559 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:12.598398 12806 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.608719 16613 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.612913 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:12.612790 16450 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:12.614470 16450 consensus_queue.cc:1243] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:12.614598 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:12.579487 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.444609 16314 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:12.623178 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.625312 16782 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:12.625530 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82035.5us
I20260709 13:08:12.626219 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:12.626605 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.627161 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.627605 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.628468 16670 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.628948 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.628470 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.630366 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:12.631001 12802 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.549726 16632 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.632373 16670 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:12.633015 16670 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.633491 16670 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.617003 16617 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.626251 16631 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:12.636318 16745 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.637233 12803 raft_consensus.cc:1240] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.637372 16745 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.636796 16631 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.625258 16314 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.636569 16617 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.642009 12804 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:12.615696 16450 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.638757 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.647433 12803 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:12.648463 16652 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.639210 16782 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.652968 16682 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.643854 16493 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.662045 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:12.650332 12806 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:12.649847 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.659386 16652 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.661281 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.661605 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:12.664110 16782 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.681526 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.679116 12848 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:12.665685 16493 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:12.707855 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:12.677237 16652 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.649827 16797 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.640880 16644 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.766095 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:12.768946 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.772946 12803 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.774825 12801 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:12.778290 13484 leader_election.cc:336] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.933s (SENT)
I20260709 13:08:12.781801 16644 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:12.783311 16347 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.784192 16347 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.787307 16347 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:12.793642 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 106163us
I20260709 13:08:12.763386 16775 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.813252 12802 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:12.783212 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:12.824082 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 197079us
W20260709 13:08:12.845618 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 166611us
I20260709 13:08:12.849030 12807 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:12.830832 16775 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:12.846917 16755 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.822436 16754 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.907411 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:12.910092 16493 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.875032 16755 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.839172 16670 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.890937 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:12.927690 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58155.9us
I20260709 13:08:12.891398 16450 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.911904 16493 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.930657 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:12.933177 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62089.1us
I20260709 13:08:12.933364 16775 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.935606 16754 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.923524 16755 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.923887 16682 consensus_queue.cc:1243] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:12.954743 16450 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.955197 16450 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:12.955394 16682 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.955596 16450 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.955952 16682 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:12.958058 16794 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.609s	user 0.003s	sys 0.000s
I20260709 13:08:12.958447 16613 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:12.947511 16810 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.947772 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:12.951764 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:12.952334 16631 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:12.952618 16741 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.953501 16797 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:12.953678 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:12.944844 16680 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.958524 16682 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:12.945441 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:12.962124 12808 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:12.891177 16745 consensus_queue.cc:1059] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:12.964856 16680 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.970558 16810 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.973649 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1387) took 2403 ms. Trace:
I20260709 13:08:12.972342 16741 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:12.984361 16314 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.984897 16314 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:12.985700 16807 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:08:12.985526 16741 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.985913 16314 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:12.987319 16314 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:12.987870 16806 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:08:12.988340 13520 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:12.988901 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 492) took 2194 ms. Trace:
I20260709 13:08:12.989355 12727 rpcz_store.cc:276] 0709 13:08:10.794061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.146346 (+1352285us) service_pool.cc:224] Handling call
0709 13:08:12.242684 (+ 96338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.376295 (+133611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.376331 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.382813 (+  6482us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.382859 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.988624 (+605765us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540038f754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.988675 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.988832 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294052096}
I20260709 13:08:12.990873 16773 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:12.991493 16811 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:12.980810 12799 rpcz_store.cc:276] 0709 13:08:10.570199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.570371 (+   172us) service_pool.cc:224] Handling call
0709 13:08:10.570671 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.562123 (+1991452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.973275 (+411152us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001a1b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:12.973559 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4565383040}
I20260709 13:08:12.975431 13517 raft_consensus.cc:2393] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
W20260709 13:08:12.999116 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 341747us
I20260709 13:08:12.964749 16613 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:12.980443 16680 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:12.975903 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 333128us
W20260709 13:08:13.004000 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58678.5us
I20260709 13:08:13.017925 16742 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:13.009470 16631 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.020648 16812 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:13.021430 16812 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.027114 16613 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:13.019407 16631 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.028211 16580 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:13.033145 16580 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:13.034875 16631 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.036012 16580 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:13.014902 16679 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.037878 16679 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.031730 16611 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:13.030489 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 76925.7us
I20260709 13:08:13.029335 16670 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:13.041546 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 104508us
W20260709 13:08:13.043325 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.049839 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.060173 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.006088 16682 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:08:13.065112 16682 consensus_queue.cc:1243] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:13.049085 16742 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:13.065683 16682 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.066227 16682 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.066768 16742 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.067225 16682 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.071506 16450 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.072619 16682 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.073714 16450 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:13.074998 16755 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.077069 16755 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.083294 16773 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:13.083850 16773 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:13.085120 16773 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.085579 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.086615 16773 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.089668 16616 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.092609 16697 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.096676 16697 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:13.097448 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.097610 16697 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.098938 16697 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.023088 16812 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.099058 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:13.100111 16812 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:13.040009 16679 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.105916 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:13.106726 12732 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:13.108295 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50309us
I20260709 13:08:13.106058 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1405) took 2121 ms. Trace:
I20260709 13:08:13.108906 12805 rpcz_store.cc:276] 0709 13:08:10.985127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.987139 (+  2012us) service_pool.cc:224] Handling call
0709 13:08:10.987479 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.530326 (+1542847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.105793 (+575467us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002b25d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:13.105998 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187135232}
I20260709 13:08:13.109948 16670 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:13.111126 16450 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.111528 16450 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.112425 16450 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.114651 12631 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 7, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:13.116209 12631 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 5 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.117650 12631 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.119552 12631 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 5 to 10, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.122720 12631 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 1 to 10, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 10 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:13.124210 16450 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.124399 12631 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 5, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 5 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.126852 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:13.126111 12631 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 9 to 10, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.127604 13512 raft_consensus.cc:1813] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.131915 16670 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.131467 16809 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:13.140079 16314 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:13.140834 16809 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:13.140961 12629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 75) took 11371 ms (client timeout 15000 ms). Trace:
I20260709 13:08:13.141402 16809 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.149750 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:13.151391 16809 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.152872 16809 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.131062 16814 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:13.154690 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.155464 12808 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.154984 16782 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.158725 16745 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.159474 16782 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:13.163620 13512 raft_consensus.cc:2410] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:08:13.163817 16617 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.008s
I20260709 13:08:13.164417 16617 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:13.167217 16617 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:13.168617 16652 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.141148 16314 consensus_queue.cc:1243] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:13.161708 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.160830 12804 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:13.170228 16680 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.179021 16814 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:13.177838 16745 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:13.179571 16814 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.179911 16745 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:13.180927 16680 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.180670 16814 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.181111 16745 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.181787 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.182282 16814 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.182688 16387 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.183336 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.184139 16387 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.184882 16652 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:13.131507 16682 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:08:13.188611 12808 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:13.171283 16755 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:08:13.211916 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.214830 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.216085 12808 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.217353 12631 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 7 to 8, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.220772 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:13.141846 12629 rpcz_store.cc:269] 0709 13:08:01.769492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.770025 (+   533us) service_pool.cc:224] Handling call
0709 13:08:13.140674 (+11370649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:08.760219 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:08.915979 (+155760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:08.916050 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:08:08.916072 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:08.917179 (+  1107us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:08.917246 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:08.917279 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:08.944839 (+ 27560us) tablet.cc:701] Row locks acquired
0709 13:08:08.944861 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:08.945031 (+   170us) write_op.cc:270] Start()
0709 13:08:08.945193 (+   162us) write_op.cc:276] Timestamp: P: 1783602488944984 usec, L: 0
0709 13:08:08.945216 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:08.945913 (+   697us) log.cc:844] Serialized 4349 byte log entry
0709 13:08:09.469962 (+524049us) op_driver.cc:464] REPLICATION: finished
0709 13:08:09.733443 (+263481us) write_op.cc:301] APPLY: starting
0709 13:08:09.733535 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:09.733787 (+   252us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:09.733929 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:09.735193 (+  1264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:09.735428 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:08:09.735472 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:09.735788 (+   316us) log.cc:844] Serialized 76 byte log entry
0709 13:08:09.736664 (+   876us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:09.736905 (+   241us) write_op.cc:454] Released schema lock
0709 13:08:09.736977 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:09.738045 (+  1068us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:09.738075 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29221,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":263192,"apply.run_cpu_time_us":3483,"apply.run_wall_time_us":4563,"num_ops":10,"prepare.queue_time_us":551282,"prepare.run_cpu_time_us":12806,"prepare.run_wall_time_us":296206,"raft.queue_time_us":256115,"raft.run_cpu_time_us":5922,"raft.run_wall_time_us":321432,"replication_time_us":524457,"thread_start_us":572468,"threads_started":4,"wal-append.queue_time_us":148197,"wal-append.run_cpu_time_us":29636,"wal-append.run_wall_time_us":1643188}]]}
I20260709 13:08:13.223335 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.224289 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.225063 12807 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:13.212155 16387 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.226652 16387 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:13.227355 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:13.228271 12804 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:13.224896 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:13.228533 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.229031 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.205278 16738 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.185856 16616 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:13.238467 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:13.241634 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58407.3us
I20260709 13:08:13.242009 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.242847 12805 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.245783 12631 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.212715 16493 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:13.248805 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.251135 12802 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:13.245178 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.252822 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.253456 12808 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.247488 12631 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.254458 12732 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:08:13.227572 16387 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.256392 12876 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:13.256857 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:13.261253 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.263164 16755 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.263356 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.268182 16697 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.240954 16738 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.269896 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:13.270835 16738 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.272380 12799 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:13.273569 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.277967 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.277886 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.278823 12801 raft_consensus.cc:3060] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.275388 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.282241 13486 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:13.283475 12878 raft_consensus.cc:2368] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:13.272943 16493 consensus_queue.cc:1243] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:13.280717 12631 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 7 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.286571 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.283748 12699 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:13.292562 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:13.280766 16611 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.283964 16387 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.285950 16417 raft_consensus.cc:2804] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:13.312265 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 93896.5us
I20260709 13:08:13.292825 16755 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.297911 16680 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:13.283679 16616 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:08:13.337499 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74667.6us
I20260709 13:08:13.342837 16813 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.343488 16813 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.343497 12631 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 9, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:13.344906 16813 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.346338 16813 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.345894 12631 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 7 to 8, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.354945 12877 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:13.318195 16417 raft_consensus.cc:697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:13.361034 12878 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:13.361999 12808 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:13.365051 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:13.338953 16680 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:13.375710 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.377986 16680 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.381476 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.382424 12877 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:13.381074 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.387063 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.386866 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.380611 16812 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.391968 12880 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:13.399396 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:13.418824 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67347.5us
W20260709 13:08:13.421969 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57199.4us
I20260709 13:08:13.390390 16745 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:13.425849 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.429929 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 68867.5us
I20260709 13:08:13.430816 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.444289 16797 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:13.445135 16797 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:13.448545 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.448884 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:13.434142 16417 consensus_queue.cc:237] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:13.432271 16616 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.472929 12877 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:08:13.479737 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.458091 16797 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:13.499439 12881 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:13.498533 16819 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:08:13.522814 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:13.524240 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66308.8us
I20260709 13:08:13.525625 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.498358 16493 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.529681 12808 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:13.546732 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.547732 12880 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:08:13.558293 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.558701 12801 raft_consensus.cc:2468] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:08:13.564661 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.567633 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.570516 16697 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.539367 16773 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.584571 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:13.589383 12880 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:13.592170 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 578886us
I20260709 13:08:13.538859 16450 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:13.592340 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.585402 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62747.8us
I20260709 13:08:13.623459 16682 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.621496 16773 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:13.597298 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 71834us
I20260709 13:08:13.752144 16682 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.753324 16682 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.754848 16682 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:13.623087 16821 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.198s	user 0.004s	sys 0.002s
W20260709 13:08:13.630235 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.694442 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:13.710719 12805 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:13.623355 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:13.729818 12880 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
W20260709 13:08:13.694140 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.738687 12873 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:13.722250 12875 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:13.766099 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.775656 12801 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:13.757310 12878 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:13.799386 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.805006 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.808791 12879 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:13.809022 12875 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:13.772804 16314 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.812675 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:13.817611 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.819738 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.822024 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:13.803280 13512 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:13.826638 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.829677 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.830581 12879 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:13.802280 16387 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:13.818199 16314 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:13.833326 16314 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:13.834506 16314 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:13.841934 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.846747 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44662.1us
I20260709 13:08:13.847752 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.807050 16775 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:13.866748 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.869195 12879 raft_consensus.cc:1813] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:13.869886 16314 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.870281 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:13.825819 16493 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.875165 12873 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:13.893469 12879 raft_consensus.cc:2368] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:08:13.900884 12877 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:13.920750 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94185.6us
I20260709 13:08:13.863732 16773 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:13.935647 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88003.9us
I20260709 13:08:13.901607 16812 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:13.942302 12877 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:13.945752 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:13.976822 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:13.976595 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 87666.5us
I20260709 13:08:13.978988 12728 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:13.977722 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:13.940332 16812 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:13.992470 13484 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.828s (SENT)
W20260709 13:08:13.995733 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.001659 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 179720us
W20260709 13:08:14.014662 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.020200 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.021265 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81585.6us
I20260709 13:08:14.021389 12877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:14.024255 13484 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:14.029318 12877 raft_consensus.cc:606] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:14.029963 12877 raft_consensus.cc:614] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:14.029990 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49645.3us
I20260709 13:08:14.033776 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:14.042661 12801 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.992116 16773 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:13.994686 16812 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.019804 16745 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:14.048555 16834 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:08:14.024842 16387 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.060194 16773 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.068997 12879 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:14.070915 16773 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:14.000392 16797 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:14.079233 12882 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:14.042368 16775 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.082372 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:14.082958 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57572.1us
I20260709 13:08:14.056770 16738 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:14.086987 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56051.3us
I20260709 13:08:14.117466 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:14.087852 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:14.089321 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.083930 16682 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:08:14.092167 16773 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:14.096573 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.097262 16843 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.119196 16843 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.119644 16843 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.120450 12771 leader_election.cc:400] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:14.120831 12771 leader_election.cc:403] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.122080 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.122649 16580 raft_consensus.cc:2764] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:14.122993 16679 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:14.123821 16347 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:14.103906 13512 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:08:14.124401 16347 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:14.137704 12800 raft_consensus.cc:1275] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:14.139259 16450 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.139035 16347 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.139662 16493 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.140516 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:14.126005 16773 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.145219 16616 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.139935 16745 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.147531 12696 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:14.139678 16450 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:14.148355 16682 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:14.148715 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68777.8us
I20260709 13:08:14.078418 16839 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:08:14.085040 16387 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.137081 16841 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:14.175606 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 191665us
I20260709 13:08:14.145226 16773 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:14.167822 16745 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:14.180733 13484 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.847s (SENT)
I20260709 13:08:14.148985 16682 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:14.188786 12845 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.148954 16450 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:08:14.194274 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.195142 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.195945 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.200767 12799 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:14.197170 12807 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:14.197834 12802 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:14.186478 16314 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.176658 16797 consensus_queue.cc:1048] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:14.166154 16843 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.201742 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
W20260709 13:08:14.220984 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 99010.9us
I20260709 13:08:14.221292 12882 raft_consensus.cc:606] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:14.222254 12882 raft_consensus.cc:614] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:14.223960 16493 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:14.224972 16493 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.225961 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.226846 16679 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:14.227064 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 77478.6us
W20260709 13:08:14.228415 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51054.1us
I20260709 13:08:14.231392 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.229063 16682 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:14.221738 16314 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:14.230345 16841 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.250434 16841 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:14.250808 16852 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:14.251421 16852 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:14.251581 16841 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.252815 16841 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.253834 16852 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:14.255070 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:14.223577 16580 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:14.261134 12847 leader_election.cc:400] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:14.261502 12847 leader_election.cc:403] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.264756 16387 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:14.201305 16851 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:14.248425 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:14.241242 16813 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.285440 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:14.286235 12882 raft_consensus.cc:606] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:14.286588 12882 raft_consensus.cc:614] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:14.286827 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.267231 16450 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.287825 12727 raft_consensus.cc:2368] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:14.296793 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.266074 16314 raft_consensus.cc:697] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:14.299292 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.266808 16812 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:14.316529 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 76175.7us
I20260709 13:08:14.317888 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:14.320317 16846 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:14.320394 16853 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.321506 16314 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:14.325758 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:14.326496 16855 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:14.320578 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.330158 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:14.325825 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:14.337323 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.342935 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.338665 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:14.320990 16682 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.345141 16682 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:14.346362 16837 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.326s	user 0.003s	sys 0.000s
I20260709 13:08:14.350212 12732 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:14.352166 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.352443 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.352519 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.352886 12731 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.353317 12726 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.361322 12728 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:14.365973 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.368278 12731 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:14.369066 12727 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.369760 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44014.1us
I20260709 13:08:14.373689 12725 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:14.374487 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.375931 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 145178us
I20260709 13:08:14.377607 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.379208 12731 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.320952 16846 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:14.298915 16813 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:14.409789 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81316us
W20260709 13:08:14.378085 16858 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.004s
I20260709 13:08:14.400565 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.419909 12732 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:14.404675 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.378427 16847 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.417671 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.423568 12728 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:14.427119 12730 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.403076 16682 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:14.402832 16679 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:14.454650 13484 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.194s (SENT)
I20260709 13:08:14.414924 16632 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.461040 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:14.415853 16839 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.404258 16773 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:08:14.466634 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:14.467291 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63070.3us
I20260709 13:08:14.473301 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:14.476838 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.479810 12726 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:14.461889 16843 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:14.482918 13484 leader_election.cc:336] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 2.200s (SENT)
I20260709 13:08:14.489928 12732 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:08:14.491281 16611 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.506809 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:14.512319 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.431202 16864 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:08:14.523417 16679 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.526894 12732 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:14.528532 16611 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:14.529096 16813 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:14.530140 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55410.1us
I20260709 13:08:14.530300 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:14.530020 16846 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.531364 13518 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:14.531623 16846 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.523892 12730 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:14.535502 12845 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:14.466187 16632 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.536067 16812 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:14.543645 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.563164 12725 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:14.566387 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.574028 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:14.576398 16863 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:14.576527 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.577767 12726 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:08:14.578454 12732 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:14.581081 16745 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.586898 16853 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:14.590744 16839 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.592804 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.593593 12732 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:14.593587 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.594996 12728 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:14.596351 12724 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:14.569057 16450 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.597888 12728 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.598595 16852 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:14.598929 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.599113 16852 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:14.600656 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.601272 12732 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:14.608727 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:14.610042 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:14.610899 12729 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:14.611285 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.611943 12724 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:14.612185 16632 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:14.613112 16866 log.cc:927] Time spent T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 13:08:14.594594 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.622264 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:14.626348 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.576757 12731 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:14.633315 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.635221 12725 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:14.637048 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.641389 12730 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.654651 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.664700 12733 raft_consensus.cc:2393] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 5: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:14.648500 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:14.666473 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 435692us
I20260709 13:08:14.671623 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.684885 12771 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.685782 12727 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:14.685648 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.638865 16839 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.646631 16812 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.702566 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.703949 12725 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 6: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:14.648763 16661 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:14.708074 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.709937 12732 raft_consensus.cc:2376] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8. Re-sending same reply.
I20260709 13:08:14.711751 16812 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.737571 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.741645 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.743613 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.744621 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.690616 16841 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.773355 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.781908 12727 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:14.786473 12732 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:14.789650 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.790577 12725 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.714962 16347 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.633062 16852 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.797992 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.811721 12882 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:14.797883 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:14.770265 16829 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:14.805294 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.797827 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.751797 16855 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.826462 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.813978 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.828866 12732 raft_consensus.cc:2368] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:14.814388 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:14.828013 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:14.846629 12725 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:08:14.848368 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.851409 12724 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:14.857568 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.800766 16347 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:14.816681 12874 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:14.830757 16862 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:08:14.864431 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:14.897433 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.898032 12726 raft_consensus.cc:2376] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
I20260709 13:08:14.868592 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.899716 12882 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 9.
I20260709 13:08:14.903168 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.796833 12733 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:14.784263 16841 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:14.878090 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 129406us
I20260709 13:08:14.886390 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:14.907083 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 98239.7us
I20260709 13:08:14.841678 16813 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:14.910254 12724 raft_consensus.cc:2376] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7. Re-sending same reply.
I20260709 13:08:14.920416 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.927703 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.930238 16880 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.931140 16880 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.933847 16738 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:14.937291 16857 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.937949 16857 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:14.948227 16875 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 13:08:14.949498 16738 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.950434 16738 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:14.950300 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.952976 12882 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:14.957162 13512 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:14.959599 16846 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.959981 16493 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:14.962523 16738 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:14.964469 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:14.943382 16880 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:14.965691 12874 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:14.966216 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:14.901340 16347 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.974514 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.978987 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:14.980439 12724 raft_consensus.cc:2376] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9. Re-sending same reply.
I20260709 13:08:14.981973 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:14.908394 16387 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:14.991108 12771 leader_election.cc:400] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:08:14.995309 12771 leader_election.cc:403] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.836562 16855 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.005911 12874 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.938992 16857 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:15.007980 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.009544 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:14.981446 16841 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:15.011958 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:15.016217 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:14.994563 16613 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:15.023671 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.024178 12724 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:15.026716 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:15.026634 16679 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:15.032357 16839 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:15.033900 16876 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:15.021327 16859 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.035543 12732 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:15.036394 16872 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.997051 16846 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:14.997155 16862 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.044629 12876 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:14.975879 16813 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.064443 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.061239 12799 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:15.005061 16387 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:15.128988 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.129892 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:15.048914 16613 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.066936 16839 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.080791 16862 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.053668 16679 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:15.139837 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:15.142023 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.147840 12727 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:15.149066 12724 raft_consensus.cc:2376] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12. Re-sending same reply.
I20260709 13:08:15.154481 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:15.136441 16876 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:15.162328 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:15.157119 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:15.163048 12724 raft_consensus.cc:2376] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13. Re-sending same reply.
I20260709 13:08:15.170830 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.136719 16613 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.180579 12731 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:15.131676 16812 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.177994 13484 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:15.152587 16679 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.150385 16862 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.190356 16661 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.161211 16841 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.212167 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.215577 16450 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:15.217877 16881 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:08:15.218667 16387 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.219310 16839 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.134703 16885 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:08:15.227900 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:15.222020 16886 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:08:15.228703 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 145065us
I20260709 13:08:15.243175 16853 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.243884 16841 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.232146 12724 raft_consensus.cc:2376] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12. Re-sending same reply.
I20260709 13:08:15.215144 16661 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.227456 16882 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.222750 16450 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.270498 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.276927 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:15.277671 12724 raft_consensus.cc:2376] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
I20260709 13:08:15.279109 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.259867 16661 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.258708 16812 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.292207 16830 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.269815 16882 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.294091 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.277978 16450 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.295342 12731 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:15.311270 12724 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:15.313741 12874 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:15.259207 16853 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.264609 16841 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.275743 16885 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:15.340076 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:15.342983 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:15.313894 16882 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.360692 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:15.312361 16812 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.341354 16855 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.324335 16613 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:15.383000 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.387017 12773 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.683s (SENT)
W20260709 13:08:15.383853 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 119255us
W20260709 13:08:15.392210 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.374528 12696 connection.cc:256] RPC call timeout handler was delayed by -4.0751518179999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:08:15.409386 12696 connection.cc:256] RPC call timeout handler was delayed by -4.02655181800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 13:08:15.348803 16839 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:15.410851 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.422118 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:15.394243 16887 log.cc:927] Time spent T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:08:15.427645 12801 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:15.429068 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:15.428193 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.422295 12773 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.879s (SENT) [suppressed 35 similar messages]
I20260709 13:08:15.409590 16855 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.433524 12877 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:08:15.441856 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 155416us
W20260709 13:08:15.442634 12696 connection.cc:256] RPC call timeout handler was delayed by -2.7678369080000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:08:15.447199 12696 connection.cc:256] RPC call timeout handler was delayed by -2.63222444500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2893s for a response
W20260709 13:08:15.448215 12696 connection.cc:256] RPC call timeout handler was delayed by -2.3823557210000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:08:15.431197 16745 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:15.471494 16883 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.519s	user 0.005s	sys 0.000s
I20260709 13:08:15.476570 16900 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.477366 16900 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.447613 16813 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:15.489044 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 106492us
I20260709 13:08:15.499028 16813 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.508257 16862 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.508507 16813 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.451996 16855 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:15.521891 16613 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.484166 16745 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.528174 16855 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:15.531896 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 67292.8us
I20260709 13:08:15.540494 16853 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.548605 16852 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.548857 16812 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.552392 16841 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.552875 16862 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.511422 16813 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.506075 16900 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.573233 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.574749 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.575215 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:15.577389 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 155116us
I20260709 13:08:15.579383 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.580384 12728 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:15.581596 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.582363 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:15.575640 12730 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:15.595870 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.596784 12732 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:15.602705 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.606218 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.606828 12727 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:15.610471 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:15.611320 12731 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:15.603557 12729 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:15.582923 16813 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.637178 12880 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:15.596158 16493 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.600924 16830 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:15.646185 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46046.5us
I20260709 13:08:15.601132 16841 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.649296 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.584137 16884 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:15.599858 16679 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.662057 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:15.667984 12880 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:15.654845 16864 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.614200 16661 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:15.651788 16893 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:15.675979 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.677953 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:15.678637 12880 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.682652 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.684445 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.685563 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.647564 16813 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.691316 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.650027 16493 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.668457 16745 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.656289 16882 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:15.658042 16841 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.671319 16864 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.713482 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.692373 16812 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.688189 16900 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:15.689816 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.721904 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.700404 16839 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.692387 16855 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.692736 16853 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.726599 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.731184 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:15.717206 16859 consensus_meta.cc:287] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.630s	user 0.013s	sys 0.000s
I20260709 13:08:15.729931 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.730751 13520 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.736377 12802 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:15.680254 16893 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.734280 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.734915 12880 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:15.732278 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:15.735682 16631 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.751969 16839 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.752404 16631 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.738482 16855 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.754830 16631 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.717967 16745 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:15.738415 16859 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 5. Current term is 6.
I20260709 13:08:15.752801 16839 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.717674 16864 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.757643 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:15.779238 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51842.1us
I20260709 13:08:15.720100 16904 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.732831 13517 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:15.787676 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47053us
I20260709 13:08:15.742255 12799 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:15.793108 12880 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.755954 16855 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:15.805562 16679 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.756686 16745 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:15.795380 16904 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.835820 12880 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:15.869064 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52921.4us
I20260709 13:08:15.812422 16862 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.263s
I20260709 13:08:15.898967 12848 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:16.077280 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 178405us
I20260709 13:08:16.041657 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:15.912315 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:15.981194 16908 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:08:16.093307 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:15.869925 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:15.843405 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.097273 16846 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:16.097764 16913 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:16.094848 16855 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.098516 16855 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.098302 16846 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.098973 16855 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.100850 16846 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:16.101536 16493 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.097378 16899 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.102079 16864 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:15.990162 16911 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:08:15.860076 16347 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.004s
W20260709 13:08:16.104485 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 234671us
W20260709 13:08:15.913625 16905 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:08:15.913102 16907 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:08:15.972388 16919 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.120131 16862 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.120636 16846 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.121140 16347 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:15.847152 16857 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.275s
I20260709 13:08:15.828682 16859 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.293s
I20260709 13:08:16.072276 16904 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.996492 16900 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.997604 16893 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.124173 16920 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:16.128322 16864 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.133119 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:16.139616 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 296334us
I20260709 13:08:15.897189 16679 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.898209 16915 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.910339 16661 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:15.952500 16813 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.113780 16899 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.076673 16894 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:15.951504 16909 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.963618 16882 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:16.147658 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 414396us
I20260709 13:08:16.194337 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:15.959008 12627 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 9 to 10, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.144325 16862 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.130673 16855 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:16.139129 16812 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.837809 16450 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:16.181383 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48374us
I20260709 13:08:16.200057 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.144747 16841 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.144603 16613 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:08:16.144467 16892 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:16.212448 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:16.189713 16893 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.203153 16862 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.190029 16580 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:08:16.204622 16909 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.199376 16914 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.229832 16914 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.199282 16895 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:16.230907 16909 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.196715 16899 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.203456 16493 raft_consensus.cc:2764] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:16.234586 16347 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:16.189918 16631 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:16.190162 16846 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:16.239672 16450 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.241855 12627 catalog_manager.cc:5697] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:16.240564 12631 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 155) took 14445 ms (client timeout 15000 ms). Trace:
I20260709 13:08:16.240410 16852 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:16.241813 12874 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.199738 16864 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.262305 16864 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.202615 16745 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.252624 16914 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.180895 16900 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.265334 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.266278 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.267664 16857 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:16.200779 16894 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.268846 16864 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.269235 16893 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.269958 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.255369 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.270725 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.287976 12807 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:16.245929 16813 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.172890 16919 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.192478 16679 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.283552 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.284686 12773 leader_election.cc:400] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
W20260709 13:08:16.284878 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 77945.7us
I20260709 13:08:16.286954 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:16.289383 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.243898 12627 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 4 to 8, term changed from 9 to 10, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to <none>, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.245407 16841 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.202481 16915 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.298204 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.303555 12733 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:16.301069 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:16.245591 12631 rpcz_store.cc:269] 0709 13:08:01.794857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.795287 (+   430us) service_pool.cc:224] Handling call
0709 13:08:16.240454 (+14445167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.972526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.973346 (+   820us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.973429 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:08:13.973452 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:14.113467 (+140015us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:14.113572 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:14.113618 (+    46us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:14.115371 (+  1753us) tablet.cc:701] Row locks acquired
0709 13:08:14.115438 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:08:14.115681 (+   243us) write_op.cc:270] Start()
0709 13:08:14.115869 (+   188us) write_op.cc:276] Timestamp: P: 1783602494115599 usec, L: 0
0709 13:08:14.115910 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:08:14.210499 (+ 94589us) log.cc:844] Serialized 5878 byte log entry
0709 13:08:14.865333 (+654834us) op_driver.cc:464] REPLICATION: finished
0709 13:08:15.141740 (+276407us) write_op.cc:301] APPLY: starting
0709 13:08:15.146914 (+  5174us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.348332 (+201418us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.368895 (+ 20563us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.506000 (+137105us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.520761 (+ 14761us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:08:15.520836 (+    75us) write_op.cc:312] APPLY: finished
0709 13:08:15.521308 (+   472us) log.cc:844] Serialized 106 byte log entry
0709 13:08:15.521498 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.521663 (+   165us) write_op.cc:454] Released schema lock
0709 13:08:15.521738 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.522166 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.522192 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2839055,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":275970,"apply.run_cpu_time_us":11430,"apply.run_wall_time_us":380430,"num_ops":15,"prepare.queue_time_us":434435,"prepare.run_cpu_time_us":17098,"prepare.run_wall_time_us":371576,"raft.queue_time_us":235120,"raft.run_cpu_time_us":68362,"raft.run_wall_time_us":177079,"replication_time_us":729508,"thread_start_us":498685,"threads_started":4,"wal-append.queue_time_us":134185}]]}
I20260709 13:08:16.305573 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:16.306316 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.308195 16906 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.291967 16812 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.302332 12627 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.310036 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.308746 16885 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:16.311717 16915 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.329101 16855 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.312008 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:16.291606 16813 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:16.318910 16631 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.320449 16839 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:16.307720 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:16.334064 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:16.334723 12805 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.326668 12627 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.313040 16859 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.340051 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:16.343935 16894 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.321923 16906 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:16.344857 16906 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.344900 12696 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:16.346572 16931 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.336257 12627 catalog_manager.cc:5697] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.347390 16931 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.348295 16893 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.348595 12627 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 5, term changed from 4 to 6, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to <none>, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.349372 12696 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:16.350281 16915 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:16.350486 12627 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 2 to 6, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.287374 16857 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.352607 12627 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.353799 16857 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:16.353644 16745 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:16.288471 16846 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:16.354146 12627 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:16.355731 16915 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:16.356196 16915 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:16.357041 16915 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.358377 12805 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:16.364194 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.364477 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.369810 12878 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:16.362980 12848 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:16.303802 16450 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.372804 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.332820 16839 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:16.375555 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.380766 16812 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.371558 16852 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.381728 16852 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:16.382218 16852 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.384708 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.388365 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.381048 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.393376 12876 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:16.394411 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.394536 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.327999 16885 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.338109 16813 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.436862 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.457458 12881 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:16.395491 12879 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:16.440399 12874 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:08:16.440897 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 128960us
I20260709 13:08:16.454232 12880 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:16.401023 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:16.460515 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.462742 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.372977 16855 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.391451 16839 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.395999 16889 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.395646 16841 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:16.471943 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 153468us
I20260709 13:08:16.374505 16631 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.434803 16812 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:16.482059 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.484997 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.475632 16931 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.487114 12877 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:16.468305 16859 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.479020 16855 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.483081 13517 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.494876 12875 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:16.455746 16926 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:16.500451 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.502048 12875 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:16.507069 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.500221 16855 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.519438 16900 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.491676 16931 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.525342 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.528226 16928 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.529680 16928 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.548516 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:16.498232 16864 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:16.501060 16927 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.502324 16926 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:16.568614 16631 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.569460 16926 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.562561 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.572570 12877 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:16.572607 16934 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.563599 16812 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:16.575068 16934 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.565246 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.576259 12875 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:16.576125 16934 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.567802 16919 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.574594 16859 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.571738 16926 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.586840 12879 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:16.588372 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.488406 16841 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.598955 12879 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:16.599946 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51596.4us
I20260709 13:08:16.604549 16855 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.610276 16855 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.561058 16613 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.554647 16679 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.612584 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.620023 12875 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:16.621623 12880 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:16.624404 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 125198us
I20260709 13:08:16.634912 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.599802 16857 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.579442 16864 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.640969 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.644580 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.646553 12874 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:16.555032 16899 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.652776 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.656649 12874 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.657070 12801 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.622279 16862 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.665426 12801 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.619756 16895 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:16.670663 12877 raft_consensus.cc:2368] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13.
I20260709 13:08:16.642311 16679 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:16.656068 16931 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.676741 12807 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:16.678090 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.684746 12874 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:16.708763 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.709683 12880 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:16.710289 16899 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:16.712738 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.718104 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.722419 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.727912 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.730068 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:16.744012 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 109356us
I20260709 13:08:16.735859 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.747082 12880 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:16.748603 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.755643 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:16.681772 16885 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:16.668216 16904 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.737581 16855 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.814886 12880 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:16.816076 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.743829 16812 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:16.820897 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:16.817057 12878 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:16.766215 16900 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.831410 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.834750 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.841147 12879 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:16.835191 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.835718 12881 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.842408 12874 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:16.771310 16910 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:16.843065 12873 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:16.837283 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:16.838117 12805 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:16.845271 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:16.845572 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:16.809906 16857 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.845645 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:16.821322 16613 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.857632 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:16.836652 16934 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:16.858878 16852 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.847838 16812 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:16.874733 16942 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.001s
I20260709 13:08:16.875723 16927 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:16.877749 16941 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:16.848412 16900 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.879922 16679 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:16.805917 16906 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.879468 16889 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:16.888902 16921 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.666s	user 0.006s	sys 0.000s
I20260709 13:08:16.860260 16910 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.890518 16864 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.948473 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.933840 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:16.823463 16855 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.848520 16839 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:16.891835 16841 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:16.935276 16679 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:16.991571 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.993629 12879 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:16.885076 16813 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:17.002568 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:16.950645 16846 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:17.004011 16862 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:16.893095 16613 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:17.014770 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:17.021531 16904 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:17.023849 16906 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:17.025441 16943 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.198s	user 0.000s	sys 0.003s
I20260709 13:08:17.027876 16679 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:17.029599 16679 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:17.032335 16951 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.270s	user 0.003s	sys 0.001s
I20260709 13:08:17.037931 16900 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:17.048341 16910 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:17.049057 16812 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:17.005471 16857 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:17.071432 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2161) took 1413 ms. Trace:
W20260709 13:08:17.043185 16950 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 13:08:17.072358 12882 rpcz_store.cc:276] 0709 13:08:15.657674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.984916 (+327242us) service_pool.cc:224] Handling call
0709 13:08:15.985537 (+   621us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:15.986040 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.986066 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:15.987114 (+  1048us) log.cc:844] Serialized 513 byte log entry
0709 13:08:16.142487 (+155373us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.142528 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.142590 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.763202 (+620612us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:17.070911 (+307709us) raft_consensus.cc:1685] finished
0709 13:08:17.070960 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.071332 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5138,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":45213568,"thread_start_us":154709,"threads_started":1,"wal-append.queue_time_us":222670}
I20260709 13:08:17.076004 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:17.077375 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:17.078610 12882 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:17.078629 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:17.085160 16841 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:17.085992 16841 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:16.988719 16852 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:17.050881 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:17.102003 12879 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:18.621090 12696 connection.cc:256] RPC call timeout handler was delayed by -1.9360457620000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:08:18.621680 12696 connection.cc:256] RPC call timeout handler was delayed by -1.902745761999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:08:18.622324 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.622957 12696 connection.cc:256] RPC call timeout handler was delayed by -1.8667457620000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:08:18.625102 12627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.136s	user 0.022s	sys 0.030s
W20260709 13:08:18.625828 12627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.143s	user 0.022s	sys 0.030s
W20260709 13:08:18.623502 12696 connection.cc:256] RPC call timeout handler was delayed by -1.8019457620000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:08:18.641484 12696 connection.cc:256] RPC call timeout handler was delayed by -1.7839457620000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:08:18.693080 12696 connection.cc:256] RPC call timeout handler was delayed by -1.7740457620000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:08:18.733481 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.773983 12696 connection.cc:256] RPC call timeout handler was delayed by -1.734445762000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:08:18.833169 12696 connection.cc:256] RPC call timeout handler was delayed by -1.7083457620000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:08:18.879315 12696 connection.cc:256] RPC call timeout handler was delayed by -1.6984457620000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:08:18.923048 12696 connection.cc:256] RPC call timeout handler was delayed by -1.5013457620000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:08:18.968514 12696 connection.cc:256] RPC call timeout handler was delayed by -1.47164576199998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:08:19.021534 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4473457620000545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:08:19.061726 12696 connection.cc:256] RPC call timeout handler was delayed by -1.4113457619999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:08:17.055822 16855 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.088156 16967 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:19.090164 16967 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.092113 16915 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.094161 16967 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.096215 16967 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.097381 16967 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.099517 16968 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.100162 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3681457620000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:08:19.102053 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3393457619999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:08:19.101976 16968 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:19.102646 12696 connection.cc:256] RPC call timeout handler was delayed by -1.2871457620000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.227s for a response
W20260709 13:08:19.108384 12696 connection.cc:256] RPC call timeout handler was delayed by -1.2430457620000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2319s for a response
I20260709 13:08:19.101377 16967 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.109527 16967 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.109990 16968 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.110108 16967 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.110641 16968 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.111240 16968 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.112944 16967 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.113204 16968 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.113523 16967 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.113826 16968 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:19.114763 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0640331989999368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:08:19.115097 16968 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:19.117200 16968 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.114028 16967 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.119202 16967 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.106343 16915 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.120018 16915 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.122740 16915 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.130064 16915 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.130730 16915 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.132174 16967 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.132663 12696 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 3.147s (SENT)
I20260709 13:08:19.132781 16967 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.133610 16915 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.134378 16915 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.134791 16967 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.133102 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:19.134977 16915 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.135735 16968 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.139021 16968 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.141283 16968 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.143582 16968 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:19.145759 16915 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.146325 16968 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.148495 16968 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.149121 16968 consensus_queue.cc:1243] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:19.151851 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:19.151160 16967 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:19.158748 13487 connection.cc:256] RPC call timeout handler was delayed by -1.2635865020000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:08:19.154959 16967 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:19.161960 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:19.154939 16970 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.162014 16967 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:19.165666 16970 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.166165 16970 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.166590 16967 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.154165 16968 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:19.170626 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:19.171738 13512 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:19.167999 16967 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.174347 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:08:19.170734 16857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.093s	user 0.000s	sys 0.030s
I20260709 13:08:19.176153 16915 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:19.176474 16857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.098s	user 0.001s	sys 0.032s
I20260709 13:08:19.176609 16915 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.177050 16915 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.182050 16775 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.182665 16775 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.187747 16970 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.193216 16970 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.198195 16775 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:19.202441 16944 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 2.341s	user 0.017s	sys 0.004s
W20260709 13:08:19.205636 16925 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 2.935s	user 0.000s	sys 0.023s
I20260709 13:08:19.207373 16915 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.213426 16915 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.214344 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 340) took 2446 ms. Trace:
W20260709 13:08:19.216171 12754 debug-util.cc:398] Leaking SignalData structure 0x7b08001e44c0 after lost signal to thread 11579
I20260709 13:08:19.220885 12876 rpcz_store.cc:276] 0709 13:08:16.768346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.769168 (+   822us) service_pool.cc:224] Handling call
0709 13:08:16.775630 (+  6462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.977306 (+201676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.977355 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.977413 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:16.977458 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.214068 (+2236610us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540006c7d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:19.214112 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.214247 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463062784}
I20260709 13:08:19.229063 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2180) took 2402 ms. Trace:
I20260709 13:08:19.240237 12876 rpcz_store.cc:276] 0709 13:08:16.826713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.228076 (+2401363us) service_pool.cc:224] Handling call
0709 13:08:19.228451 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.228657 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.228685 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.228731 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.228766 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.228827 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.228958 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.243780 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:19.244393 13512 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.245342 16970 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.245867 16970 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.232353 16915 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.251803 16915 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:19.253022 16922 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 2.958s	user 0.005s	sys 0.017s
I20260709 13:08:19.254083 16915 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.253572 16970 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.255106 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:19.231841 12699 connection.cc:256] RPC call timeout handler was delayed by -2.5118600220000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:08:19.256789 12699 connection.cc:256] RPC call timeout handler was delayed by -2.1609275800000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:08:19.257215 12699 connection.cc:256] RPC call timeout handler was delayed by -1.8962600220000922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.227s for a response
W20260709 13:08:19.257700 12699 connection.cc:256] RPC call timeout handler was delayed by -1.3366908599999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:08:19.257980 12699 connection.cc:256] RPC call timeout handler was delayed by -1.3051908600000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 13:08:19.259089 16967 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.259588 16967 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.260905 16915 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.261772 16967 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.261478 16915 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.263687 16915 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.265080 16970 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.265331 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:19.265895 16970 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.269019 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.269830 12733 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:08:19.272863 13512 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:19.272946 16855 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.273648 16970 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:19.286504 16855 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.287328 16852 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.288174 16852 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.289639 16855 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.290217 16855 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.290851 16906 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.290678 16852 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.291472 16906 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.292511 16852 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.293344 16852 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.294509 16906 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:19.243178 12879 consensus_meta.cc:287] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 2.140s	user 0.017s	sys 0.014s
I20260709 13:08:19.278220 16853 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.277719 16900 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:19.279528 12880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.301s	user 0.034s	sys 0.063s
I20260709 13:08:19.279976 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.280773 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2178) took 2455 ms. Trace:
I20260709 13:08:19.281477 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.283519 16812 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.285527 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:19.298250 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.276831 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.296303 16775 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.278847 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.313234 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.300786 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:19.305989 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.295945 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 339) took 2528 ms. Trace:
I20260709 13:08:19.290661 16855 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:19.331724 12877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2266) took 2729 ms (client timeout 1773 ms). Trace:
I20260709 13:08:19.440956 12879 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:19.335033 12729 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
W20260709 13:08:19.454234 12879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 344) took 2628 ms (client timeout 3003 ms). Trace:
W20260709 13:08:19.347146 12848 connection.cc:256] RPC call timeout handler was delayed by -1.1527774190000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:08:19.332638 12724 raft_consensus.cc:2410] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:19.299964 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.458299 12727 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:19.343089 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.333537 12731 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
W20260709 13:08:19.456873 12879 rpcz_store.cc:269] 0709 13:08:16.826407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.050524 (+224117us) service_pool.cc:224] Handling call
0709 13:08:19.454161 (+2403637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.091892 16839 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.335892 12732 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:19.338879 12875 rpcz_store.cc:276] 0709 13:08:16.767483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.767685 (+   202us) service_pool.cc:224] Handling call
0709 13:08:16.817509 (+ 49824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.878774 (+ 61265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.878896 (+   122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.878953 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.878990 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.295680 (+2416690us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b54000703d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:19.295745 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.295881 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138571136}
I20260709 13:08:19.332718 12881 rpcz_store.cc:276] 0709 13:08:16.825580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.120545 (+2294965us) service_pool.cc:224] Handling call
0709 13:08:19.120953 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.121194 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:19.137926 (+ 16732us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.280367 (+142441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.280433 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:19.280487 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.280566 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.280707 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124007,"prepare.queue_time_us":16099,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":127000,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":34186,"threads_started":2,"wal-append.queue_time_us":38320}
I20260709 13:08:19.478440 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 347) took 2383 ms. Trace:
I20260709 13:08:19.478956 12881 rpcz_store.cc:276] 0709 13:08:17.095578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.477377 (+2381799us) service_pool.cc:224] Handling call
0709 13:08:19.477714 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.477903 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.477930 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.477973 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.478005 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.478073 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.478186 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.480613 12881 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.481791 12727 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:19.481984 12881 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:19.366458 12807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 2277) took 2745 ms (client timeout 1586 ms). Trace:
I20260709 13:08:19.482790 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:19.470639 16892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.153s	user 0.015s	sys 0.023s
I20260709 13:08:19.334062 12733 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:19.342408 12877 rpcz_store.cc:269] 0709 13:08:16.601908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.602128 (+   220us) service_pool.cc:224] Handling call
0709 13:08:19.331318 (+2729190us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5400139554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:19.331558 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105666944}
W20260709 13:08:19.483136 12807 rpcz_store.cc:269] 0709 13:08:16.620911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.621030 (+   119us) service_pool.cc:224] Handling call
0709 13:08:19.366050 (+2745020us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b5400398ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:19.366294 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69453568}
W20260709 13:08:19.332957 12880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.354s	user 0.036s	sys 0.064s
I20260709 13:08:19.485176 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:19.485689 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.504506 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.505012 12879 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.342854 16885 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:19.360654 16884 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.487532 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.489319 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.493438 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.494055 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.342123 16855 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.349150 16906 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.347513 16947 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.497328 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.499003 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 346) took 2566 ms. Trace:
I20260709 13:08:19.517103 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:19.472988 16846 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:19.337777 16931 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.338459 16745 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.497421 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.333894 16812 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.486596 13512 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:19.504741 12727 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:19.333604 16775 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.507005 12730 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.495172 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:19.512485 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.512764 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.496277 16839 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:19.487040 16895 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.485247 16970 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.455893 16979 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:19.517892 12805 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:19.518788 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:19.517482 12875 rpcz_store.cc:276] 0709 13:08:16.932626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.476906 (+2544280us) service_pool.cc:224] Handling call
0709 13:08:19.498247 (+ 21341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.498532 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.498574 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.498638 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.498686 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.498766 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.498919 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.525303 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:19.526013 12771 connection.cc:256] RPC call timeout handler was delayed by -1.0820234139999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:08:19.504348 16892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.187s	user 0.016s	sys 0.024s
I20260709 13:08:19.528076 12724 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.296428 16852 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:19.528486 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.334342 16853 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.332799 16900 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.514267 12879 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:19.524893 16855 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.524957 16857 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:19.568653 12877 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:19.566329 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.543632 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.570416 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:19.533825 12806 raft_consensus.cc:2410] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:08:19.573323 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 111134us
W20260709 13:08:19.526145 16679 consensus_meta.cc:287] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 2.496s	user 0.016s	sys 0.016s
I20260709 13:08:19.516919 16947 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:19.533339 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.620210 12733 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
W20260709 13:08:19.624284 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 233982us
I20260709 13:08:19.530577 16846 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.530452 16931 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.526379 16885 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.526930 16884 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.525166 16906 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.746182 12729 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.749913 12727 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.753700 13521 raft_consensus.cc:2410] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:19.753935 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:19.641546 12731 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:19.740376 12730 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:19.758241 12879 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:19.806914 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.654645 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 73668.3us
I20260709 13:08:19.828171 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:19.880002 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:19.900717 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:19.902020 12727 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
W20260709 13:08:19.684440 16981 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:08:19.904301 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:19.913822 12733 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:19.689532 16975 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:08:19.906412 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94700.2us
W20260709 13:08:19.909286 12873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.022s
I20260709 13:08:19.911012 12732 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:19.908826 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2184) took 3075 ms. Trace:
I20260709 13:08:19.533612 16745 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.575779 16839 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.585590 16970 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.671629 16855 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.722532 16857 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:19.585899 16895 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:19.591364 16979 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.919235 12877 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 12 index: 4. (index mismatch)
I20260709 13:08:20.032469 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:19.924285 13486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.025s
I20260709 13:08:19.911648 12803 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:08:19.919282 12873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.001s	sys 0.022s
W20260709 13:08:20.051296 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 131559us
I20260709 13:08:19.759195 16812 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.758965 16775 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:19.614624 16982 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:20.052479 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:20.061448 12881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.019s
W20260709 13:08:20.053301 13486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.000s	sys 0.049s
I20260709 13:08:20.089039 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.072026 12807 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:19.985311 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.043241 16989 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.111162 12724 consensus_meta.cc:287] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.000s
I20260709 13:08:20.121129 12731 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:20.121865 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 741108us
W20260709 13:08:20.070904 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 239869us
W20260709 13:08:19.922565 16977 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:20.107702 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2181) took 3280 ms. Trace:
I20260709 13:08:20.124416 12733 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:20.125224 12881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.012s	sys 0.019s
I20260709 13:08:19.962395 16853 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:20.061861 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 245888us
I20260709 13:08:19.905951 16679 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.128957 12724 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:20.144754 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.147992 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.148836 12733 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.133942 12874 rpcz_store.cc:276] 0709 13:08:16.827068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.229253 (+2402185us) service_pool.cc:224] Handling call
0709 13:08:19.229614 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.232891 (+  3277us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:19.233606 (+   715us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.586983 (+353377us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.107226 (+520243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.107307 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.107378 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.107477 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.107622 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7622,"prepare.queue_time_us":4186,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":29218,"raft.queue_time_us":607171,"thread_start_us":721645,"threads_started":3,"wal-append.queue_time_us":380674}
I20260709 13:08:20.149363 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 342) took 3370 ms. Trace:
I20260709 13:08:20.101258 16993 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:20.137022 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2187) took 3295 ms. Trace:
I20260709 13:08:20.100991 16885 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:20.183565 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.194736 12731 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:20.201404 12804 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:20.157496 12873 rpcz_store.cc:276] 0709 13:08:16.841841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.371319 (+2529478us) service_pool.cc:224] Handling call
0709 13:08:19.371724 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.371959 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:19.380494 (+  8535us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.059731 (+679237us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.136653 (+ 76922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.136714 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.136762 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.136831 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.136960 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82013,"prepare.queue_time_us":77064,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":112,"raft.queue_time_us":643572,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7530,"thread_start_us":671762,"threads_started":1}
W20260709 13:08:20.203567 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 141831us
I20260709 13:08:20.204316 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:20.153659 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.204937 12729 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:20.205579 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.023241 16947 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:19.961315 16852 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.208297 16852 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.071781 16978 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.210860 16978 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.095319 16931 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.214440 16895 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:20.214612 16931 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:20.215068 16859 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:20.215257 16931 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:20.096993 16855 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.215643 16859 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.162249 16900 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.152066 12880 rpcz_store.cc:276] 0709 13:08:16.778793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.823301 (+ 44508us) service_pool.cc:224] Handling call
0709 13:08:16.823635 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.835090 (+ 11455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.835125 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.835590 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.954991 (+119401us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.504487 (+2549496us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.149028 (+644541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.149111 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.149159 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:20.149170 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.149285 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54096,"prepare.queue_time_us":381044,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":386,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":16514,"thread_start_us":3182125,"threads_started":4,"wal-append.queue_time_us":204320,"wal-append.run_cpu_time_us":2578,"wal-append.run_wall_time_us":1002614}
I20260709 13:08:20.162544 16906 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.153075 16984 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:20.136157 16989 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.164172 16839 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.165549 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:20.168076 16940 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:20.169201 16884 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.169677 16979 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:20.177153 16995 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:08:20.178862 17004 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.178743 17001 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:20.180377 16857 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:20.182938 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.133580 16987 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.183459 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2177) took 3358 ms. Trace:
I20260709 13:08:20.245582 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.184008 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.184682 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.185906 12733 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:20.187254 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.134066 16982 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.237525 16984 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.258281 16982 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.260855 16580 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:20.261420 16580 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:20.262368 16580 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.263468 16580 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.143643 16812 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.264503 16859 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.242106 16906 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:20.264945 16812 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.265587 16906 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.267524 16812 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.205878 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.246176 12882 rpcz_store.cc:276] 0709 13:08:16.825352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.079632 (+254280us) service_pool.cc:224] Handling call
0709 13:08:17.080025 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.261498 (+2181473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.261541 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.262182 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.487153 (+224971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:19.487218 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.487305 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.183232 (+695927us) raft_consensus.cc:1685] finished
0709 13:08:20.183253 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.183405 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2167879,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"thread_start_us":224490,"threads_started":1,"wal-append.queue_time_us":265233}
I20260709 13:08:20.049942 12876 rpcz_store.cc:276] 0709 13:08:16.833251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.243807 (+2410556us) service_pool.cc:224] Handling call
0709 13:08:19.244147 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.244366 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:19.244690 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.908368 (+663678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.908445 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.908500 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.908573 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.908747 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6591,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":561361,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11929,"thread_start_us":663263,"threads_started":2,"wal-append.queue_time_us":241803}
I20260709 13:08:20.218737 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.229251 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.231868 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.273756 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.274315 12724 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.233971 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.237941 16900 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.157030 16679 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.248673 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.283308 12733 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.250373 16931 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.250661 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.248621 12808 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:20.296797 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60724 (request call id 399) took 1027 ms. Trace:
I20260709 13:08:20.297240 12799 rpcz_store.cc:276] 0709 13:08:19.269880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.282558 (+1012678us) service_pool.cc:224] Handling call
0709 13:08:20.296258 (+ 13700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.296457 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.296482 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.296523 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:20.296553 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.296606 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.296734 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.252135 16745 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:20.235554 16855 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:20.217846 16993 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.217463 16892 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:20.239295 16996 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.234581 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69114.6us
I20260709 13:08:20.269603 17008 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:20.306048 16995 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:20.268428 12729 raft_consensus.cc:2376] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11. Re-sending same reply.
I20260709 13:08:20.318810 12733 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:20.280431 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:20.320156 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 158774us
I20260709 13:08:20.320753 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.297909 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:20.300909 12724 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:20.302048 12771 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:20.268009 16906 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:20.305588 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.305454 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.308890 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.327647 12731 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.304672 16859 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.239544 16611 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:20.276672 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.304193 16857 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:20.303316 17002 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.301342 16900 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.324569 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.347057 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.325486 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:20.309832 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.307771 16745 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.330142 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.333047 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.348068 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.335207 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.350628 12875 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:20.351217 12729 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:20.335642 16864 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.321905 17008 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.356284 16864 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.357815 16984 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:20.357952 17008 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:20.358285 16864 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.335909 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.359671 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.318216 16996 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.360733 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.361786 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:20.361840 16996 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.362373 12799 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.273048 16987 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.340281 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.372488 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.323258 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:20.373680 12733 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:20.372538 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 127837us
I20260709 13:08:20.305207 17001 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:20.245798 17004 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.350281 12881 raft_consensus.cc:2376] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10. Re-sending same reply.
I20260709 13:08:20.310499 16855 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.350620 12880 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:20.352015 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.346278 12731 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
W20260709 13:08:20.353039 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51077.9us
W20260709 13:08:20.353416 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.347340 16991 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:20.354586 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.354820 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:20.364738 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.365254 12805 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:20.355717 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:20.340059 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.342334 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.583634 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:20.341568 16611 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.599179 12729 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:20.599961 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.373309 12801 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:20.331378 16859 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:20.371774 16889 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:20.385879 17001 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.392221 16679 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:20.364372 17002 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.341709 17003 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:08:20.584569 12731 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:20.671963 12731 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.672616 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2044) took 1237 ms. Trace:
I20260709 13:08:20.673009 12731 rpcz_store.cc:276] 0709 13:08:19.434931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.671465 (+1236534us) service_pool.cc:224] Handling call
0709 13:08:20.671795 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.672394 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.672567 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.674712 12731 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.675448 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2050) took 1156 ms. Trace:
I20260709 13:08:20.675833 12731 rpcz_store.cc:276] 0709 13:08:19.519490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.674120 (+1154630us) service_pool.cc:224] Handling call
0709 13:08:20.674493 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.675155 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.675384 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.677700 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2051) took 1157 ms. Trace:
I20260709 13:08:20.678135 12731 rpcz_store.cc:276] 0709 13:08:19.520305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.676740 (+1156435us) service_pool.cc:224] Handling call
0709 13:08:20.677077 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.677308 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.677347 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.677405 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.677449 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.677518 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.677641 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.600379 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2042) took 1166 ms. Trace:
I20260709 13:08:20.604315 12733 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:20.681603 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2055) took 1065 ms. Trace:
I20260709 13:08:20.682018 12733 rpcz_store.cc:276] 0709 13:08:19.616640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.680622 (+1063982us) service_pool.cc:224] Handling call
0709 13:08:20.680973 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.681164 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.681203 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.681262 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:20.681328 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.681398 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.681536 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.606245 12799 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:20.608877 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:20.629391 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 308518us
I20260709 13:08:20.679536 12729 rpcz_store.cc:276] 0709 13:08:19.434354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.583030 (+1148676us) service_pool.cc:224] Handling call
0709 13:08:20.598797 (+ 15767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.600101 (+  1304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.600315 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.630411 12873 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:20.669592 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 64407.1us
I20260709 13:08:20.349784 12876 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:20.685205 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.685767 12876 raft_consensus.cc:2376] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9. Re-sending same reply.
I20260709 13:08:20.692628 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.700627 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.702407 12876 raft_consensus.cc:2393] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:20.703430 12733 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.705555 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2056) took 1018 ms. Trace:
I20260709 13:08:20.707890 12733 rpcz_store.cc:276] 0709 13:08:19.687109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.702781 (+1015672us) service_pool.cc:224] Handling call
0709 13:08:20.703184 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.705228 (+  2044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.705486 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.716689 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:20.717916 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:20.605342 16611 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.719295 13518 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:20.719679 12876 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 6: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:20.719313 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:20.726841 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2057) took 1039 ms. Trace:
I20260709 13:08:20.632368 17001 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:20.727438 12729 rpcz_store.cc:276] 0709 13:08:19.687491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.702167 (+1014676us) service_pool.cc:224] Handling call
0709 13:08:20.726153 (+ 23986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.726446 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.726484 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.726540 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.726586 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.726654 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.726771 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.372805 16745 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.724663 13521 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:20.731899 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:20.730413 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45594.5us
W20260709 13:08:20.738289 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.733285 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.741873 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.742771 12729 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:08:20.744000 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2059) took 1055 ms. Trace:
I20260709 13:08:20.744490 12729 rpcz_store.cc:276] 0709 13:08:19.688152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.728695 (+1040543us) service_pool.cc:224] Handling call
0709 13:08:20.742485 (+ 13790us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:20.743663 (+  1178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.743939 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.746716 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:20.746440 16889 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:20.755302 16889 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.756958 13512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 362) took 1178 ms. Trace:
I20260709 13:08:20.757716 17002 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:20.757400 13512 rpcz_store.cc:276] 0709 13:08:19.578382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.578586 (+   204us) service_pool.cc:224] Handling call
0709 13:08:19.578963 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.909824 (+330861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.909862 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.909920 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.909954 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.756679 (+846725us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54006a0c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:20.756730 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.756863 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760386944}
I20260709 13:08:20.759429 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:20.760543 13520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 314) took 1600 ms. Trace:
I20260709 13:08:20.760972 13520 rpcz_store.cc:276] 0709 13:08:19.160027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.759052 (+1599025us) service_pool.cc:224] Handling call
0709 13:08:20.760463 (+  1411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.752636 13517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38668 (request call id 313) took 1593 ms. Trace:
W20260709 13:08:20.765769 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.739851 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.767866 13486 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:20.769387 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.771160 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.771837 12873 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:20.790850 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.792014 12873 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:20.793126 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.794015 12873 raft_consensus.cc:2368] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13.
I20260709 13:08:20.794888 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:20.799813 12873 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:20.801128 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:20.730412 17006 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:08:20.801980 17016 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:20.735833 16859 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.398818 12873 raft_consensus.cc:2376] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10. Re-sending same reply.
W20260709 13:08:20.815479 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82497.6us
W20260709 13:08:21.394675 12754 debug-util.cc:398] Leaking SignalData structure 0x7b0800225920 after lost signal to thread 12665
W20260709 13:08:20.957461 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.865198 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:20.773631 16884 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:21.398355 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.395011 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:21.418383 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 553273us
I20260709 13:08:21.428540 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:21.472694 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.473053 12730 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:08:21.473948 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2062) took 1784 ms. Trace:
I20260709 13:08:21.473938 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:21.474568 12730 rpcz_store.cc:276] 0709 13:08:19.689195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.472360 (+1783165us) service_pool.cc:224] Handling call
0709 13:08:21.472741 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.473611 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.473882 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:21.344901 16931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.008s	sys 0.015s
I20260709 13:08:20.837257 16982 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.202474 16745 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.577049 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.635771 12873 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:20.872557 17003 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.636803 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.637461 12873 raft_consensus.cc:2376] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9. Re-sending same reply.
I20260709 13:08:21.638329 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.407224 17004 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.477578 16889 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:20.865798 16580 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:21.480211 16859 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.472514 16884 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:21.476811 17019 raft_consensus.cc:2764] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:08:21.560606 16931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.008s	sys 0.019s
I20260709 13:08:21.635308 16910 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:21.659106 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.204183 16611 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:21.655401 12873 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:21.662436 13512 raft_consensus.cc:1813] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Handling vote request from an unknown peer 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:21.663829 13512 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:21.584077 16982 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:21.668154 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.474694 17016 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:20.830029 17001 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:20.766469 13517 rpcz_store.cc:276] 0709 13:08:19.159725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.715667 (+1555942us) service_pool.cc:224] Handling call
0709 13:08:20.736167 (+ 20500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.749077 (+ 12910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.752144 (+  3067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.752213 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.752290 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.752365 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.752520 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.661023 16884 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.639245 16991 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:21.670068 12873 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:21.657608 16914 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:21.671764 17016 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.678825 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2286) took 1345 ms. Trace:
I20260709 13:08:21.660403 16580 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:21.675761 16611 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:21.678352 17001 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.703315 17028 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.704088 17028 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:21.657735 17003 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.688437 12873 rpcz_store.cc:276] 0709 13:08:20.333461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.667699 (+1334238us) service_pool.cc:224] Handling call
0709 13:08:21.678775 (+ 11076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.707798 16914 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.714406 16580 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.716432 16900 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.723412 16900 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.723578 16841 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.723938 16900 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.726748 16900 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.667742 16910 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.719789 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.727732 12880 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:21.728263 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2287) took 1387 ms. Trace:
I20260709 13:08:21.729063 12880 rpcz_store.cc:276] 0709 13:08:20.342485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.719351 (+1376866us) service_pool.cc:224] Handling call
0709 13:08:21.728201 (+  8850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.729643 17028 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.730248 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.730995 12880 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.734650 17003 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:21.710855 17016 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.739328 12880 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
W20260709 13:08:21.740557 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 83970us
I20260709 13:08:21.741822 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:21.744321 12803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1474) took 2248 ms (client timeout 1977 ms). Trace:
I20260709 13:08:21.748582 16978 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.794884 12873 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.794191 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.797035 12880 raft_consensus.cc:2376] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9. Re-sending same reply.
I20260709 13:08:21.797744 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2305) took 1080 ms. Trace:
W20260709 13:08:21.798044 12754 debug-util.cc:398] Leaking SignalData structure 0x7b0800106780 after lost signal to thread 12757
W20260709 13:08:21.799834 12754 debug-util.cc:398] Leaking SignalData structure 0x7b0800135920 after lost signal to thread 12832
W20260709 13:08:21.800225 12754 debug-util.cc:398] Leaking SignalData structure 0x7b080022bae0 after lost signal to thread 12833
I20260709 13:08:21.798135 12880 rpcz_store.cc:276] 0709 13:08:20.716947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.793897 (+1076950us) service_pool.cc:224] Handling call
0709 13:08:21.797651 (+  3754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.803464 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.750291 16910 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.754038 16855 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:21.758569 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 1.3834e+06us
I20260709 13:08:21.760800 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1452) took 2452 ms. Trace:
I20260709 13:08:21.762655 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.678524 16991 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.740276 16982 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:21.769078 17002 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.778884 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.781131 16989 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.744338 16889 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:21.777051 16745 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:21.783706 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:21.783886 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 310044us
I20260709 13:08:21.848583 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2304) took 1132 ms. Trace:
I20260709 13:08:21.783773 17017 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:21.859736 12696 connection.cc:256] RPC call timeout handler was delayed by -1.0238437060000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 13:08:21.805932 12880 raft_consensus.cc:2410] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:08:21.795030 12803 rpcz_store.cc:269] 0709 13:08:19.496119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.496226 (+   107us) service_pool.cc:224] Handling call
0709 13:08:21.744023 (+2247797us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54001d51d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:21.744209 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768752000}
W20260709 13:08:21.816391 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.825893 12876 raft_consensus.cc:2393] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:21.860594 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2306) took 1138 ms. Trace:
I20260709 13:08:21.861050 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2303) took 1144 ms. Trace:
I20260709 13:08:21.861642 12876 rpcz_store.cc:276] 0709 13:08:20.716336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.762352 (+1046016us) service_pool.cc:224] Handling call
0709 13:08:21.860978 (+ 98626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.862913 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.820101 12726 rpcz_store.cc:276] 0709 13:08:19.307978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.310026 (+  2048us) service_pool.cc:224] Handling call
0709 13:08:19.310531 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.310822 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:19.312061 (+  1239us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.271059 (+958998us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b180035cf80. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a
0709 13:08:20.348065 (+ 77006us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.758148 (+1410083us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b180035cf80. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:08:21.758385 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.758445 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.758499 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.758614 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.760666 (+  2052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406110,"prepare.queue_time_us":2158,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":98,"raft.queue_time_us":1497859,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":20147,"spinlock_wait_cycles":159683072,"thread_start_us":140395,"threads_started":3,"wal-append.queue_time_us":58361,"wal-append.run_cpu_time_us":8544,"wal-append.run_wall_time_us":1938309}
I20260709 13:08:21.829176 12724 raft_consensus.cc:2955] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:21.849021 12878 rpcz_store.cc:276] 0709 13:08:20.716632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.783389 (+1066757us) service_pool.cc:224] Handling call
0709 13:08:21.848511 (+ 65122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.852843 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.857298 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2061) took 2168 ms. Trace:
I20260709 13:08:21.858266 16914 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.858618 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.884693 12879 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:21.885488 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2326) took 1071 ms. Trace:
I20260709 13:08:21.885888 12879 rpcz_store.cc:276] 0709 13:08:20.813850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.858343 (+1044493us) service_pool.cc:224] Handling call
0709 13:08:21.885403 (+ 27060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.887144 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.847914 16864 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:21.859347 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:21.788100 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 359696us
I20260709 13:08:21.897286 13514 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
W20260709 13:08:21.859951 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.898579 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 497322us
I20260709 13:08:21.861058 12880 rpcz_store.cc:276] 0709 13:08:20.722561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.803101 (+1080540us) service_pool.cc:224] Handling call
0709 13:08:21.860536 (+ 57435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:21.861084 12696 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.540s (SENT) [suppressed 60 similar messages]
I20260709 13:08:21.865754 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.899900 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.900511 12878 raft_consensus.cc:2410] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:21.900818 12880 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:21.869383 12729 rpcz_store.cc:276] 0709 13:08:19.688888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.745283 (+1056395us) service_pool.cc:224] Handling call
0709 13:08:20.745928 (+   645us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:21.761108 (+1015180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.761143 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:21.761887 (+   744us) log.cc:844] Serialized 78 byte log entry
0709 13:08:21.826925 (+ 65038us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.826992 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.827106 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.857033 (+ 29927us) raft_consensus.cc:1685] finished
0709 13:08:21.857061 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.857234 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1014657,"raft.queue_time_us":1015035,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"thread_start_us":64551,"threads_started":1,"wal-append.queue_time_us":65032}
I20260709 13:08:21.871994 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2058) took 2184 ms. Trace:
I20260709 13:08:21.873616 16993 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:21.876993 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.877208 16987 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:21.888005 12879 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:21.902670 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.905472 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2311) took 1164 ms. Trace:
I20260709 13:08:21.906090 12879 rpcz_store.cc:276] 0709 13:08:20.741533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.886848 (+1145315us) service_pool.cc:224] Handling call
0709 13:08:21.905377 (+ 18529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.875909 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1477) took 2356 ms. Trace:
I20260709 13:08:21.907742 12807 rpcz_store.cc:276] 0709 13:08:19.519981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.521174 (+  1193us) service_pool.cc:224] Handling call
0709 13:08:19.566876 (+ 45702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.119690 (+552814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.875615 (+1755925us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54001748d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:21.875834 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141156096}
I20260709 13:08:21.897655 12773 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:21.855715 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.901028 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2310) took 1159 ms. Trace:
I20260709 13:08:21.900961 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:21.910036 12878 rpcz_store.cc:276] 0709 13:08:20.741192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.865513 (+1124321us) service_pool.cc:224] Handling call
0709 13:08:21.900964 (+ 35451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.863790 12876 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:21.901310 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2307) took 1171 ms. Trace:
I20260709 13:08:21.902974 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.912109 12880 rpcz_store.cc:276] 0709 13:08:20.729858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.899625 (+1169767us) service_pool.cc:224] Handling call
0709 13:08:21.901256 (+  1631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.913684 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2309) took 1176 ms. Trace:
I20260709 13:08:21.909524 12875 raft_consensus.cc:2376] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11. Re-sending same reply.
I20260709 13:08:21.914451 12876 rpcz_store.cc:276] 0709 13:08:20.737168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.862567 (+1125399us) service_pool.cc:224] Handling call
0709 13:08:21.913590 (+ 51023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.912374 12729 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:08:21.914940 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2308) took 1180 ms. Trace:
I20260709 13:08:21.901513 12733 rpcz_store.cc:276] 0709 13:08:19.687813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.710725 (+1022912us) service_pool.cc:224] Handling call
0709 13:08:20.711139 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.760852 (+1049713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.760884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.761359 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.831907 (+ 70548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:21.831953 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.832019 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.871730 (+ 39711us) raft_consensus.cc:1685] finished
0709 13:08:21.871754 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.871924 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1049224,"raft.queue_time_us":1049713,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"thread_start_us":70143,"threads_started":1,"wal-append.queue_time_us":70531}
I20260709 13:08:21.917514 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.922497 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2313) took 1159 ms. Trace:
I20260709 13:08:21.922874 12879 rpcz_store.cc:276] 0709 13:08:20.766835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.912785 (+1145950us) service_pool.cc:224] Handling call
0709 13:08:21.922432 (+  9647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.868172 17017 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:21.926631 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.927013 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:21.924101 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.927471 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2314) took 1158 ms. Trace:
I20260709 13:08:21.925490 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.927376 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.925149 12875 rpcz_store.cc:276] 0709 13:08:20.734193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.855352 (+1121159us) service_pool.cc:224] Handling call
0709 13:08:21.914845 (+ 59493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.928069 12876 rpcz_store.cc:276] 0709 13:08:20.769052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.926381 (+1157329us) service_pool.cc:224] Handling call
0709 13:08:21.927415 (+  1034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.928889 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.929162 12729 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:21.929500 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.929715 12875 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:21.930075 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.930413 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2315) took 1157 ms. Trace:
I20260709 13:08:21.930680 12729 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:21.930771 12875 rpcz_store.cc:276] 0709 13:08:20.772826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.928657 (+1155831us) service_pool.cc:224] Handling call
0709 13:08:21.930347 (+  1690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.931304 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.928735 12879 raft_consensus.cc:2410] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:21.931803 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.932219 12878 raft_consensus.cc:2410] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:21.932323 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2328) took 1117 ms. Trace:
I20260709 13:08:21.932756 12875 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.849239 17002 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:21.933933 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:21.934644 12879 rpcz_store.cc:276] 0709 13:08:20.814505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.923507 (+1109002us) service_pool.cc:224] Handling call
0709 13:08:21.932263 (+  8756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.937647 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.929617 13517 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:21.864795 16745 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:21.939898 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2285) took 1606 ms. Trace:
I20260709 13:08:21.940073 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.948899 12879 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:21.937794 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:21.946915 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.948284 12878 rpcz_store.cc:276] 0709 13:08:20.333221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.928075 (+1594854us) service_pool.cc:224] Handling call
0709 13:08:21.937316 (+  9241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.950271 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:21.952515 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:21.954011 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2325) took 1140 ms. Trace:
I20260709 13:08:21.954294 12729 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.947086 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.954388 12879 rpcz_store.cc:276] 0709 13:08:20.813549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.938113 (+1124564us) service_pool.cc:224] Handling call
0709 13:08:21.953949 (+ 15836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.948053 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2053) took 2370 ms. Trace:
I20260709 13:08:21.956415 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2063) took 2266 ms. Trace:
I20260709 13:08:21.956015 12731 rpcz_store.cc:276] 0709 13:08:19.577795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.679251 (+1101456us) service_pool.cc:224] Handling call
0709 13:08:20.694813 (+ 15562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.759223 (+1064410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.759251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:21.760106 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 13:08:21.922862 (+162756us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.922912 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.922995 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.947760 (+ 24765us) raft_consensus.cc:1685] finished
0709 13:08:21.947784 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.947963 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063933,"raft.queue_time_us":1065739,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":162329,"threads_started":1,"wal-append.queue_time_us":181995}
I20260709 13:08:21.962970 12875 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:21.956941 12730 rpcz_store.cc:276] 0709 13:08:19.689547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.475821 (+1786274us) service_pool.cc:224] Handling call
0709 13:08:21.560706 (+ 84885us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.769727 (+209021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.769760 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:21.770408 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 13:08:21.890109 (+119701us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:21.955886 (+ 65777us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.956123 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.956198 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.956237 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:21.956249 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.956364 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208567,"prepare.queue_time_us":49356,"raft.queue_time_us":219213,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":159335,"threads_started":2,"wal-append.queue_time_us":135527}
I20260709 13:08:21.932965 16892 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.931304 17017 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.965849 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.963840 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2323) took 1151 ms. Trace:
I20260709 13:08:21.967828 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:21.969872 12878 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.971107 12875 rpcz_store.cc:276] 0709 13:08:20.812877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.931540 (+1118663us) service_pool.cc:224] Handling call
0709 13:08:21.963716 (+ 32176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.972599 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.973413 12875 raft_consensus.cc:1813] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Handling vote request from an unknown peer 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:21.974639 12875 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:21.975286 12879 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:21.977070 17018 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.931519 16347 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:08:21.983872 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2331) took 1145 ms. Trace:
I20260709 13:08:21.984584 12879 rpcz_store.cc:276] 0709 13:08:20.838613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.955677 (+1117064us) service_pool.cc:224] Handling call
0709 13:08:21.983782 (+ 28105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.986938 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:21.986302 12729 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
W20260709 13:08:21.980556 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 79666.4us
I20260709 13:08:21.988153 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2068) took 2296 ms. Trace:
I20260709 13:08:21.988694 12730 rpcz_store.cc:276] 0709 13:08:19.691253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.964482 (+2273229us) service_pool.cc:224] Handling call
0709 13:08:21.986435 (+ 21953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.987771 (+  1336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.987801 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.987837 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:21.987874 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.987928 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.988090 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.990694 12699 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:21.992473 12876 raft_consensus.cc:2393] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:22.001184 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.008335 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.010272 12806 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:22.011241 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2327) took 1197 ms. Trace:
I20260709 13:08:22.011677 12876 rpcz_store.cc:276] 0709 13:08:20.814177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.969367 (+1155190us) service_pool.cc:224] Handling call
0709 13:08:22.011146 (+ 41779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.974092 16613 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:21.969039 16892 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:21.965440 17031 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.975127 16859 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.019953 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.025355 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:22.029938 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 168888us
W20260709 13:08:22.030639 12696 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.549s (SENT)
W20260709 13:08:22.031559 12696 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.586s (SENT)
W20260709 13:08:22.032284 12696 leader_election.cc:336] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.591s (SENT)
W20260709 13:08:22.033968 12696 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.626s (SENT)
I20260709 13:08:22.034528 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:22.035259 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.946653 16889 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.046754 17044 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:22.047435 17044 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:22.050463 12873 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:22.019609 16892 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.053218 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2302) took 1337 ms. Trace:
I20260709 13:08:22.053576 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2069) took 2362 ms. Trace:
I20260709 13:08:22.056808 12726 rpcz_store.cc:276] 0709 13:08:19.691567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.965553 (+2273986us) service_pool.cc:224] Handling call
0709 13:08:21.982068 (+ 16515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.982372 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.982397 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.982847 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.038271 (+ 55424us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:22.038351 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.038445 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.052909 (+ 14464us) raft_consensus.cc:1685] finished
0709 13:08:22.052927 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.053524 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62353,"thread_start_us":55082,"threads_started":1,"wal-append.queue_time_us":59168}
I20260709 13:08:22.056160 12873 rpcz_store.cc:276] 0709 13:08:20.716060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.741520 (+1025460us) service_pool.cc:224] Handling call
0709 13:08:22.053157 (+311637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.019785 17031 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:22.061573 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2072) took 2201 ms. Trace:
I20260709 13:08:22.067237 12726 rpcz_store.cc:276] 0709 13:08:19.860624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.060521 (+2199897us) service_pool.cc:224] Handling call
0709 13:08:22.060891 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.061106 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.061142 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.061200 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:22.061245 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.061315 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.061493 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.069747 12726 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:22.074609 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2073) took 2213 ms. Trace:
I20260709 13:08:21.996191 17029 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:22.015635 17028 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:22.018219 17033 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:08:22.029704 16859 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.076133 17031 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.102041 17042 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.107141 16991 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:22.123598 16745 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.127701 17002 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.128933 16892 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.062601 17044 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.129643 16970 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.130928 16859 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.141747 16857 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.152606 16857 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.154605 16947 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.145828 16884 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.164428 17034 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:22.164577 13520 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.165025 17034 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:22.166002 17034 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.166565 16813 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:22.167220 17034 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.169816 16884 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:22.171295 16893 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.176630 16893 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:22.177706 16864 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:22.178141 16864 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:22.168735 16852 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:22.179001 16864 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.173667 16928 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.175423 16846 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:22.224913 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 190675us
W20260709 13:08:22.227979 12696 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.698s (SENT)
I20260709 13:08:22.228955 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:22.075435 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 84808.7us
I20260709 13:08:22.233525 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:22.075205 12726 rpcz_store.cc:276] 0709 13:08:19.861033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.068834 (+2207801us) service_pool.cc:224] Handling call
0709 13:08:22.069492 (+   658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.074123 (+  4631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.074456 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.238088 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2066) took 2547 ms. Trace:
W20260709 13:08:22.242254 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.245143 12802 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:22.250829 12881 pending_rounds.cc:85] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 4
I20260709 13:08:22.251489 12881 pending_rounds.cc:107] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 10.5
W20260709 13:08:22.259115 17060 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:22.239274 12726 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:08:22.265741 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.260751 16892 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.268643 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2074) took 2368 ms. Trace:
I20260709 13:08:22.278672 16864 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:22.282524 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 54677.9us
I20260709 13:08:22.284533 16928 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:22.285492 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52805.9us
I20260709 13:08:22.285962 16931 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.287645 12726 rpcz_store.cc:276] 0709 13:08:19.898843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.236999 (+2338156us) service_pool.cc:224] Handling call
0709 13:08:22.238160 (+  1161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.265077 (+ 26917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.266777 (+  1700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.251967 12881 raft_consensus.cc:2889] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.177731 16893 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.290416 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:22.312541 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 550) took 1984 ms. Trace:
I20260709 13:08:22.313048 12726 rpcz_store.cc:276] 0709 13:08:20.332192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.310806 (+1978614us) service_pool.cc:224] Handling call
0709 13:08:22.311597 (+   791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.312074 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.312112 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.312189 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:22.312227 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.312296 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.312438 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.314750 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:22.238811 12731 rpcz_store.cc:276] 0709 13:08:19.690568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.960971 (+2270403us) service_pool.cc:224] Handling call
0709 13:08:21.980892 (+ 19921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.981342 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.981383 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.996113 (+ 14730us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.236731 (+240618us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:22.236904 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.237129 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.237291 (+   162us) raft_consensus.cc:1685] finished
0709 13:08:22.237325 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.237734 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57489,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":172859,"threads_started":1,"wal-append.queue_time_us":133665}
I20260709 13:08:22.321882 16893 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.323498 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 551) took 1559 ms. Trace:
I20260709 13:08:22.330500 12731 rpcz_store.cc:276] 0709 13:08:20.763879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.322050 (+1558171us) service_pool.cc:224] Handling call
0709 13:08:22.322636 (+   586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.323064 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.323091 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.323164 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:22.323235 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.323299 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.323439 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.325335 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 545) took 3026 ms. Trace:
I20260709 13:08:22.333809 12725 rpcz_store.cc:276] 0709 13:08:19.299146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.300490 (+  1344us) service_pool.cc:224] Handling call
0709 13:08:22.323872 (+3023382us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800002a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:08:22.324215 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.324731 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.324759 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.324829 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:22.324877 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.324939 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.325118 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47500416}
W20260709 13:08:22.329788 12696 leader_election.cc:336] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.718s (SENT)
I20260709 13:08:22.346452 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:22.357774 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2317) took 1558 ms. Trace:
I20260709 13:08:22.360427 16931 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:22.363557 17058 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:08:22.365790 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2319) took 1554 ms. Trace:
I20260709 13:08:22.366317 12876 rpcz_store.cc:276] 0709 13:08:20.811376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.012410 (+1201034us) service_pool.cc:224] Handling call
0709 13:08:22.028203 (+ 15793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.028694 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:22.028734 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.037655 (+  8921us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.271277 (+233622us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:22.271595 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.271801 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.365325 (+ 93524us) raft_consensus.cc:1685] finished
0709 13:08:22.365356 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.365581 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":582,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8917,"thread_start_us":169326,"threads_started":1,"wal-append.queue_time_us":139428}
I20260709 13:08:22.358784 12875 rpcz_store.cc:276] 0709 13:08:20.798726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.995400 (+1196674us) service_pool.cc:224] Handling call
0709 13:08:22.012813 (+ 17413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.013288 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.014900 (+  1612us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.024909 (+ 10009us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.108430 (+ 83521us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.303274 (+194844us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.356273 (+ 52999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.356561 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.356691 (+   130us) raft_consensus.cc:1685] finished
0709 13:08:22.356717 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.357179 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9316,"prepare.queue_time_us":225758,"raft.queue_time_us":5119,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5813,"thread_start_us":31540,"threads_started":2,"wal-append.queue_time_us":63464}
I20260709 13:08:22.369143 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2316) took 1594 ms. Trace:
W20260709 13:08:22.367833 12696 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.729s (SENT)
I20260709 13:08:22.361935 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 553) took 1592 ms. Trace:
I20260709 13:08:22.374177 12731 rpcz_store.cc:276] 0709 13:08:20.769198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.342991 (+1573793us) service_pool.cc:224] Handling call
0709 13:08:22.361137 (+ 18146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.361538 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.361571 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.361625 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:22.361666 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.361713 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.361850 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:22.380422 12754 debug-util.cc:398] Leaking SignalData structure 0x7b0800399c00 after lost signal to thread 12906
W20260709 13:08:22.383677 12754 debug-util.cc:398] Leaking SignalData structure 0x7b0800288260 after lost signal to thread 13545
I20260709 13:08:22.373777 12879 rpcz_store.cc:276] 0709 13:08:20.774498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.994555 (+1220057us) service_pool.cc:224] Handling call
0709 13:08:21.996671 (+  2116us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.997189 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.997232 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.014519 (+ 17287us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.106511 (+ 91992us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.289122 (+182611us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.343507 (+ 54385us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.368386 (+ 24879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.368521 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.368618 (+    97us) raft_consensus.cc:1685] finished
0709 13:08:22.368637 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.368912 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79297,"prepare.queue_time_us":222476,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":142,"raft.queue_time_us":20275,"raft.run_cpu_time_us":566,"raft.run_wall_time_us":7348,"spinlock_wait_cycles":20439808,"thread_start_us":228370,"threads_started":2,"wal-append.queue_time_us":108060}
I20260709 13:08:22.369207 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 349) took 2045 ms. Trace:
I20260709 13:08:22.393296 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:22.395087 12754 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0e60 after lost signal to thread 13546
I20260709 13:08:22.392467 12882 rpcz_store.cc:276] 0709 13:08:20.323477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.323611 (+   134us) service_pool.cc:224] Handling call
0709 13:08:20.323890 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.751665 (+1427775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.751715 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.751780 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:21.751826 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.368427 (+616601us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003a0054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:22.368513 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.368852 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283086080}
W20260709 13:08:22.406682 12847 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.511s (SENT)
I20260709 13:08:22.407457 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:22.412988 17056 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.056s	user 0.004s	sys 0.001s
I20260709 13:08:22.415336 16892 consensus_queue.cc:1059] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:22.424932 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1455) took 3014 ms. Trace:
I20260709 13:08:22.425446 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 552) took 1658 ms. Trace:
I20260709 13:08:22.425966 12727 rpcz_store.cc:276] 0709 13:08:20.766859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.327584 (+1560725us) service_pool.cc:224] Handling call
0709 13:08:22.328111 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.361484 (+ 33373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.361524 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.361601 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.361633 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.424989 (+ 63356us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b5400062f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:22.425037 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.425174 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21168896}
I20260709 13:08:22.425602 12724 rpcz_store.cc:276] 0709 13:08:19.410429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.323076 (+912647us) service_pool.cc:224] Handling call
0709 13:08:20.324118 (+  1042us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.762373 (+1438255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.762426 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:21.763935 (+  1509us) log.cc:844] Serialized 513 byte log entry
0709 13:08:21.828833 (+ 64898us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:21.877720 (+ 48887us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.308710 (+430990us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.352716 (+ 44006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.423879 (+ 71163us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400309154. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:22.423963 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.424456 (+   493us) raft_consensus.cc:1685] finished
0709 13:08:22.424473 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.424695 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1030101,"prepare.queue_time_us":6475,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":1083613,"raft.run_cpu_time_us":700,"raft.run_wall_time_us":14340,"spinlock_wait_cycles":979657472,"thread_start_us":428623,"threads_started":2,"wal-append.queue_time_us":64832}
I20260709 13:08:22.430495 12731 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 12 index: 4. (index mismatch)
I20260709 13:08:22.450701 12803 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:22.431921 12724 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:22.465591 16580 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.453977 12732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1456) took 3043 ms (client timeout 1784 ms). Trace:
I20260709 13:08:22.466351 16580 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:22.466725 12732 rpcz_store.cc:269] 0709 13:08:19.410719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.496929 (+ 86210us) service_pool.cc:224] Handling call
0709 13:08:22.453468 (+2956539us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54003b1d54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:22.453667 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906434304}
I20260709 13:08:22.468710 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.471582 12880 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:22.472689 12619 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.245s	user 0.014s	sys 0.022s
I20260709 13:08:22.452950 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.431401 16982 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.474736 16846 raft_consensus.cc:3055] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:22.475383 16846 raft_consensus.cc:740] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:22.476727 12731 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:22.452205 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 2.14521e+06us
I20260709 13:08:22.448571 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2320) took 1636 ms. Trace:
I20260709 13:08:22.439646 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2330) took 1624 ms. Trace:
I20260709 13:08:22.479640 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:22.437525 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2070) took 2704 ms. Trace:
I20260709 13:08:22.480314 12877 rpcz_store.cc:276] 0709 13:08:20.815170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.437632 (+1622462us) service_pool.cc:224] Handling call
0709 13:08:22.438311 (+   679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.438893 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.438930 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.438991 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.439054 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.439137 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.439333 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.481786 17017 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.489295 12726 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:22.491153 12845 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:22.492103 17017 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.483510 12730 rpcz_store.cc:276] 0709 13:08:19.691877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.989865 (+2297988us) service_pool.cc:224] Handling call
0709 13:08:21.990259 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.248527 (+258268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.248623 (+    96us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.250396 (+  1773us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.345134 (+ 94738us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:22.345190 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.350915 (+  5725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.391915 (+ 41000us) raft_consensus.cc:1685] finished
0709 13:08:22.391938 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.396241 (+  4303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55760,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":349129,"threads_started":2,"wal-append.queue_time_us":128959}
I20260709 13:08:22.485769 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:22.442021 12800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1485) took 2262 ms (client timeout 2249 ms). Trace:
I20260709 13:08:22.493039 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:22.499464 16846 consensus_queue.cc:260] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.501824 16884 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:22.502496 16884 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:22.484913 13521 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:22.498059 16931 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:22.504765 12754 debug-util.cc:398] Leaking SignalData structure 0x7b080033e100 after lost signal to thread 16912
I20260709 13:08:22.499042 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2064) took 2809 ms. Trace:
I20260709 13:08:22.503777 16884 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:22.505275 12754 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb420 after lost signal to thread 16919
W20260709 13:08:22.505909 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.505278 12733 rpcz_store.cc:276] 0709 13:08:19.689907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.938541 (+2248634us) service_pool.cc:224] Handling call
0709 13:08:21.938927 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.013881 (+ 74954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.013928 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.024252 (+ 10324us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.432019 (+407767us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.433202 (+  1183us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.433563 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.433732 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.449640 (+ 15908us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b1800357520. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:22.498436 (+ 48796us) raft_consensus.cc:1685] finished
0709 13:08:22.498556 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.498755 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2495,"prepare.queue_time_us":293,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":99017,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":435,"spinlock_wait_cycles":2946816,"thread_start_us":339533,"threads_started":2,"wal-append.queue_time_us":296349}
I20260709 13:08:22.514833 16857 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.480247 12873 rpcz_store.cc:276] 0709 13:08:20.811717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.059615 (+1247898us) service_pool.cc:224] Handling call
0709 13:08:22.060122 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.063879 (+  3757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.063921 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.089924 (+ 26003us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.428420 (+338496us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:22.428624 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.428730 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.448188 (+ 19458us) raft_consensus.cc:1685] finished
0709 13:08:22.448205 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.448363 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5352,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":26785,"thread_start_us":279427,"threads_started":1,"wal-append.queue_time_us":318968}
I20260709 13:08:22.523087 16580 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.448390 17066 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:22.524305 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:22.536262 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:22.536211 17066 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.538113 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:08:22.509812 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 142460us
I20260709 13:08:22.501982 16846 raft_consensus.cc:3060] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:22.542420 12800 rpcz_store.cc:269] 0709 13:08:20.179411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.441524 (+2262113us) service_pool.cc:211] Skipping call since client already timed out
0709 13:08:22.441696 (+   172us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:08:22.547281 16982 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:22.539806 12696 leader_election.cc:336] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.773s (SENT)
I20260709 13:08:22.548965 16857 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.558084 12728 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:08:22.559823 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 153421us
I20260709 13:08:22.560907 17032 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.561288 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2321) took 1749 ms. Trace:
W20260709 13:08:22.561470 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 70720.8us
I20260709 13:08:22.562769 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:22.571439 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:22.563516 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 85668.4us
I20260709 13:08:22.565110 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.565716 17066 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.562806 16914 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.569041 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:22.571982 12881 rpcz_store.cc:276] 0709 13:08:20.812077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.135499 (+1323422us) service_pool.cc:224] Handling call
0709 13:08:22.249781 (+114282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.317771 (+ 67990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.317825 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.319056 (+  1231us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.352493 (+ 33437us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.373225 (+ 20732us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.373967 (+   742us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.492888 (+118921us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b180039e800. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:22.558584 (+ 65696us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b180039e800. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:08:22.560838 (+  2254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.560923 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.560982 (+    59us) raft_consensus.cc:1685] finished
0709 13:08:22.560998 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.561212 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88882,"prepare.queue_time_us":20945,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":84,"raft.queue_time_us":188006,"raft.run_cpu_time_us":571,"raft.run_wall_time_us":7594,"spinlock_wait_cycles":37697536,"thread_start_us":30848,"threads_started":1,"wal-append.queue_time_us":121006}
I20260709 13:08:22.576020 16982 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.495846 17031 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:22.595921 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.597601 12627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 76) took 7951 ms. Trace:
I20260709 13:08:22.597992 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.585076 16914 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:22.603291 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.594084 16982 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.599795 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:22.617331 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.620713 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.606559 16914 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.632117 12801 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:22.632684 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:22.634409 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94665.1us
W20260709 13:08:22.635360 12696 leader_election.cc:336] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.802s (SENT)
I20260709 13:08:22.636543 16991 raft_consensus.cc:2764] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:22.638531 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.642321 12725 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:22.646621 12878 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.016s
I20260709 13:08:22.647151 12878 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:22.658851 13521 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:22.665675 17031 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:22.623999 16864 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.682960 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.682591 12726 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:22.683058 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
W20260709 13:08:22.689886 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 94161.6us
I20260709 13:08:22.694856 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:22.704833 13487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.720239 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.598240 12627 rpcz_store.cc:276] 0709 13:08:14.646213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.647446 (+  1233us) service_pool.cc:224] Handling call
0709 13:08:18.626281 (+3978835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.626313 (+    32us) write_op.cc:454] Released schema lock
0709 13:08:22.597265 (+3970952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.671078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.815816 (+144738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.816563 (+   747us) write_op.cc:435] Acquired schema lock
0709 13:08:16.821882 (+  5319us) tablet.cc:662] Decoding operations
0709 13:08:16.886006 (+ 64124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.886095 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.886134 (+    39us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:16.887122 (+   988us) tablet.cc:701] Row locks acquired
0709 13:08:16.887137 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:08:16.887349 (+   212us) write_op.cc:270] Start()
0709 13:08:16.887496 (+   147us) write_op.cc:276] Timestamp: P: 1783602496887281 usec, L: 0
0709 13:08:16.887521 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.982845 (+ 95324us) log.cc:844] Serialized 3916 byte log entry
0709 13:08:17.427300 (+444455us) op_driver.cc:464] REPLICATION: finished
0709 13:08:17.428841 (+  1541us) write_op.cc:301] APPLY: starting
0709 13:08:17.428946 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:17.429786 (+   840us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:17.429933 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:17.430871 (+   938us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:17.431136 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:08:17.431197 (+    61us) write_op.cc:312] APPLY: finished
0709 13:08:17.431723 (+   526us) log.cc:844] Serialized 76 byte log entry
0709 13:08:17.431931 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:17.432116 (+   185us) write_op.cc:454] Released schema lock
0709 13:08:17.432165 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":672144,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":1184,"apply.run_cpu_time_us":3523,"apply.run_wall_time_us":3722,"num_ops":10,"prepare.queue_time_us":158126,"prepare.run_cpu_time_us":19270,"prepare.run_wall_time_us":522989,"raft.queue_time_us":176944,"raft.run_cpu_time_us":1201,"raft.run_wall_time_us":1633,"replication_time_us":539605,"spinlock_wait_cycles":68352,"thread_start_us":2431523,"threads_started":4,"wal-append.queue_time_us":217039,"wal-append.run_cpu_time_us":8277,"wal-append.run_wall_time_us":1225163}]]}
I20260709 13:08:22.716969 12725 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:22.727057 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.728785 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.730253 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.728147 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.736676 12803 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:08:22.738281 12728 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:22.737649 12733 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:22.742327 12628 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.752314 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:22.754675 16983 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.763921 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.764511 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.766461 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:22.767663 12619 maintenance_manager.cc:643] P d95a6396e3d84f5fb98713ce86e01813: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.586s	user 0.236s	sys 0.137s Metrics: {"bytes_written":30653,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":81702,"dirs.run_cpu_time_us":463,"dirs.run_wall_time_us":32376,"drs_written":1,"lbm_read_time_us":455,"lbm_reads_lt_1ms":4,"lbm_write_time_us":140036,"lbm_writes_1-10_ms":6,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":44344448,"thread_start_us":171887,"threads_started":2,"update_count":25,"wal-append.queue_time_us":164914}
I20260709 13:08:22.773402 12620 maintenance_manager.cc:419] P d95a6396e3d84f5fb98713ce86e01813: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7764 bytes on disk
W20260709 13:08:22.777274 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.779548 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 144275us
I20260709 13:08:22.788620 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:22.789693 16991 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.790335 16991 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:22.798578 16991 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.799532 12628 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.802217 12619 maintenance_manager.cc:643] P d95a6396e3d84f5fb98713ce86e01813: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.027s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24527,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 13:08:22.806197 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.807453 12725 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:22.808527 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2322) took 1996 ms. Trace:
I20260709 13:08:22.808666 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.809208 12874 rpcz_store.cc:276] 0709 13:08:20.812552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.407306 (+1594754us) service_pool.cc:224] Handling call
0709 13:08:22.408096 (+   790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.570997 (+162901us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:22.571341 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.614717 (+ 43376us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.624606 (+  9889us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.624772 (+   166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:22.627010 (+  2238us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.636876 (+  9866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.637180 (+   304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.808109 (+170929us) raft_consensus.cc:1685] finished
0709 13:08:22.808132 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.808315 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171201,"prepare.queue_time_us":12885,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":171626,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":1611,"thread_start_us":42821,"threads_started":1,"wal-append.queue_time_us":232164}
I20260709 13:08:22.810609 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:22.803459 12628 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.752497 16914 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:22.835606 12696 leader_election.cc:336] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.813s (SENT)
I20260709 13:08:22.835989 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.842497 12733 raft_consensus.cc:2376] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12. Re-sending same reply.
I20260709 13:08:22.849256 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:22.849912 12696 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:22.846837 12847 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.656s (SENT)
I20260709 13:08:22.851294 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:22.853579 12728 raft_consensus.cc:2376] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11. Re-sending same reply.
I20260709 13:08:22.855528 16899 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.843750 12628 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 6 to 7, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 7 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:22.861138 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.862380 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.836566 17032 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:22.869537 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.869992 12628 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 5 to 8, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 8 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.875193 12628 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 9, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.887425 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.875352 16864 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:22.898474 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 144443us
W20260709 13:08:22.899394 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.898066 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 72470.2us
W20260709 13:08:22.892697 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 54961.5us
W20260709 13:08:22.901495 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68855us
I20260709 13:08:22.906693 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.909505 12733 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
W20260709 13:08:22.914067 12696 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.825s (SENT)
I20260709 13:08:22.920591 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:22.924578 12847 leader_election.cc:336] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.660s (SENT)
I20260709 13:08:22.925295 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:22.919030 13487 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:22.941030 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.935806 17032 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:22.948550 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 139116us
I20260709 13:08:22.951048 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.939325 16983 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.943701 16914 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:22.967907 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:22.977749 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.987715 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:22.988585 12728 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:22.990566 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74793.9us
I20260709 13:08:22.984912 12628 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.995499 12628 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 5 to 3, term changed from 6 to 4, leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) added. New cstate: current_term: 4 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.005328 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:23.005788 12847 leader_election.cc:336] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.660s (SENT)
I20260709 13:08:23.006572 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.007814 12728 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:23.009626 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 100271us
I20260709 13:08:23.011500 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.010010 12847 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.012624 12728 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 6.
I20260709 13:08:23.013935 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.015064 16899 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.016377 16864 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.019629 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.020236 12803 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:23.003963 16982 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.050092 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:23.054078 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45213.5us
I20260709 13:08:23.055462 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.056470 16947 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.062826 16947 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.060775 12800 raft_consensus.cc:1813] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Handling vote request from an unknown peer 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:23.051322 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.064247 12728 raft_consensus.cc:2376] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12. Re-sending same reply.
I20260709 13:08:23.048377 16846 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.069445 16846 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:23.066651 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68699.9us
I20260709 13:08:23.072238 12800 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12.
I20260709 13:08:23.074507 12728 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:23.078383 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.080087 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.080680 12728 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:23.078002 16864 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:23.094372 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 155863us
I20260709 13:08:23.095628 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:23.098462 12728 raft_consensus.cc:2376] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10. Re-sending same reply.
W20260709 13:08:23.104162 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48804.6us
W20260709 13:08:23.102500 12847 leader_election.cc:336] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.673s (SENT)
I20260709 13:08:23.105526 12847 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:23.108304 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:23.110174 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.129315 12628 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.110427 16899 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:23.140741 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43530.4us
W20260709 13:08:23.141830 12847 leader_election.cc:336] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.697s (SENT)
I20260709 13:08:23.142385 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:23.143317 17032 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.144133 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.145080 12807 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:23.148186 16884 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.148723 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.150352 16982 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.151345 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.153091 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:23.159631 12728 raft_consensus.cc:2410] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:23.172947 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.174996 16846 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.175750 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.179937 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.181003 12800 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:23.191706 16983 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.171269 16864 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.195673 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.181740 16991 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.213339 16864 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:23.214188 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.214793 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.214855 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.214239 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.215679 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:23.220503 13521 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.216933 12726 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:23.222149 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.228585 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.229779 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.230898 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.231266 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.233563 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:23.234182 12724 raft_consensus.cc:2376] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13. Re-sending same reply.
I20260709 13:08:23.223325 16864 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.236717 16864 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.237084 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:23.237490 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:23.237834 12729 raft_consensus.cc:2376] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13. Re-sending same reply.
I20260709 13:08:23.238178 12732 raft_consensus.cc:2376] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12. Re-sending same reply.
I20260709 13:08:23.238682 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41076
I20260709 13:08:23.236579 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.240106 12731 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:23.242159 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.247610 16991 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.229856 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.249622 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.258498 12808 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:23.236472 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:23.259914 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 146384us
I20260709 13:08:23.274245 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.275555 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.276536 12728 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:23.273518 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.273887 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:23.281190 12725 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.280093 12807 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:23.254252 16947 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.284910 12802 raft_consensus.cc:2393] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:23.285538 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.289669 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:23.274303 16884 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:08:23.286252 17088 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.297392 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.298617 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.304526 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet cc76143509f64c4faa68973765829aec with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41706
W20260709 13:08:23.305924 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.313591 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.314265 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.315168 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.315608 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.316532 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:23.291831 17083 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:23.322764 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:23.318889 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.324949 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.323414 12728 raft_consensus.cc:2376] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12. Re-sending same reply.
W20260709 13:08:23.328119 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44674.8us
I20260709 13:08:23.329593 13521 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:23.334815 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.335994 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.337230 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:23.338795 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.341657 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 140108us
I20260709 13:08:23.356431 12879 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:23.356969 12879 pending_rounds.cc:85] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 6
I20260709 13:08:23.359274 12879 pending_rounds.cc:107] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:23.359432 12875 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:23.359597 12879 raft_consensus.cc:2889] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.357801 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:23.360666 12800 raft_consensus.cc:2468] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:23.361753 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.358992 12876 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.366117 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:08:23.366894 12847 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.784s (SENT)
I20260709 13:08:23.367316 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.371843 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.372772 12875 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:08:23.365453 16982 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:23.377449 16982 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:23.377485 16991 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.378561 16982 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.380141 16864 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.384317 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.384821 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.385205 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.376291 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.388923 12725 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:23.392170 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.390995 12731 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:23.396248 12847 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.814s (SENT)
I20260709 13:08:23.393347 17088 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:23.398859 17085 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.397311 17093 tablet_replica.cc:333] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:08:23.398929 17088 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:23.400177 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.398290 16864 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.403995 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.404760 12728 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:23.399928 17088 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.399581 17085 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.411175 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:23.415321 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.405405 16983 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.406652 16914 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:23.433151 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.434159 12879 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
W20260709 13:08:23.435243 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 76867.9us
I20260709 13:08:23.444167 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.446144 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.446954 12732 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:23.454078 12808 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.461133 17085 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.460985 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.465397 17090 tablet_replica.cc:333] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
W20260709 13:08:23.466074 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89948.7us
I20260709 13:08:23.461519 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:23.470718 12800 raft_consensus.cc:2393] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:08:23.479254 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:23.483039 12875 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.485213 12875 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.485970 12879 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:23.488090 12881 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.483297 12876 raft_consensus.cc:1240] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:23.496222 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 100047us
I20260709 13:08:23.487067 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.497429 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:23.497766 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.500594 12847 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.839s (SENT)
I20260709 13:08:23.501160 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.502327 16864 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.502998 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:23.502178 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:23.505478 16914 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.498162 12728 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:08:23.512769 12847 leader_election.cc:336] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Timed out: RequestConsensusVote RPC to 127.11.78.1:36161 timed out after 1.898s (SENT)
I20260709 13:08:23.514021 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.516700 12881 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.519404 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.512622 16947 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.520803 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:23.520835 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.513168 16846 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.522962 13521 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:23.523003 12881 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:23.517282 16914 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.531244 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.528813 13487 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:23.545846 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58896us
I20260709 13:08:23.548243 16983 raft_consensus.cc:2804] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:23.548862 16983 raft_consensus.cc:697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:23.549842 16983 consensus_queue.cc:237] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.538916 16846 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.556507 16982 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:23.557102 16982 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:23.559333 12771 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.607s (SENT)
I20260709 13:08:23.525985 16947 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.546986 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.560130 17090 raft_consensus.cc:2243] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.572227 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.559552 17088 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.574461 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.580300 16947 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:23.581096 17095 log.cc:927] Time spent T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:23.576264 12876 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:23.580323 17090 raft_consensus.cc:2272] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:23.585964 17096 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:23.593380 12879 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:23.607668 12876 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.610528 12873 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:23.613055 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.613801 12877 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
W20260709 13:08:23.615782 17097 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.096s	user 0.001s	sys 0.004s
W20260709 13:08:23.620381 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61099.5us
I20260709 13:08:23.621193 17100 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.610004 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.625828 16982 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.627213 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:23.628064 12880 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.628340 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:23.629724 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.630870 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:23.634961 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.636349 12878 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:23.640007 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:23.641736 12882 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:23.643461 12771 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.704s (SENT)
I20260709 13:08:23.643399 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:23.645596 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.646420 12876 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.643894 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.647331 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.649025 16846 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.649315 17088 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.649242 17084 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.634949 17100 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.658555 12878 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:23.655566 12880 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:23.647881 12879 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:23.662061 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:23.662603 17090 ts_tablet_manager.cc:1916] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.662047 16991 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:08:23.664268 16914 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.664067 16982 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:23.676278 17102 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:08:23.677757 16864 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.681121 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:23.680409 17087 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:23.682699 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.691696 12726 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.693635 17084 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:23.710251 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.710768 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.711375 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.711558 12877 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:23.681833 13521 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:23.713426 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:23.712173 12879 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
W20260709 13:08:23.725754 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61917.9us
W20260709 13:08:23.731338 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.731925 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.722170 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:23.737807 12878 raft_consensus.cc:606] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.738188 12878 raft_consensus.cc:614] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:23.738819 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.740391 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:23.741842 12805 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:23.742538 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 175481us
I20260709 13:08:23.745206 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:23.746096 16914 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:23.746201 16864 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.748273 16864 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:23.748733 16864 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.747718 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.752820 17105 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.754563 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:23.755620 17105 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.756057 17105 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:23.756433 17105 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.763515 16864 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.764971 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.768369 17100 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.768388 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:23.765841 16864 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:23.773193 16914 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.773664 16914 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.774044 16914 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.769227 17093 raft_consensus.cc:2243] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.781988 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.783025 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.770030 17105 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.771907 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.796449 12876 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
W20260709 13:08:23.804804 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 259717us
I20260709 13:08:23.804369 16864 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.809470 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:23.807618 16846 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.811124 16899 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.814365 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.816689 17093 raft_consensus.cc:2272] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.816941 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.817801 17101 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.820693 17100 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.823590 16899 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.827906 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.828501 17093 ts_tablet_manager.cc:1916] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.831149 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:23.812173 16864 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:23.834363 16864 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.838601 17101 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:23.838743 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.839481 17101 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:23.840950 17105 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.841840 16899 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.842451 16899 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:23.844148 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.838617 12848 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
W20260709 13:08:23.839159 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57301.2us
I20260709 13:08:23.845374 12848 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.843780 16899 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.849328 16991 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.850117 16991 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:23.837779 17100 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:23.854418 12727 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.836442 17090 ts_tablet_manager.cc:1929] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 13:08:23.856015 17090 log.cc:1199] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/21f97de57a4f4bf7a4ac5fde6b3bc613
I20260709 13:08:23.858593 17084 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.859488 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.859815 16983 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.860479 16983 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:23.862044 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:23.863202 16846 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.863965 16846 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.859500 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:08:23.866304 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.861505 16983 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.869211 16983 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.840771 17101 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.863807 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:23.900842 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.900725 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 128911us
I20260709 13:08:23.851384 16991 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.837168 16914 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.904915 17031 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:23.911469 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 47820.9us
I20260709 13:08:23.912544 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:23.917272 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 76668.7us
I20260709 13:08:23.919046 12847 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.919098 17114 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:23.915587 16846 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.924690 17087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52660 (request call id 1) took 1325 ms. Trace:
I20260709 13:08:23.927881 17118 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.930938 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.932528 16846 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:23.934927 16864 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.937556 16864 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:23.937558 16914 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:23.926708 17087 rpcz_store.cc:276] 0709 13:08:22.602416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.602712 (+   296us) service_pool.cc:224] Handling call
0709 13:08:22.758275 (+155563us) log.cc:844] Serialized 487 byte log entry
0709 13:08:23.069659 (+311384us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b18001444c0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:23.076114 (+  6455us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18001444c0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:23.916344 (+840230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2279,"raft.queue_time_us":35916,"raft.run_cpu_time_us":1051,"raft.run_wall_time_us":32565,"spinlock_wait_cycles":19319808,"thread_start_us":142167,"threads_started":1,"wal-append.queue_time_us":198656}
I20260709 13:08:23.948889 12808 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:23.950048 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a839b697aea46da87cb69b00515389e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.951016 17084 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.951452 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:23.951469 17084 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:23.952445 16914 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.952684 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.953066 16914 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:23.953192 17084 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:23.953846 16914 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.953792 12699 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12.
I20260709 13:08:23.954654 12699 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.954743 17084 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:23.955288 12699 raft_consensus.cc:2686] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:23.956936 17085 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:23.963096 16899 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:23.966279 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:23.940239 17114 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:23.983717 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.988693 17118 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:23.994282 17118 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:23.987766 17031 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:23.995656 17118 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:23.997567 17031 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.998003 17031 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:24.001266 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 176623us
I20260709 13:08:23.999239 17031 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.005439 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.005659 17031 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.006692 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.009155 16899 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.009816 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:24.021040 12847 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.022840 16991 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.025555 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.025094 16899 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.032058 16914 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.038013 16991 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.038980 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.038295 16899 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.042503 12848 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.047890 16991 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.048916 12847 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.034360 16914 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:24.066668 16991 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:24.121714 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 72937.4us
I20260709 13:08:24.124928 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.127702 16899 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.126081 17116 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.129747 17116 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:24.130862 17116 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:24.132275 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89871.4us
I20260709 13:08:24.128378 16914 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.125231 16991 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.133410 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.136943 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.138849 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.139467 16914 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.131862 17093 ts_tablet_manager.cc:1929] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:08:24.140591 17093 log.cc:1199] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/cc76143509f64c4faa68973765829aec
I20260709 13:08:24.140599 16914 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.149547 16914 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.150035 16914 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.150372 16914 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.152643 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:24.245616 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.268059 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 129280us
I20260709 13:08:24.269477 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:24.210893 16899 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:24.284945 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.335090 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 182538us
I20260709 13:08:24.335997 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.349045 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.282644 16899 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:24.359009 16914 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.353578 16899 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.361583 16914 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:24.365022 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81745.6us
I20260709 13:08:24.365919 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:24.368278 17123 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.379307 17093 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41706 (request call id 0) took 1077 ms. Trace:
I20260709 13:08:24.379550 16914 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.386829 16991 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:24.386837 17093 rpcz_store.cc:276] 0709 13:08:23.301871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.304219 (+  2348us) service_pool.cc:224] Handling call
0709 13:08:23.396869 (+ 92650us) ts_tablet_manager.cc:1151] Deleting tablet cc76143509f64c4faa68973765829aec
0709 13:08:23.396976 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:23.947994 (+551018us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:24.131684 (+183690us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:24.378511 (+246827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346737,"tablet-delete.queue_time_us":91598,"thread_start_us":49559,"threads_started":1}
I20260709 13:08:24.395212 17123 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.400313 17125 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:24.404670 17125 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:24.408109 17125 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:24.393064 17126 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.412647 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:24.413945 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.414338 12882 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:24.420020 12807 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:24.423535 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74611.7us
I20260709 13:08:24.425024 17125 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:24.425956 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 518754us
I20260709 13:08:24.439435 16899 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.436618 12808 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:24.445482 12808 pending_rounds.cc:85] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:24.446633 12808 pending_rounds.cc:107] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:24.447467 12808 raft_consensus.cc:2889] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:24.465268 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.466578 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:24.467373 12805 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.467653 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.447228 17130 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:24.470659 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.467929 17128 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.472340 17101 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.473073 17101 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:24.474273 12807 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:24.474748 12807 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:24.475154 17125 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.475522 12807 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.477035 12807 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.477700 17124 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:24.478255 17124 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:24.490883 12805 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:24.491447 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:24.495018 17129 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:24.495397 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:24.496338 17086 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:24.496567 17129 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.492997 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.501636 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:24.493719 17116 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:24.508513 16899 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:24.488758 17124 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:24.506830 17077 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.533653 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:24.535281 12845 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:24.539007 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 68451.5us
I20260709 13:08:24.540351 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.500263 17129 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:24.552839 17031 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.553624 17031 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.554205 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:24.564391 17101 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.566915 17101 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.568382 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.569396 12807 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:24.570286 12807 pending_rounds.cc:85] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:24.568056 17101 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.516479 17131 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:24.570941 12807 pending_rounds.cc:107] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:24.536363 17077 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.575289 12807 raft_consensus.cc:2889] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:24.540700 17124 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.577973 17077 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.576438 17031 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.577589 17131 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:24.601965 17031 raft_consensus.cc:2764] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:24.604835 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:24.620736 12876 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.621198 12876 raft_consensus.cc:614] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:24.615852 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 656316us
I20260709 13:08:24.617471 17101 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.624573 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:24.660801 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 120606us
W20260709 13:08:24.668838 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 100578us
W20260709 13:08:24.671247 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.566864 17129 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:24.675802 12727 raft_consensus.cc:1275] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:24.678172 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:24.684198 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.658888 17128 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:24.677548 17130 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.675380 17101 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.676367 17133 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:24.661947 17100 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:24.677114 17126 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:08:24.702997 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:24.703684 12876 raft_consensus.cc:606] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:24.690513 17130 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:24.705386 17130 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.694548 17139 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:24.698474 17133 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.711547 17133 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.694859 17101 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.713524 17101 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.714025 17101 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.714463 17101 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.693290 17129 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.717984 17133 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.697880 17087 consensus_queue.cc:1048] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:24.730525 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.735970 17141 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.735918 17077 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:24.745002 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.745214 17130 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.745829 12724 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.746268 17101 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.747927 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.748386 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.748906 12730 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:24.749186 12729 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:24.750025 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.750600 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.751387 12725 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:24.743067 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.756541 12726 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.747793 17130 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:24.770809 12727 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:24.688629 17128 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.756418 17131 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.747931 17077 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.783464 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.784752 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.785313 12725 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:24.787228 12729 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.796911 12726 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:08:24.797775 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 127634us
I20260709 13:08:24.738986 17139 consensus_queue.cc:1243] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:24.786806 17145 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:24.809345 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.813090 17145 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.744895 17141 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.818261 17141 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.824108 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.824533 12725 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:24.825112 12733 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.826953 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.807040 17139 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:24.830041 17128 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:24.815709 17145 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:24.833772 12724 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:24.838452 12729 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:24.843240 12730 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:24.851857 17144 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.854475 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.857254 12733 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:24.860472 17144 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.864056 17138 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.864737 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:24.885080 12802 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:24.876243 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45779.7us
W20260709 13:08:24.886837 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.887751 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.888266 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.878960 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 92772.3us
I20260709 13:08:24.891180 17136 consensus_queue.cc:1059] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:24.892686 12802 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:24.894191 17138 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.896931 17138 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.897743 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.898767 12728 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:24.899261 17138 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:24.894655 12696 connection.cc:256] RPC call timeout handler was delayed by -1.3004875089999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:08:24.900594 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:24.906673 17138 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:24.902844 12771 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:24.908272 12771 raft_consensus.cc:2686] T cc76143509f64c4faa68973765829aec P 83d2731c4bc049b3929d6c39670f5fd8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:24.908517 17138 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:24.909093 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:24.912007 12733 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:24.912256 12731 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:24.913537 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.914960 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.917847 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.920212 12728 raft_consensus.cc:1240] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:24.936194 17157 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.936968 17157 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.937446 17157 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.940542 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.941601 12728 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:24.947377 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.948312 12733 raft_consensus.cc:1813] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:24.948974 12733 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:24.948997 12725 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:24.952495 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.953433 12731 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:24.956421 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.962200 12726 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:24.970700 16991 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:24.973795 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.973615 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.975589 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:24.976284 12724 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.977000 12726 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:24.978281 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.978941 12725 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:24.980459 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.981173 12731 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:24.983261 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.983765 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:24.983407 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90249.9us
I20260709 13:08:24.984313 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.992995 12724 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:24.993597 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:24.994397 12731 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 6.
I20260709 13:08:24.994822 16899 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:24.996021 16899 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:24.992851 17138 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.000475 17138 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.002701 17138 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:25.006613 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57770.3us
I20260709 13:08:25.009444 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.009861 16899 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.011157 17157 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.018668 12771 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.028434 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.029917 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.030746 12724 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:25.030583 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.035910 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.049046 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.036736 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.036988 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.038159 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.050094 12731 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:25.038291 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:25.051046 12729 raft_consensus.cc:1813] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.051546 12729 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:25.040448 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.041193 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.052472 12882 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.042227 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.053511 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.053928 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.054596 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.042963 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.047294 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.054903 12877 raft_consensus.cc:2410] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:25.044245 17159 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.064318 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:25.048575 16899 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.070459 17157 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.071337 12731 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:25.071801 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.086726 12880 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:25.072458 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.073339 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.074682 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.088102 12724 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:25.076130 12881 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.077253 17160 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.096341 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.092552 16899 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.100936 16899 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.113446 17155 raft_consensus.cc:3055] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:25.114045 17155 raft_consensus.cc:740] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:25.114892 17155 consensus_queue.cc:260] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.115614 12874 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.116528 17155 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.117501 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.118450 12880 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:25.119307 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.119891 12880 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:25.120810 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.121156 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.121601 12880 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:08:25.122071 12881 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.089344 17159 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:25.088922 12882 raft_consensus.cc:2468] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:25.123360 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.123792 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.124513 12882 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:25.124586 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.125252 12880 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 6.
I20260709 13:08:25.125417 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.126114 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.090159 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.126803 12882 raft_consensus.cc:2410] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:25.128921 12880 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:25.122830 17159 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:25.090402 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 103712us
I20260709 13:08:25.137640 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:25.121896 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 67387.8us
I20260709 13:08:25.090255 17163 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.083817 12733 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:25.134790 12878 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:25.131501 12882 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [7.9-11.11]
I20260709 13:08:25.147508 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.148460 12880 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:25.143482 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.151482 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.190537 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.192808 17100 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.193230 17157 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:25.193463 17100 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.197126 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:25.198594 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:25.150139 17031 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:25.201973 17031 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.217265 12874 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:25.148512 17163 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.226395 17139 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:25.294572 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 65256.2us
I20260709 13:08:25.226270 16899 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:25.235759 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92343.3us
I20260709 13:08:25.240589 13513 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
W20260709 13:08:25.254282 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.284252 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 88788us
I20260709 13:08:25.202416 17031 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.321094 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.228731 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:25.302138 17163 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.321816 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.331569 13518 raft_consensus.cc:1240] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:08:25.336933 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.364326 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:25.324761 17031 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.324906 17139 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:25.416287 17139 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.424739 17146 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:25.425572 17146 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:25.426846 17146 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.338656 16899 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:25.428689 16899 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:25.429397 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92543.2us
W20260709 13:08:25.430941 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 109279us
I20260709 13:08:25.432091 12771 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.370353 17166 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:25.450027 17114 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:25.451457 17162 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.452632 17162 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.453122 17162 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.413781 16991 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:25.456576 16991 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.457130 16991 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.459064 17136 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.459944 17136 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.460376 17136 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:25.460479 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 133674us
I20260709 13:08:25.485127 17155 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:25.495108 17031 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.429391 16899 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.535274 17167 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:25.551671 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86011us
I20260709 13:08:25.556090 17173 raft_consensus.cc:993] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:25.588352 17167 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.597216 17167 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.590255 17157 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:25.602428 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 171043us
I20260709 13:08:25.616169 13514 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:25.556720 17123 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.635632 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.635432 17172 raft_consensus.cc:1081] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
W20260709 13:08:25.655066 12881 consensus_meta.cc:287] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.000s
I20260709 13:08:25.663770 12881 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:25.665323 17145 consensus_queue.cc:1059] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:25.665617 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 245241us
I20260709 13:08:25.647239 17146 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.666575 12696 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:25.667554 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 216790us
I20260709 13:08:25.641131 17123 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.668607 17146 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.669763 17123 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.670369 17123 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:25.670809 17123 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:25.671665 17123 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.674470 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.675453 17174 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.676147 17174 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:25.676731 17174 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.681339 17146 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.679726 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:25.693492 17114 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.687970 17174 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.699828 17163 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:25.667484 17159 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.004s
I20260709 13:08:25.708622 17136 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.715883 17031 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:25.718686 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.666405 17145 raft_consensus.cc:3055] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:25.743968 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 153262us
W20260709 13:08:25.745304 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 78831.2us
I20260709 13:08:25.767388 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:25.744742 17101 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.746781 17170 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.739219 17114 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.735509 17172 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.777976 17114 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.777654 17172 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.766552 17159 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.780175 17170 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.780383 17178 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:25.781683 17159 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.782460 17159 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:25.782732 17170 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:25.783317 17146 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.745848 17155 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.643342 17173 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:08:25.784197 17155 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.785475 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:25.785494 17172 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.755144 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.787554 17172 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:25.788524 17172 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:25.766410 17145 raft_consensus.cc:740] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:25.789717 17100 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:25.763172 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 127620us
I20260709 13:08:25.790586 17145 consensus_queue.cc:260] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.665323 17177 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:08:25.791790 12847 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.786458 17155 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.783661 17178 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:25.792515 17145 raft_consensus.cc:3060] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.786207 13514 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:25.793286 17173 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:25.793906 17173 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:25.794900 17173 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.789304 16884 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.799830 17146 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:25.801168 17146 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:25.802958 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac200 after lost signal to thread 11579
I20260709 13:08:25.806454 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:25.753096 17174 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.810065 12881 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.795938 17163 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.811292 17136 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.811411 12877 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:25.809983 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.814604 16884 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.824918 16884 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.809983 17172 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.826371 12877 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:25.826572 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:25.827629 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.828366 12874 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:25.829092 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.830607 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.832317 16991 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.834523 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.834914 16991 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.835234 12878 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.836822 12873 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.840161 12874 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:25.841539 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.845736 12874 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:25.848950 12874 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.854681 12878 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:25.764314 17162 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.858562 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.771873 17176 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.863644 17176 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.864538 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.856012 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.875924 12878 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.873420 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.880837 12875 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.880955 12874 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.885277 13521 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:25.887733 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.887565 12845 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.890631 13484 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:25.897221 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.898651 17100 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.899506 17100 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:25.900462 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 121076us
I20260709 13:08:25.910898 12878 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:25.913460 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.914522 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.914822 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.915349 12878 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:25.908291 16884 raft_consensus.cc:2804] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.916409 17173 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.916894 17170 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.856902 17181 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:25.918540 12696 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.897866 17162 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:25.917191 17173 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:25.924124 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.866665 17176 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:25.909493 17114 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:25.928133 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.910739 17177 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:25.916478 17168 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.920328 17181 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:25.933295 12878 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 7.
I20260709 13:08:25.944922 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:25.946585 16884 raft_consensus.cc:697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:25.948002 16884 consensus_queue.cc:237] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.951756 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.952708 12878 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:25.953862 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.954216 12874 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:25.930966 17170 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.960605 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.960806 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.961254 12878 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:25.961315 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.961644 12874 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:08:25.956851 17162 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.916519 17183 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:25.962934 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:25.933827 17114 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:25.965126 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.968118 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:25.945559 17181 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.968662 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.970450 12880 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.976748 17189 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:25.977381 17189 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.977746 17189 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.977663 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:25.979727 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08001de580 after lost signal to thread 12665
I20260709 13:08:25.964570 17168 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:25.981223 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd880 after lost signal to thread 12757
W20260709 13:08:25.981549 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8800 after lost signal to thread 12758
W20260709 13:08:25.982936 12829 debug-util.cc:398] Leaking SignalData structure 0x7b0800268600 after lost signal to thread 12832
W20260709 13:08:25.983290 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe780 after lost signal to thread 12833
I20260709 13:08:25.976622 17156 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:25.966235 17139 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.995064 17184 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:25.996850 17139 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:25.997298 17139 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:25.998275 17139 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:25.999186 17184 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:25.999720 17139 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.999869 17184 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.001055 17173 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.001652 17173 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.002112 17173 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:25.994524 12874 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:25.995378 17186 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:08:26.006297 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 52084.9us
I20260709 13:08:26.017477 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.006856 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:25.942912 17177 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.018872 12874 raft_consensus.cc:2393] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:26.024538 17170 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.010195 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:25.990425 17174 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.034826 12874 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:25.991084 17168 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.043846 12880 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:26.045761 12880 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:26.046705 17162 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:26.052054 17162 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:26.046861 17169 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:08:26.053182 17162 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.045431 17124 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:26.054813 17133 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.055258 17133 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:26.056054 17133 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.057000 17133 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.054491 17124 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.061553 17181 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.042948 17168 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.015574 17184 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:25.990711 16899 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:26.070385 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.064384 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.083355 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:26.084283 13520 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:26.086429 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.092401 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.093742 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.094518 12730 raft_consensus.cc:2393] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:26.093027 12881 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:26.098111 17145 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.094238 17183 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:26.099756 17183 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.102325 17183 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.102867 17183 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.103313 17183 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.103590 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:26.104076 12845 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.104522 13512 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:26.085088 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.093143 12732 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:26.068790 17173 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.111596 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.116220 12726 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:26.081653 17123 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:26.122149 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.088862 17184 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.118384 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.107216 12727 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
W20260709 13:08:26.080338 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63006.1us
I20260709 13:08:26.122207 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:26.109465 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:26.122959 12732 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:26.137883 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.113920 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:26.141609 12724 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.142040 12724 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.142171 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.118033 16991 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.147738 17100 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.150664 17100 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.151057 17100 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.098730 17145 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:26.158385 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.139678 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:26.169095 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.173262 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.174357 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.175206 17198 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.175635 17198 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.176050 17198 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.185135 17184 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:26.186354 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46772.2us
I20260709 13:08:26.187413 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.175657 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.190752 17199 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.151937 17143 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.144587 16899 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.143193 17174 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.146550 16991 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.149322 17173 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.156076 17192 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.089367 17114 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.217691 13512 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:26.181137 17170 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:26.219981 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.140645 17123 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.222288 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:26.201464 17143 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:26.191489 17199 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.209373 17138 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.219385 12724 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:26.228297 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 52774.9us
I20260709 13:08:26.216199 17173 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.209652 16991 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:26.238718 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65538.2us
I20260709 13:08:26.240767 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.223083 16899 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:26.220635 17170 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.246034 12724 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.247669 17151 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.224607 17192 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.248468 17154 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:26.248798 17143 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.256428 17181 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.247534 17196 raft_consensus.cc:2764] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:26.262286 17177 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.263716 17206 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:26.305116 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.304903 17206 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.306931 17199 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.307331 17206 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.265801 17101 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:26.308146 17101 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.262336 17100 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.269662 17123 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.270530 17183 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.271843 17145 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.270499 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.276571 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:26.326854 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56427.8us
I20260709 13:08:26.276171 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:26.242941 17173 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.239534 17138 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.288224 17146 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:26.284756 17170 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.304209 17177 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.277217 16899 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.309340 17198 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.288592 17151 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.328593 13512 raft_consensus.cc:2393] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:26.333505 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:26.437863 12879 raft_consensus.cc:2393] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:26.332854 17141 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:26.420586 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 225371us
I20260709 13:08:26.439087 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:26.292512 17189 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.313371 17143 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:26.427426 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 98983.7us
I20260709 13:08:26.342293 17146 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.333156 17138 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:26.431846 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.442647 12696 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.444672 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:26.434899 16899 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.440182 17141 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.456746 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:26.457505 13521 raft_consensus.cc:2368] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16.
I20260709 13:08:26.440637 17151 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.452361 12696 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:26.445947 17146 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.446333 17177 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.487535 12807 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:26.488734 12802 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:26.450165 17101 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.522746 17101 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:26.523656 17101 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:26.525717 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.526659 12808 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:26.449757 17171 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:26.529449 17171 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.457237 17141 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.446973 17154 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:26.525113 17101 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.435276 17206 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:26.527004 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.528729 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.529488 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.501111 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:26.533075 12829 debug-util.cc:398] Leaking SignalData structure 0x7b0800330240 after lost signal to thread 12906
I20260709 13:08:26.533288 12802 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:26.499411 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.441957 16991 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:26.533641 12829 debug-util.cc:398] Leaking SignalData structure 0x7b0800371fe0 after lost signal to thread 12907
I20260709 13:08:26.537060 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.541183 12806 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:26.546496 17212 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:26.548229 17207 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:26.553378 12803 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:26.554795 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:26.555049 17210 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:08:26.536566 17171 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.561538 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.562592 12808 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
W20260709 13:08:26.564499 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 102139us
I20260709 13:08:26.544524 17100 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.549180 17192 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.573179 17189 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.574059 17124 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.580475 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:26.552368 17212 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:26.588886 12879 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.591805 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.635624 12808 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:08:26.641419 17141 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:26.643049 12829 debug-util.cc:398] Leaking SignalData structure 0x7b080036bd40 after lost signal to thread 13545
W20260709 13:08:26.643481 12829 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae320 after lost signal to thread 13546
W20260709 13:08:26.644526 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.644901 17141 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:26.645987 17216 log.cc:927] Time spent T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
I20260709 13:08:26.566210 17206 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:26.657091 17206 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.658526 16991 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.659101 17206 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.659365 17198 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.645605 17212 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.656481 17177 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.587874 17144 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.670461 12808 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:26.677661 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.671774 12879 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
I20260709 13:08:26.679920 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:26.680620 12803 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.681442 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.691771 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.692723 12805 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:26.693532 16899 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.702072 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.702924 12802 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:26.706293 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.729490 12803 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:26.731922 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.732196 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.736860 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.745487 12805 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.753419 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.757292 12799 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.681473 17170 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.760468 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.758026 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:26.769990 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 317709us
I20260709 13:08:26.770933 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.683045 17144 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:26.776901 12800 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:26.718876 17173 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.781985 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.783785 12804 raft_consensus.cc:1240] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.784689 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.782948 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.760455 16899 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.725229 17138 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:26.783309 17168 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.004s
W20260709 13:08:26.792663 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55893.4us
I20260709 13:08:26.795719 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:26.797946 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.752471 17133 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:26.775668 17206 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.777504 17221 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.826555 17100 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:26.828648 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.832826 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:26.847743 17177 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:26.784878 17145 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.866321 17206 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.861766 17177 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.879712 17138 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.854646 17100 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:26.881847 17100 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.883536 17100 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.894448 17144 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:26.896409 17170 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:26.857415 17221 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:27.009150 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.901918 17153 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.903431 17219 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:26.903195 17162 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:26.905148 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:26.906581 17173 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:26.914561 12881 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:26.822781 17168 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:26.932952 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:26.934082 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:26.937862 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.024914 12807 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:27.026077 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 121020us
I20260709 13:08:27.026988 12771 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:26.938851 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.027895 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.944512 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.029950 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.029657 12630 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 12 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.947687 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.030947 12799 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 13: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:27.031423 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 83839.5us
I20260709 13:08:27.031980 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:26.955178 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.032965 12724 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:27.033578 17189 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:26.875626 17177 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:27.008422 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:25.804602 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet cc76143509f64c4faa68973765829aec (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:27.034384 12729 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:27.034476 12618 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 1.23014e+06us
I20260709 13:08:27.012172 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.030658 12732 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.953333 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.024410 12728 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:27.036211 12726 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.017233 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.028538 12800 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:27.009716 17171 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.033746 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:27.054580 17218 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:27.056407 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.013813 17221 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.070463 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.086490 12732 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:27.081092 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.058145 12724 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:27.071192 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.073969 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:27.025400 17174 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.105262 12804 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.084323 12806 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.108371 12804 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.108949 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.109344 12879 raft_consensus.cc:606] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.109828 12879 raft_consensus.cc:614] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:27.108310 12730 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:27.108795 12806 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.110903 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.087833 12726 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:27.113020 12728 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:08:27.072326 12771 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.080504 12733 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:27.116469 12729 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:27.025213 17153 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.111999 12806 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.4, Last appended by leader: 4, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.123580 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.064163 17184 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.122644 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.130002 12729 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.126981 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.128173 12806 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.085848 17189 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:27.134465 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.117127 12804 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.138367 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.148784 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.118675 17177 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:27.070990 17160 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:08:27.163691 12730 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:27.071383 17178 consensus_queue.cc:1059] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:27.167034 12732 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:27.167704 12804 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.168871 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.124821 17174 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.150481 17176 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:27.175578 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.178614 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.179399 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.179915 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.185506 17153 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:27.187026 17146 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.001s
I20260709 13:08:27.187505 17146 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.189879 17146 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:27.164798 17198 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:27.192284 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.192651 17198 consensus_queue.cc:1243] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:27.171821 17173 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.191710 17221 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.200344 17221 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:27.201045 17168 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:27.204834 17171 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:27.210625 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2269) took 1372 ms. Trace:
I20260709 13:08:27.212088 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.211120 12882 rpcz_store.cc:276] 0709 13:08:25.837866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.838012 (+   146us) service_pool.cc:224] Handling call
0709 13:08:25.838364 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:25.861895 (+ 23531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.861940 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.576705 (+714765us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:26.577304 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.685697 (+108393us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:26.685735 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.685800 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.210298 (+524498us) raft_consensus.cc:1685] finished
0709 13:08:27.210321 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.210559 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40399,"raft.queue_time_us":18710,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":25237,"spinlock_wait_cycles":12274432,"thread_start_us":107987,"threads_started":1,"wal-append.queue_time_us":197643}
I20260709 13:08:27.134210 17184 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.215608 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.136484 16991 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:08:27.215102 12630 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 5, term changed from 4 to 6, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 6 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:27.249532 12730 raft_consensus.cc:1275] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260709 13:08:27.166517 17232 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:08:27.232023 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.241067 12725 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.257172 12847 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:27.247653 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.132508 17116 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:27.191586 17151 consensus_meta.cc:287] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.000s
I20260709 13:08:27.254475 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.285374 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.216866 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.250888 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.286401 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:27.284345 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 212203us
I20260709 13:08:27.222803 12729 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:08:27.292323 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.968s (SENT) [suppressed 40 similar messages]
I20260709 13:08:27.297111 12806 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:08:27.327252 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.288663 12730 pending_rounds.cc:85] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 9
I20260709 13:08:27.328117 12730 pending_rounds.cc:107] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:08:27.328433 12730 raft_consensus.cc:2889] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.330585 12801 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:27.213884 17124 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.328766 12730 pending_rounds.cc:107] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:27.334133 12730 raft_consensus.cc:2889] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.213227 17174 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:27.330842 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44585us
I20260709 13:08:27.331977 12630 catalog_manager.cc:5697] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 11, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 11 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.334028 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:27.339139 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.229494 17184 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.340709 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:27.347178 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.322456 17198 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.352250 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.353859 12806 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:27.342535 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.334653 16991 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.341106 12771 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.351109 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.331223 17173 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.238970 17176 consensus_queue.cc:1059] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:08:27.364439 17124 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.371138 17086 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:27.364766 17173 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:27.373255 17173 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.375115 17173 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.376279 17162 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:27.376974 17162 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.378086 17162 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.371706 17124 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.383502 17124 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:27.365276 12799 raft_consensus.cc:2376] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11. Re-sending same reply.
I20260709 13:08:27.369611 17116 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:08:27.394192 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.334970 17151 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:27.345402 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.356791 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.346683 17172 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:08:27.364679 16899 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:27.366581 12771 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.356675 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.423352 12808 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.367112 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:27.350204 17153 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:27.420487 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63759.9us
I20260709 13:08:27.339952 17174 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.349999 17154 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:08:27.289364 17189 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:27.430559 17229 consensus_queue.cc:1048] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:27.425343 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58892.3us
I20260709 13:08:27.404415 17124 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.436141 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.432801 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.437374 12803 raft_consensus.cc:2368] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:27.452514 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.454074 12847 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.424831 17116 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:27.439467 12696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.024s	sys 0.014s
W20260709 13:08:27.462072 12696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.024s	sys 0.014s
I20260709 13:08:27.424892 16899 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:27.457154 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.477962 12807 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:27.455408 16914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.033s
I20260709 13:08:27.437955 17124 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:27.494676 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 202388us
W20260709 13:08:27.498867 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.499048 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.439539 17230 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.502665 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 731787us
W20260709 13:08:27.499419 16914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.018s	sys 0.033s
I20260709 13:08:27.504740 12696 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.473390 17153 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.480717 16899 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.509071 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:27.510970 12628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 163) took 33199 ms (client timeout 15000 ms). Trace:
I20260709 13:08:27.504921 16914 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:27.513675 12808 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:27.493988 17178 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:27.520187 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:27.540458 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.557276 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.570706 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 404645us
I20260709 13:08:27.573359 17116 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:27.578171 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 94442.3us
W20260709 13:08:27.579191 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 122152us
I20260709 13:08:27.518113 17146 raft_consensus.cc:2764] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:27.517336 17154 raft_consensus.cc:2764] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:27.623036 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.517064 16914 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.635519 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.545913 17178 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.608523 17160 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:27.605916 17162 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.508108 17230 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:27.650367 12799 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:27.619063 17177 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.543562 17101 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:08:27.626017 16884 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.668411 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 214457us
I20260709 13:08:27.636320 17172 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:27.637887 16914 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:27.654376 17228 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:08:27.700258 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:27.513374 12628 rpcz_store.cc:269] 0709 13:07:54.304803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.342610 (+ 37807us) service_pool.cc:224] Handling call
0709 13:08:27.504180 (+33161570us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.409698 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:23.467690 (+ 57992us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:23.467754 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:08:23.467781 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:23.525001 (+ 57220us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:23.539239 (+ 14238us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:23.540634 (+  1395us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:23.590858 (+ 50224us) tablet.cc:701] Row locks acquired
0709 13:08:23.590940 (+    82us) write_op.cc:260] PREPARE: finished
0709 13:08:23.591192 (+   252us) write_op.cc:270] Start()
0709 13:08:23.591424 (+   232us) write_op.cc:276] Timestamp: P: 1783602503591101 usec, L: 0
0709 13:08:23.591477 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:08:23.592435 (+   958us) log.cc:844] Serialized 3643 byte log entry
0709 13:08:23.897723 (+305288us) op_driver.cc:464] REPLICATION: finished
0709 13:08:24.003301 (+105578us) write_op.cc:301] APPLY: starting
0709 13:08:24.003416 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.131135 (+127719us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.131290 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:24.139121 (+  7831us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.139482 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:08:24.139535 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:24.139995 (+   460us) log.cc:844] Serialized 88 byte log entry
0709 13:08:24.143474 (+  3479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.147870 (+  4396us) write_op.cc:454] Released schema lock
0709 13:08:24.147971 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.148583 (+   612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.148620 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1438551,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":98812,"apply.run_cpu_time_us":20494,"apply.run_wall_time_us":145195,"cfile_cache_hit":34,"cfile_cache_hit_bytes":35564,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":38777,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":9,"prepare.queue_time_us":123776,"prepare.run_cpu_time_us":31329,"prepare.run_wall_time_us":247605,"raft.queue_time_us":135654,"raft.run_cpu_time_us":18861,"raft.run_wall_time_us":75415,"replication_time_us":305695,"thread_start_us":209639,"threads_started":4,"wal-append.queue_time_us":65389,"wal-append.run_cpu_time_us":35307,"wal-append.run_wall_time_us":1482225}]]}
I20260709 13:08:27.707480 12799 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:27.707630 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 88709.4us
I20260709 13:08:27.668375 17168 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.653333 17235 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:27.651518 17234 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:27.733316 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.664301 17146 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.693337 17177 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.751695 17168 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:27.761487 17168 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.724476 17221 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.729487 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:27.757357 17212 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.727200 12799 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:27.757018 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56879.5us
W20260709 13:08:27.752193 12615 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet cc76143509f64c4faa68973765829aec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 5
I20260709 13:08:27.761178 17146 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:27.786022 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56669.4us
I20260709 13:08:27.620810 17124 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.729048 17259 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:27.750324 12804 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
I20260709 13:08:27.693117 17162 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:27.790652 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 246282us
I20260709 13:08:27.762868 17177 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.656247 17153 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.792503 12804 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:27.736696 13521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.032s
I20260709 13:08:27.795715 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:27.796840 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:27.797209 13517 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:27.691665 17116 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.814374 17124 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.785817 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.802299 12799 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:27.815956 17100 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.000s
W20260709 13:08:27.805563 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 170111us
W20260709 13:08:27.805963 13521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.017s	sys 0.032s
I20260709 13:08:27.764194 17235 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:27.724236 16884 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:27.798203 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 278113us
W20260709 13:08:27.829586 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 218473us
I20260709 13:08:27.834062 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:27.844223 12699 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:27.847361 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:27.772769 17178 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.802798 17254 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.773008 17221 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.840052 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:27.849828 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:27.852561 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:27.851778 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:27.858984 12729 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.860536 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.861496 12725 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:27.866485 12729 raft_consensus.cc:1240] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:27.857295 13518 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:27.873311 12731 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:27.831048 17251 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.877521 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.883790 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.801306 17212 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.888425 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.803638 17259 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.840969 17151 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:27.848251 17243 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.891320 12732 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:27.892753 12731 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 7: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:27.894052 12733 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.847987 17100 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.896122 12726 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.4-12.4]
I20260709 13:08:27.900476 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.907641 12733 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.852593 17254 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:27.869978 17234 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:27.913434 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.875263 17260 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:27.904299 17237 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:27.921500 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 83955.1us
I20260709 13:08:27.922226 12724 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.909900 17254 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:27.935493 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 83777.7us
I20260709 13:08:27.936666 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:27.937314 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 82648.6us
I20260709 13:08:27.940018 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:27.886543 17160 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.941481 12732 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:27.910105 17157 raft_consensus.cc:3055] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:27.904901 17262 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.952643 12696 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:27.953819 12733 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:27.935341 17239 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:27.966363 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.978699 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:27.979476 12733 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:27.979526 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 129744us
I20260709 13:08:27.976917 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:27.963833 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 107351us
I20260709 13:08:27.929774 17237 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.912362 17100 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:27.950438 17233 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 13:08:27.984678 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:27.988229 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.944918 17257 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:28.003775 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 56460us
I20260709 13:08:27.957975 13517 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:28.023293 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:28.008761 12733 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:27.976199 17266 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:27.954715 17157 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:27.895133 17251 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:27.982501 17101 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.035746 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:28.037145 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1528) took 1311 ms. Trace:
I20260709 13:08:27.971321 17230 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.038378 12733 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:08:28.029325 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48573us
I20260709 13:08:28.040910 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:28.040781 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:28.024772 12696 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:27.935787 17260 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.062790 12724 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:28.036444 17253 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.058539 12771 leader_election.cc:400] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16.
I20260709 13:08:28.076690 12771 leader_election.cc:403] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.026758 17270 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:28.074046 13520 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:28.037750 12802 rpcz_store.cc:276] 0709 13:08:26.717499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.718678 (+  1179us) service_pool.cc:224] Handling call
0709 13:08:26.735105 (+ 16427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.758020 (+ 22915us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:26.795034 (+ 37014us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.167407 (+372373us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.484133 (+316726us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.508554 (+ 24421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.511936 (+  3382us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.512141 (+   205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:27.512178 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.512258 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.028947 (+516689us) raft_consensus.cc:1685] finished
0709 13:08:28.028969 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.029099 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7524,"prepare.queue_time_us":152505,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":3847,"raft.queue_time_us":255893,"raft.run_cpu_time_us":688,"raft.run_wall_time_us":16799,"thread_start_us":664852,"threads_started":3,"wal-append.queue_time_us":520685}
I20260709 13:08:28.032722 17234 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:28.004395 17242 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:28.082563 12729 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.042187 17239 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:28.020720 17262 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:28.097817 17276 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.061030 17243 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:28.080972 17253 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.081300 17146 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.063639 17151 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:08:28.044346 17101 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.095762 17270 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:28.127162 16884 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.045959 17250 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:08:28.138161 17253 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.162801 12729 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:28.163919 17257 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:28.165140 17257 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.140226 17243 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.168642 17243 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.170495 17116 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:28.172583 17116 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.139850 17221 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.149749 17146 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:28.177940 12732 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:08:28.182699 17240 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:08:28.183086 17279 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.141580 17235 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.190618 12799 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:28.146332 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:28.070331 17237 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.291570 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.292485 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.293351 12880 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:28.275254 17172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.028s
I20260709 13:08:28.184062 17271 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:28.069945 17160 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.177872 17212 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.184187 17264 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.160596 17176 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.269501 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.269706 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.271422 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.185979 17162 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.270453 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.285415 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2364) took 1022 ms. Trace:
I20260709 13:08:28.327788 12873 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.139659 17157 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.264633 17262 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:28.255636 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 196053us
W20260709 13:08:28.287487 17184 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.934s	user 0.010s	sys 0.005s
I20260709 13:08:28.265750 17259 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.275507 17242 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.314805 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:28.317857 12731 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:28.289340 17143 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:08:28.319289 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.322582 12877 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:28.341853 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.342435 12877 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:28.324560 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.326504 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.289898 17266 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:28.322371 12881 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.294180 13517 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.327695 12799 rpcz_store.cc:276] 0709 13:08:27.262642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.391169 (+128527us) service_pool.cc:224] Handling call
0709 13:08:27.391636 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.650226 (+258590us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540019c420. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b6adc0 00007f0f41bf51c0 00007f0f41bf6231 00007f0f41bf2d8f 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c
0709 13:08:28.285010 (+634784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.285322 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268164992}
I20260709 13:08:28.344169 12881 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:28.291419 17100 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.318537 17280 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:28.319656 17237 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:28.339512 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.296514 17172 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:28.346861 12731 raft_consensus.cc:1217] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 13:08:28.378888 12731 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:28.379354 17172 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.347507 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.333563 17250 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.364804 17266 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.365849 17280 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.368798 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.368496 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:28.384166 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.413618 12880 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:28.413997 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.338333 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:28.389262 12877 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:28.247725 17234 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.340262 17242 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:28.340750 17162 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:28.352169 12881 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:28.396989 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.398985 17177 consensus_meta.cc:287] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.002s
I20260709 13:08:28.419416 12876 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.420665 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.429207 12881 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.432659 12877 raft_consensus.cc:2393] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:28.441237 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 72558.6us
I20260709 13:08:28.356698 17204 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.444904 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.449904 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.254529 17239 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.403685 17157 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:28.427611 17173 consensus_meta.cc:287] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.008s
W20260709 13:08:28.474932 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.482272 13521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38680 (request call id 379) took 1604 ms. Trace:
I20260709 13:08:28.463824 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.483708 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:28.485005 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.345208 17184 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.313510 17271 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.412937 17178 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:28.493990 13518 raft_consensus.cc:1813] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:28.505826 12880 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:28.494721 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:28.515852 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.515677 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.524242 12876 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:28.529136 13518 raft_consensus.cc:2410] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:28.493472 13521 rpcz_store.cc:276] 0709 13:08:26.854363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.854533 (+   170us) service_pool.cc:224] Handling call
0709 13:08:26.854981 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.104810 (+249829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.104845 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.118452 (+ 13607us) log.cc:844] Serialized 52 byte log entry
0709 13:08:27.833712 (+715260us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:27.833774 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.833879 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.457990 (+624111us) raft_consensus.cc:1685] finished
0709 13:08:28.458024 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.458285 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55367,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":177,"thread_start_us":862448,"threads_started":2,"wal-append.queue_time_us":720300}
I20260709 13:08:28.531318 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:28.451862 17100 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.542178 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.542531 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.550041 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.551674 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.465181 17251 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:28.525511 17248 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 13:08:28.503135 17212 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.490924 17292 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:28.560599 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.563814 12881 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:28.552791 17221 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:28.564385 17272 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:28.565034 17255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.027s	sys 0.025s
I20260709 13:08:28.565721 17263 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.566239 17285 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.567044 17245 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.569131 17101 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.570958 17280 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.481489 17204 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.572795 17116 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:28.545884 17168 consensus_meta.cc:287] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.778s	user 0.014s	sys 0.000s
I20260709 13:08:28.578825 12873 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:28.549073 17178 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.451047 17177 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:28.588446 12848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.027s
W20260709 13:08:28.650267 12848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.015s	sys 0.028s
W20260709 13:08:28.651098 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 610264us
I20260709 13:08:28.507055 17260 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.440541 17250 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.599611 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.661854 12876 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:28.482822 17162 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.666765 17162 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:28.584468 17247 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.754s	user 0.004s	sys 0.000s
I20260709 13:08:28.667057 17250 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.643234 17256 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.668260 12875 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:28.625268 17255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.027s	sys 0.026s
I20260709 13:08:28.669860 17255 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:28.670624 12733 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:08:28.670792 12727 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:28.671072 12733 pending_rounds.cc:85] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 4
I20260709 13:08:28.671301 12733 pending_rounds.cc:107] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:28.671514 12733 raft_consensus.cc:2889] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.671795 12733 pending_rounds.cc:107] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 13:08:28.603343 17174 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.162s	user 0.013s	sys 0.003s
I20260709 13:08:28.329200 17270 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.672557 12730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52082 (request call id 598) took 1298 ms. Trace:
W20260709 13:08:28.673134 17278 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:08:28.673046 12730 rpcz_store.cc:276] 0709 13:08:27.373844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.384182 (+ 10338us) service_pool.cc:224] Handling call
0709 13:08:27.384671 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.385408 (+   737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.385443 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.385994 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.567491 (+181497us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:27.568106 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.582008 (+ 13902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.573583 (+991575us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:28.672206 (+ 98623us) raft_consensus.cc:1685] finished
0709 13:08:28.672226 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.672479 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":15394176,"thread_start_us":179422,"threads_started":1,"wal-append.queue_time_us":377644}
W20260709 13:08:28.674649 17268 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.410s	user 0.001s	sys 0.001s
I20260709 13:08:28.675513 12730 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:28.675616 17205 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:28.654199 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.555094 17282 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.380s
I20260709 13:08:28.676699 12873 raft_consensus.cc:2410] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:28.628984 12731 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.677876 12873 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:28.679111 12731 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:28.664705 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:28.664914 12848 leader_election.cc:400] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:28.684235 17288 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:28.684113 17253 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.627985 17272 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.685351 17288 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.687335 17272 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.604243 17292 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.688552 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.688973 12808 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.689545 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.690737 17292 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.653294 17168 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.557722 17235 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.672391 17296 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:28.679247 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.024s	sys 0.032s
I20260709 13:08:28.639959 17100 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:28.687885 17272 raft_consensus.cc:3055] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.713227 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.692240 12733 raft_consensus.cc:2889] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.699331 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:28.703804 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.024s	sys 0.032s
I20260709 13:08:28.653977 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:28.715795 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 779153us
I20260709 13:08:28.716542 12880 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 7: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:28.711232 12807 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.720822 12807 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:28.722119 12807 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.712580 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.650441 17146 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:28.637338 17263 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:28.692179 16899 consensus_meta.cc:287] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.086s	user 0.009s	sys 0.006s
I20260709 13:08:28.729548 12801 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:28.734030 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.770339 12804 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:28.741621 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:28.771369 12800 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:28.747743 12807 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.716989 12699 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.673045 17281 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.585216 17242 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.752764 17178 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.758819 13517 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:28.760192 17252 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.762038 17177 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:28.762877 17124 consensus_meta.cc:287] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.001s
W20260709 13:08:28.794055 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.764586 17280 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.764762 17241 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.765240 17288 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:28.641872 17245 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.765666 17255 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.779377 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62491.4us
I20260709 13:08:28.784626 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:28.768795 16991 consensus_meta.cc:287] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.403s	user 0.010s	sys 0.005s
I20260709 13:08:28.779536 17285 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:28.713788 17272 raft_consensus.cc:740] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:28.793502 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 194573us
W20260709 13:08:28.763180 17290 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:08:28.672400 17174 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.796694 12875 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:28.845038 13484 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:28.853101 12799 pending_rounds.cc:85] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:28.833863 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:28.836047 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:28.791175 13514 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:28.783026 17171 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.795240 17198 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.438s	user 0.012s	sys 0.004s
I20260709 13:08:28.840667 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:28.839886 12807 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:28.840808 17124 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:28.728163 17100 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.778625 16899 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.832773 17279 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:28.845111 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:28.837947 17241 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.837106 17253 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.838155 16991 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.795626 17252 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.865132 17245 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.935689 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:28.853130 17285 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:28.937002 17241 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.785683 17305 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:08:28.937913 17100 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.714128 17296 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:28.938686 17285 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:28.885309 17124 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.839059 17288 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.940403 17296 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:28.940816 17269 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.941154 17288 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.941668 12882 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:28.941524 17269 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.943687 17269 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.853506 12799 pending_rounds.cc:107] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:28.978166 12799 raft_consensus.cc:2889] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.854873 12802 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.863890 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:28.867889 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:28.868373 12725 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:28.883867 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.885793 12806 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.981694 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 2132) took 1119 ms. Trace:
I20260709 13:08:28.794646 17280 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.882858 17184 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.866384 17271 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.850338 17263 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:28.840898 17255 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:28.844369 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:29.054430 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 218557us
I20260709 13:08:29.056659 12727 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.057449 12733 raft_consensus.cc:1240] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:28.944995 17288 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.941110 17124 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:28.786780 17281 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:29.008234 16914 consensus_meta.cc:287] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.263s	user 0.011s	sys 0.005s
I20260709 13:08:29.076929 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:28.884341 17259 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.962428 12805 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:28.878773 17198 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.839793 17221 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:28.982527 12725 rpcz_store.cc:276] 0709 13:08:27.862214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.784295 (+922081us) service_pool.cc:224] Handling call
0709 13:08:28.981575 (+197280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:28.937067 17252 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:28.943842 17276 consensus_meta.cc:287] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.008s
W20260709 13:08:28.903622 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.008672 17253 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:29.016464 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 152722us
I20260709 13:08:29.058717 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:29.092723 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.093282 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.059451 12728 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:28.887550 17205 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
W20260709 13:08:29.062083 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.946482 17228 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:29.084009 12802 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:29.008239 12876 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:29.092444 12733 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:29.099897 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:29.028294 17100 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.100580 12733 raft_consensus.cc:2376] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14. Re-sending same reply.
W20260709 13:08:29.102444 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.102591 12877 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
W20260709 13:08:29.103924 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.104444 12731 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:29.104871 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.105468 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.111171 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.053319 17305 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.126446 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.127810 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.067934 17271 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.134547 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:29.138747 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.138543 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.139078 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.121649 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:29.124177 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.130188 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:29.118449 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.125088 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.132354 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.081132 17285 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:29.146998 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:29.153142 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:29.094437 17124 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.147028 12801 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:29.091454 17184 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:29.155563 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.124107 17252 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.119539 17276 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16.
W20260709 13:08:29.149901 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.132179 17282 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.162748 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.152439 12724 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:29.089679 17288 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.132465 17212 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:29.089238 16914 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.177502 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.179601 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:29.179987 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 97553.8us
I20260709 13:08:29.092696 17259 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.179987 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.138374 17234 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.163614 17184 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.194674 12802 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:29.195319 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:29.157970 17280 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.203428 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.157717 17252 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.130601 17100 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.132473 17253 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.207108 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:29.212580 17280 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:29.142920 17271 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.163511 17285 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:29.216640 12848 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:29.218046 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:29.209189 17254 consensus_meta.cc:287] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.258s	user 0.012s	sys 0.004s
I20260709 13:08:29.219472 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:29.221148 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59199.9us
I20260709 13:08:29.161414 17124 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.176373 17292 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:29.240223 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.213315 17205 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.251808 12724 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.196205 17282 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.200310 17305 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:29.217316 17280 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.200680 17212 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:29.264091 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:29.259383 17283 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.274006 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.249413 17172 raft_consensus.cc:2804] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:29.264495 17205 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.263509 17291 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:29.282449 17311 raft_consensus.cc:2764] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:08:29.283576 17314 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:29.344255 17288 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.310082 17280 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:29.286808 12833 heartbeater.cc:646] Failed to heartbeat to 127.11.78.62:43083 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.78.62:43083 timed out after 15.000s (SENT)
I20260709 13:08:29.289067 17282 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:29.289618 17315 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:08:29.293605 17281 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.295526 17252 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.297709 17184 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.299037 17309 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:29.300598 17317 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:29.192497 17272 consensus_queue.cc:260] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.303004 17100 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.303215 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:29.347930 17266 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:29.260473 17310 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:08:29.207177 17234 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.223392 17286 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:29.223184 17269 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:08:29.304507 17285 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:29.315320 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 179269us
I20260709 13:08:29.375694 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:29.375859 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:29.310930 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115478us
I20260709 13:08:29.331281 12724 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:29.331975 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68019.2us
I20260709 13:08:29.209425 17221 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.304523 17259 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.379870 12847 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.250293 17254 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.242167 17174 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.340054 17205 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.343789 17326 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:29.352185 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 507263us
I20260709 13:08:29.342600 17172 raft_consensus.cc:697] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:29.385149 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.390093 12724 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:29.390645 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.369746 17266 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.405666 13516 raft_consensus.cc:3060] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.383780 17100 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:29.368767 17177 consensus_queue.cc:1059] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:08:29.337504 17283 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.387527 17281 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.394721 17288 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:29.419345 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.429150 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.430897 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.439940 17283 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.379416 17305 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.433655 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.443742 17269 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.443305 17172 consensus_queue.cc:237] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.445175 17338 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.445322 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.446990 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.408476 17266 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.401849 17259 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:08:29.420643 17318 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:08:29.420902 17313 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 13:08:29.459595 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.415328 17331 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:29.429311 17286 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.466259 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:29.452833 17338 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.471570 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:29.456142 17269 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:29.476089 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.476478 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.402598 17326 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.479884 12724 raft_consensus.cc:2410] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:29.439988 17280 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.478845 17288 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:29.481807 17288 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.483366 17344 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:29.428956 17281 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.493296 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.498850 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.500409 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 384) took 1145 ms. Trace:
I20260709 13:08:29.510867 17345 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.507965 12880 rpcz_store.cc:276] 0709 13:08:28.354743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.725181 (+370438us) service_pool.cc:224] Handling call
0709 13:08:28.725651 (+   470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:28.783373 (+ 57722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.783420 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:28.848064 (+ 64644us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:28.848732 (+   668us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.877001 (+ 28269us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:29.089293 (+212292us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.091396 (+  2103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.091498 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.499979 (+408481us) raft_consensus.cc:1685] finished
0709 13:08:29.500128 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.500333 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52166,"prepare.queue_time_us":325903,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":69310,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":38688,"spinlock_wait_cycles":21690240,"thread_start_us":239688,"threads_started":2,"wal-append.queue_time_us":225465}
I20260709 13:08:29.521693 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.495041 17269 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.521832 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.523119 12724 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:29.523613 12880 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:29.511664 17345 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.526723 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:29.527173 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.469729 17331 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:29.530283 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.531396 17157 consensus_meta.cc:287] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.002s
I20260709 13:08:29.531472 17331 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.532804 17254 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.513399 17286 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:29.534657 17204 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.537174 17281 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.545439 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.545698 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:29.551209 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.552942 12724 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:29.525648 17269 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.553632 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.556329 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:29.558822 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.559900 12802 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:29.561110 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:29.561825 12880 raft_consensus.cc:606] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:29.562067 12880 raft_consensus.cc:614] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:29.564229 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:29.556012 17269 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.566097 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:29.568739 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:29.574421 17326 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.575095 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.575932 12733 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:29.576397 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.576968 12802 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:29.577358 12733 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:29.577739 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:29.578262 12802 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.580196 17205 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.580971 13516 raft_consensus.cc:2468] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:08:29.582937 17301 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.881s	user 0.013s	sys 0.015s
I20260709 13:08:29.586544 12880 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:29.587493 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 388) took 1221 ms. Trace:
I20260709 13:08:29.587968 12880 rpcz_store.cc:276] 0709 13:08:28.366292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.584810 (+1218518us) service_pool.cc:224] Handling call
0709 13:08:29.585142 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.587196 (+  2054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.587426 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.589231 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2390) took 1204 ms. Trace:
I20260709 13:08:29.589529 12880 rpcz_store.cc:276] 0709 13:08:28.385365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.588663 (+1203298us) service_pool.cc:224] Handling call
0709 13:08:29.588904 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.589037 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.589052 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.589080 (+    28us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:29.589097 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.589128 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.589195 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.590570 12880 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:29.590994 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2392) took 1187 ms. Trace:
I20260709 13:08:29.591562 12880 rpcz_store.cc:276] 0709 13:08:28.404214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.590134 (+1185920us) service_pool.cc:224] Handling call
0709 13:08:29.590336 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.590833 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.590959 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.592338 12802 raft_consensus.cc:2468] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:29.578719 17266 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.593161 12880 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.594883 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:29.584618 17205 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:29.597095 17321 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:08:29.600989 17266 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.598546 17345 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.605274 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:29.602154 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2377) took 1330 ms. Trace:
I20260709 13:08:29.606809 12874 rpcz_store.cc:276] 0709 13:08:28.272188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.272758 (+   570us) service_pool.cc:224] Handling call
0709 13:08:28.273035 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.358437 (+ 85402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.358470 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.358511 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:28.358540 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.601907 (+1243367us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b5400220954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.601961 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.602089 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195890560}
I20260709 13:08:29.608740 12874 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.612069 12876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60686 (request call id 381) took 1286 ms. Trace:
I20260709 13:08:29.612565 12876 rpcz_store.cc:276] 0709 13:08:28.325907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.680466 (+354559us) service_pool.cc:224] Handling call
0709 13:08:28.680748 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.098876 (+418128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.611728 (+512852us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54003a0054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.611973 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752544512}
I20260709 13:08:29.613660 17255 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.614293 12876 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.593362 17269 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.594290 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:29.615778 12802 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.602738 12880 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:29.615979 12876 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.621644 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2368) took 1353 ms. Trace:
I20260709 13:08:29.619961 12874 raft_consensus.cc:1240] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:29.622133 12882 rpcz_store.cc:276] 0709 13:08:28.268420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.268609 (+   189us) service_pool.cc:224] Handling call
0709 13:08:28.269040 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.942081 (+673041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.621339 (+679258us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400208ad4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.621577 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546136960}
I20260709 13:08:29.625080 12882 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.625041 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.625772 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2363) took 2384 ms. Trace:
I20260709 13:08:29.621948 12880 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:29.626523 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.627269 12880 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.627620 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.628475 12880 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.621933 12876 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:29.632339 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.624884 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2369) took 1356 ms. Trace:
I20260709 13:08:29.632951 12879 rpcz_store.cc:276] 0709 13:08:28.268732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.268898 (+   166us) service_pool.cc:224] Handling call
0709 13:08:28.269130 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.336018 (+ 66888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.336095 (+    77us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.336158 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:28.336201 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.624680 (+1288479us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b5400381b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.624721 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.624832 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153181568}
I20260709 13:08:29.626557 12882 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:29.635974 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.636953 12799 raft_consensus.cc:2410] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:08:29.637681 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:29.626159 12806 rpcz_store.cc:276] 0709 13:08:27.241519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.368320 (+126801us) service_pool.cc:224] Handling call
0709 13:08:27.368702 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.981200 (+1612498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.625540 (+644340us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001b6a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.625689 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3488705920}
I20260709 13:08:29.642292 12802 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:29.644295 17116 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.648432 17116 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.664997 17255 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.665912 17255 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.666613 17279 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:29.667119 17279 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.667194 17116 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:29.665273 12732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 2152) took 1722 ms (client timeout 1821 ms). Trace:
I20260709 13:08:29.668304 17255 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:29.669123 12732 rpcz_store.cc:269] 0709 13:08:27.938280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.955083 (+ 16803us) service_pool.cc:224] Handling call
0709 13:08:29.660476 (+1705393us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400063454. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:29.660639 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451813248}
I20260709 13:08:29.672221 12876 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:29.681493 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:29.683871 17253 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.684047 17212 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:29.690026 12773 connection.cc:256] RPC call timeout handler was delayed by -1.0203437679999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:08:29.687357 17279 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.638502 17269 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.712577 12876 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:29.755601 17157 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.761291 17157 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.761644 17279 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.772310 17184 consensus_queue.cc:1059] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:29.773137 17168 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.773456 17184 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:29.777422 17124 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.765126 17263 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.779752 17263 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.782811 17263 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.706875 17275 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.756044 17253 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.775429 17184 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:29.765954 17174 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.779337 16914 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:29.830232 17352 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:08:29.786063 17271 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.765825 17153 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:29.769192 17281 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.848577 17153 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.833175 17253 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.784204 17276 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:29.854348 12881 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:29.857431 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.874673 12799 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:08:29.828312 17184 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:29.783715 17275 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.867573 12874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2302) took 1131 ms. Trace:
I20260709 13:08:29.876322 12874 rpcz_store.cc:276] 0709 13:08:28.736591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.622766 (+886175us) service_pool.cc:224] Handling call
0709 13:08:29.623060 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.627385 (+  4325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.627417 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.627944 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.664473 (+ 36529us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:29.664516 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.664589 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.867293 (+202704us) raft_consensus.cc:1685] finished
0709 13:08:29.867312 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.867507 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3695,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":36049,"threads_started":1,"wal-append.queue_time_us":237058}
I20260709 13:08:29.882171 17289 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:29.886737 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1569) took 1186 ms. Trace:
I20260709 13:08:29.872367 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:29.888278 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.842146 17270 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.892388 12803 rpcz_store.cc:276] 0709 13:08:28.699975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.700122 (+   147us) service_pool.cc:224] Handling call
0709 13:08:28.700441 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.700804 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.700834 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.702979 (+  2145us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.600923 (+897944us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b1800144a00. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:08:29.654176 (+ 53253us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:29.654243 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.654357 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.870842 (+216485us) raft_consensus.cc:1685] finished
0709 13:08:29.870875 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.886631 (+ 15756us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1464,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8569,"spinlock_wait_cycles":3558656,"thread_start_us":52987,"threads_started":1,"wal-append.queue_time_us":1163822}
I20260709 13:08:29.904968 17168 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.905606 17168 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.905860 17280 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.907887 17168 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.908895 17168 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.912828 12881 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.869185 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:29.909395 17168 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.927500 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:29.928148 17168 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.930857 17153 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.871320 17281 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.934947 17281 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:29.937462 12877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60686 (request call id 386) took 1571 ms (client timeout 1990 ms). Trace:
W20260709 13:08:29.937943 12877 rpcz_store.cc:269] 0709 13:08:28.365572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.494734 (+129162us) service_pool.cc:224] Handling call
0709 13:08:29.937244 (+1442510us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54000703d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:29.937372 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276863744}
I20260709 13:08:29.939823 17283 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:29.940546 17283 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:29.939944 12873 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:29.942530 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2386) took 1623 ms. Trace:
I20260709 13:08:29.942955 12873 rpcz_store.cc:276] 0709 13:08:28.318807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.678687 (+359880us) service_pool.cc:224] Handling call
0709 13:08:29.939563 (+1260876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.941486 (+  1923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.942318 (+   832us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000703d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:29.942466 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899223296}
I20260709 13:08:29.946537 12873 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:29.949249 17253 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.918974 17157 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:29.917424 17270 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.957803 17270 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.961627 13516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59886 (request call id 380) took 1122 ms. Trace:
I20260709 13:08:29.962296 13516 rpcz_store.cc:276] 0709 13:08:28.839086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.858739 (+ 19653us) service_pool.cc:224] Handling call
0709 13:08:29.961310 (+1102571us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54006a0c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:29.961495 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078864128}
I20260709 13:08:29.965349 16899 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:29.970633 12808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1570) took 1231 ms. Trace:
I20260709 13:08:29.972924 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.973361 16914 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:29.973668 12803 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:29.974121 16914 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.975106 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:29.975737 12802 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:29.976413 16914 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:29.977802 17086 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:29.981986 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:29.990202 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.991032 12726 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:29.992012 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.992774 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.993182 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.993798 12726 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:29.995110 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.992096 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:29.941816 17283 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:29.978559 17086 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.009699 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:29.995682 12733 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:30.010671 12724 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:30.011132 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:30.012095 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.009864 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.013876 12728 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:08:30.014176 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.009069 17292 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.015719 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:30.016598 12732 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:30.020797 17234 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:30.022953 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.023030 17338 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:30.023532 17338 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:30.024762 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:29.843264 17174 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:29.971287 12808 rpcz_store.cc:276] 0709 13:08:28.739593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.739774 (+   181us) service_pool.cc:224] Handling call
0709 13:08:28.740265 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.938522 (+198257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.938557 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.939377 (+   820us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.161675 (+222298us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:29.161717 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.969981 (+808264us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002b25d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:29.970063 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.970140 (+    77us) raft_consensus.cc:1685] finished
0709 13:08:29.970161 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.970540 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2625,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":454945024,"thread_start_us":221881,"threads_started":1,"wal-append.queue_time_us":298688}
I20260709 13:08:29.997550 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:30.058097 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60640.8us
W20260709 13:08:30.072093 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 72745.1us
I20260709 13:08:30.080000 12730 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:30.083181 17260 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:30.085110 17323 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:30.089249 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:30.089965 12802 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:29.910701 17289 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:30.096385 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 60360.4us
I20260709 13:08:30.096844 17168 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.107060 17168 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.113417 17275 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.107722 17323 consensus_queue.cc:1059] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:30.074966 17292 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.114509 17168 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.133090 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:30.129105 17289 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.117173 12727 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:30.111423 17184 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.144598 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.143683 13516 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:30.141889 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.150723 12882 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:30.131356 17292 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.153147 12873 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:30.155467 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.156077 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:30.126624 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:30.169042 12771 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:30.154692 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.175416 12874 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:30.176112 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.176607 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.188439 12874 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:30.169147 12730 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.177650 12873 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:30.178409 17275 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.182607 17260 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:30.155493 17184 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:30.155735 13519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38668 (request call id 339) took 1016 ms. Trace:
I20260709 13:08:30.227034 17236 consensus_queue.cc:1059] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:30.183941 17153 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:30.185052 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.185719 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.230309 12877 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:08:30.220930 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 351799us
W20260709 13:08:30.198081 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.211126 12729 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:30.160270 17292 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.197144 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:30.227335 13519 rpcz_store.cc:276] 0709 13:08:29.139903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.158520 (+ 18617us) service_pool.cc:224] Handling call
0709 13:08:30.072297 (+913777us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003c98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacea22 00007f0f479e7c09 00007f0f46b41ee0 00007f0f46c0b0ab 00007f0f46c0b131 00007f0f46bb90a0 00007f0f46bb8984 00007f0f401336d4 00007f0f40133662
0709 13:08:30.155666 (+ 83369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29026688}
I20260709 13:08:30.174216 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.178449 16899 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.224661 17157 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.233160 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.243096 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.247301 12731 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:30.120857 17338 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.245214 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.252791 12728 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:30.251500 12773 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:30.251490 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.263967 12881 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:30.266465 17086 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.273886 17333 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.274521 17333 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:30.228111 17168 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:30.255466 12873 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:30.277940 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:30.245469 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 48457.7us
I20260709 13:08:30.255501 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.257568 17281 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:30.153151 17289 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:30.284643 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:30.284915 12732 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:30.285455 12730 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:30.293926 12848 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:30.297648 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46229.4us
I20260709 13:08:30.299444 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:30.311560 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:30.295015 17338 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.319134 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.248697 16899 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.295565 17280 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:30.295673 17311 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.251727 17275 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:08:30.296993 17282 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.234746 17221 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:08:30.306095 17351 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.338233 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.353559 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.327051 17253 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:30.308980 17174 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:30.313723 17272 raft_consensus.cc:3060] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.296416 17270 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:30.320180 16914 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:30.347198 17124 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.326964 17157 raft_consensus.cc:2804] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.309609 17252 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:30.312736 17258 consensus_queue.cc:1059] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:30.300890 17303 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.326646 17296 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:30.365515 17242 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.366802 17143 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.346133 17358 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:30.346876 17280 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.371702 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.373644 17292 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:30.376469 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.380505 17204 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.320578 17281 consensus_queue.cc:1243] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:30.423527 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2149) took 2509 ms. Trace:
I20260709 13:08:30.425390 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1593) took 1353 ms. Trace:
I20260709 13:08:30.449064 12725 rpcz_store.cc:276] 0709 13:08:29.072374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.138194 (+ 65820us) service_pool.cc:224] Handling call
0709 13:08:30.425176 (+1286982us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400064354. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:30.425324 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780237056}
I20260709 13:08:30.428965 12732 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:30.427421 17124 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.433007 12730 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:08:30.434643 17283 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.377904 17198 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.359393 17253 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:30.441309 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.350801 17311 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.357116 12848 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
W20260709 13:08:30.471407 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 114440us
I20260709 13:08:30.452399 17292 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.452148 17204 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.465236 12808 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:30.448993 12729 rpcz_store.cc:276] 0709 13:08:27.913846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.672855 (+759009us) service_pool.cc:224] Handling call
0709 13:08:28.673219 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.232579 (+1559360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.423202 (+190623us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000b5ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:30.423440 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536329984}
I20260709 13:08:30.445055 17157 raft_consensus.cc:697] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.504865 12808 pending_rounds.cc:85] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:30.505287 12808 pending_rounds.cc:107] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:30.505542 12808 raft_consensus.cc:2889] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.501744 12848 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:30.449921 17143 consensus_queue.cc:1243] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:30.468319 17124 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.473294 17253 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.447027 17284 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:08:30.520853 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:30.469791 17198 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:30.501500 17303 raft_consensus.cc:2804] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:30.528210 17351 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.533097 16899 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:30.533798 17276 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.534168 17276 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.534933 17276 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.536100 17241 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.536489 17241 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.536825 17241 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.537357 17280 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:30.528965 17198 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.542361 17261 raft_consensus.cc:3055] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:30.542804 17261 raft_consensus.cc:740] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:30.542887 17303 raft_consensus.cc:697] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:30.542979 17252 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:30.543624 17252 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.544677 17252 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.548346 17263 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:30.548846 17263 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.543825 17303 consensus_queue.cc:237] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.543784 17261 consensus_queue.cc:260] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.549858 17263 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.551024 17261 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.551334 17238 raft_consensus.cc:3055] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:30.551716 17238 raft_consensus.cc:740] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:30.552636 17238 consensus_queue.cc:260] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.553771 17238 raft_consensus.cc:3060] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.554399 17276 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.554309 17157 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.556949 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:30.512416 17327 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.567535 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 77) took 6716 ms. Trace:
I20260709 13:08:30.570374 17281 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:30.579849 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.537467 17204 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:30.578938 17342 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:08:30.598419 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.599079 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.577049 17281 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.580637 17245 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.571388 12630 rpcz_store.cc:276] 0709 13:08:23.851470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.854540 (+  3070us) service_pool.cc:224] Handling call
0709 13:08:23.866854 (+ 12314us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:30.567462 (+6700608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:27.850547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:28.028522 (+177975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:28.033645 (+  5123us) write_op.cc:435] Acquired schema lock
0709 13:08:28.036684 (+  3039us) tablet.cc:662] Decoding operations
0709 13:08:28.175019 (+138335us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:28.178275 (+  3256us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:28.246627 (+ 68352us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:28.298618 (+ 51991us) tablet.cc:701] Row locks acquired
0709 13:08:28.308820 (+ 10202us) write_op.cc:260] PREPARE: finished
0709 13:08:28.336509 (+ 27689us) write_op.cc:270] Start()
0709 13:08:28.346830 (+ 10321us) write_op.cc:276] Timestamp: P: 1783602508332872 usec, L: 0
0709 13:08:28.351228 (+  4398us) op_driver.cc:348] REPLICATION: starting
0709 13:08:28.545473 (+194245us) log.cc:844] Serialized 1283 byte log entry
0709 13:08:29.290008 (+744535us) op_driver.cc:464] REPLICATION: finished
0709 13:08:29.445557 (+155549us) write_op.cc:301] APPLY: starting
0709 13:08:29.445645 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:29.447842 (+  2197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:29.447953 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:29.572846 (+124893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:29.573032 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:29.573075 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:29.573286 (+   211us) log.cc:844] Serialized 40 byte log entry
0709 13:08:29.573443 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.573543 (+   100us) write_op.cc:454] Released schema lock
0709 13:08:29.573580 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:29.573999 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.574025 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1337500,"reported_tablets":6,"spinlock_wait_cycles":22047104,"child_traces":[["op",{"apply.queue_time_us":155235,"apply.run_cpu_time_us":7591,"apply.run_wall_time_us":128425,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":416656,"prepare.run_cpu_time_us":74959,"prepare.run_wall_time_us":883250,"raft.queue_time_us":315817,"raft.run_cpu_time_us":18408,"raft.run_wall_time_us":116077,"replication_time_us":931059,"thread_start_us":560082,"threads_started":4,"wal-append.queue_time_us":331731,"wal-append.run_cpu_time_us":31808,"wal-append.run_wall_time_us":1693461}]]}
I20260709 13:08:30.611687 12875 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:08:30.611524 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 324913us
I20260709 13:08:30.615316 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.615552 12873 raft_consensus.cc:1240] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:30.616206 12879 raft_consensus.cc:2393] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:30.617027 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 317642us
I20260709 13:08:30.625012 12877 raft_consensus.cc:1240] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:30.607954 17282 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.651697 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 308994us
I20260709 13:08:30.613893 17245 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.649852 17323 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.640254 17282 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.714628 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.715123 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.715590 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.716790 12874 raft_consensus.cc:2393] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:30.716217 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.717842 12873 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:30.720104 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:30.688547 17311 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.712280 17351 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:30.751495 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 221178us
I20260709 13:08:30.758273 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.658411 17333 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.654217 17281 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.711688 17276 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:30.760923 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.763245 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.780195 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:30.781759 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.781967 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.770114 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:30.785432 12877 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:30.684852 17323 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:30.775058 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.750569 17370 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:08:30.805135 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 149034us
I20260709 13:08:30.783263 12873 raft_consensus.cc:2410] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:08:30.807044 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 81952.9us
I20260709 13:08:30.807638 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:30.776346 17372 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:30.811654 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:30.819566 12878 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:30.832122 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:30.834359 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.835103 12730 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:30.835938 17291 consensus_queue.cc:1059] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:30.836494 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.837073 17291 raft_consensus.cc:3055] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.837553 17291 raft_consensus.cc:740] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:30.836699 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.805539 17333 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.842476 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.843425 12873 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:30.778848 17275 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:30.845109 17256 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.849781 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:30.848608 17292 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:30.886646 17241 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.900313 17241 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:30.873940 17245 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.900974 17124 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.879029 17371 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.903702 12876 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:30.838564 17291 consensus_queue.cc:260] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:30.873144 17370 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:08:30.901609 17184 consensus_meta.cc:287] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.003s
W20260709 13:08:30.909194 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.902753 17282 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:30.917421 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46655.5us
I20260709 13:08:30.866386 17351 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:30.921624 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 114072us
I20260709 13:08:30.921808 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:30.922752 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 73174.8us
I20260709 13:08:30.923624 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.911265 17371 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.924746 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.936631 17245 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.937247 17245 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.937412 17323 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:30.937584 17245 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.939169 17253 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.936631 17388 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.941045 17388 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.941493 17263 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.944938 17276 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.945400 17276 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.946342 17276 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.941628 17388 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.948346 17358 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:30.949838 17358 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:30.950204 17358 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.952546 17327 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:30.953022 17198 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:30.953063 17327 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.958673 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:30.959679 12730 raft_consensus.cc:2468] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
W20260709 13:08:30.962332 12875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 2297) took 2230 ms (client timeout 1620 ms). Trace:
W20260709 13:08:30.963007 12875 rpcz_store.cc:269] 0709 13:08:28.731164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.121287 (+390123us) service_pool.cc:224] Handling call
0709 13:08:30.961810 (+1840523us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540006c2d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:30.961987 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3359795072}
I20260709 13:08:30.966804 12875 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:30.969324 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:30.945412 17382 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:30.971884 17370 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:30.980501 17153 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.728s	user 0.014s	sys 0.000s
I20260709 13:08:30.980865 17370 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:30.981424 17370 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.982810 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.985011 17390 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:30.985651 17253 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:30.986511 17390 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.986964 17390 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:30.987329 17390 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.988385 12874 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:30.911996 17385 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 13:08:30.990659 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.981011 17252 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.924687 17184 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:30.990808 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:30.955927 17198 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:31.009323 17174 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:31.009881 17174 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:30.965372 17386 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:08:31.016409 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 258247us
I20260709 13:08:31.017177 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.042611 12882 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:31.070766 12882 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:31.084156 17283 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.084560 17245 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.086035 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 116854us
I20260709 13:08:31.014729 17286 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.011307 17174 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.029911 17272 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:31.113958 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:31.087112 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:30.940862 17371 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.116380 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 125655us
I20260709 13:08:31.073052 17338 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:31.124347 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.100582 17386 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.122634 17338 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:31.127404 17174 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.130913 17153 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.131348 12773 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.137198 17245 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.137904 17143 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:31.211568 12699 leader_election.cc:336] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.968s (SENT)
W20260709 13:08:31.138705 17238 consensus_meta.cc:287] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.001s
W20260709 13:08:31.148975 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.976192 17358 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.152878 17252 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:31.221431 17252 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:31.222457 17252 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:31.156121 17124 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:31.160681 17388 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.085582 17283 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.226112 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.227649 17283 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:31.166173 13485 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.124496 12875 raft_consensus.cc:2955] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:31.201498 17338 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.117442 17272 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.207780 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 81901.2us
I20260709 13:08:31.236258 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:31.230535 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 145691us
W20260709 13:08:31.209162 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 192053us
I20260709 13:08:31.217109 17327 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:31.209353 17386 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.219244 17256 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.220760 17270 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.201159 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.203824 17153 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.118012 17168 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:31.240104 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.223873 17252 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:31.241984 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.244822 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.260567 12881 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:31.233388 17157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.021s
I20260709 13:08:31.238377 17272 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.248639 17143 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:31.268445 17153 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.271749 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.278460 17386 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.274147 17401 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:31.276199 17157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.022s
I20260709 13:08:31.299839 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.302217 12808 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:31.267299 17270 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.303979 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.314463 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.315222 12802 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.317389 12803 raft_consensus.cc:1275] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:31.317684 12808 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:31.319469 12808 pending_rounds.cc:85] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:31.320286 12808 pending_rounds.cc:107] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:31.321002 12808 raft_consensus.cc:2889] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.319496 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.323696 12803 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.327134 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.329742 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.331435 12808 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.280617 17402 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:31.345323 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45614.9us
I20260709 13:08:31.346886 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:31.272073 17168 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.349068 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:31.348098 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 261271us
I20260709 13:08:31.363152 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.365409 12804 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.303097 17386 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:31.311092 17263 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.349502 17402 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:31.386227 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:31.355566 17275 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:31.389184 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:31.371029 17386 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.397161 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.394927 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.401088 12804 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:31.403014 17168 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.381229 17351 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:31.333377 17401 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.409435 17408 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:31.410209 17401 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:31.410445 17408 consensus_queue.cc:1243] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:31.410820 17406 consensus_queue.cc:1048] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:31.391316 17291 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.362401 17403 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:08:31.422390 17390 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.429173 17270 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:31.429526 13518 raft_consensus.cc:1240] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.430114 17327 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.417431 12629 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 10, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.431241 17388 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.424515 17370 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.447247 12804 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:31.445730 17153 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.451630 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:31.453636 16899 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:31.431758 12629 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.433398 17365 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.756s	user 0.005s	sys 0.000s
I20260709 13:08:31.433876 17168 consensus_queue.cc:1059] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:31.379451 17402 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.435988 17283 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:31.435827 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 62285.9us
I20260709 13:08:31.444268 17157 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:31.422448 17384 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:31.447124 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.437737 17281 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:31.459777 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 51316.4us
I20260709 13:08:31.466944 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:31.505769 13484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.465723 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:31.506173 17407 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:08:31.455964 12803 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:31.463644 17174 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:31.510317 17174 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.490731 17400 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.459342 17405 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:08:31.513885 17168 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:31.502458 17204 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:31.514828 17204 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:31.515744 17204 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:31.516312 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.516979 17204 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.486058 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.517905 17390 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.520920 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.522636 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.522984 12808 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:31.523437 12732 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:31.527664 12804 raft_consensus.cc:1240] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:31.354617 12802 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:08:31.491871 12848 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.496435 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.497433 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.498343 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.501128 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.495234 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.503504 12805 raft_consensus.cc:2368] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14.
I20260709 13:08:31.514477 17168 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.536339 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.542330 12803 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:31.542385 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:31.460151 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.539309 12799 raft_consensus.cc:1240] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:31.540477 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.546720 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:31.547616 12876 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.547947 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.551000 12728 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:31.551754 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:31.555179 12729 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:08:31.556483 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:31.564217 12874 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:31.549774 17377 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.549168 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.577057 12804 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:31.577230 12730 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:31.590189 12848 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:31.594898 12876 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:31.598304 12876 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:31.503809 17384 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:31.629215 12878 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:31.636211 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:31.639705 12876 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:31.644327 12629 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.647612 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57681.8us
I20260709 13:08:31.565798 16914 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:31.550238 16899 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.564008 17296 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:31.660351 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 222888us
I20260709 13:08:31.687489 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.688344 12804 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:31.653666 17286 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.692682 12629 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.652915 17377 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:31.702584 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:31.663260 17296 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:31.709245 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:31.704487 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 241511us
I20260709 13:08:31.667034 17406 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:31.775215 12629 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.786352 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.673530 16899 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.791592 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.804173 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 129849us
I20260709 13:08:31.805660 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet cc76143509f64c4faa68973765829aec with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41706
I20260709 13:08:31.809373 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.810101 12799 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:31.811060 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.811787 12799 raft_consensus.cc:2368] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12.
I20260709 13:08:31.816632 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:31.817641 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 115134us
I20260709 13:08:31.817991 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.817910 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.818825 12847 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:31.788192 17382 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:31.764946 16914 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:31.829869 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.831719 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2423) took 1027 ms. Trace:
W20260709 13:08:31.846503 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 165158us
I20260709 13:08:31.844820 12799 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.844827 12875 rpcz_store.cc:276] 0709 13:08:30.806027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.967883 (+161856us) service_pool.cc:224] Handling call
0709 13:08:30.971670 (+  3787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.124363 (+152693us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:31.260028 (+135665us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.388802 (+128774us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.389361 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.389506 (+   145us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:31.734906 (+345400us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.831326 (+ 96420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.831421 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.831465 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:31.831478 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.831651 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267724,"prepare.queue_time_us":115083,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":240620,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":180,"thread_start_us":337522,"threads_started":2,"wal-append.queue_time_us":175912}
I20260709 13:08:31.851404 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.819547 17256 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.801229 17184 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:31.859961 13514 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:31.707429 17384 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.870472 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.876050 12629 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.876991 12799 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:31.843534 17296 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.879614 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.829742 17289 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:31.880661 12799 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:31.839931 17189 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.856215 17410 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:31.824462 17286 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:31.887920 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.845664 17406 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:31.854389 17408 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.909957 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.855496 17283 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.911355 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:31.869167 17252 consensus_meta.cc:287] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:08:31.894693 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:31.859033 17275 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.879895 17385 raft_consensus.cc:2764] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:31.921336 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.928987 12807 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:31.887785 17296 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.889454 17370 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.896397 17303 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:31.916646 17272 consensus_meta.cc:287] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.000s
I20260709 13:08:31.870690 17402 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.878748 17184 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.944221 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.952423 12799 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:31.961206 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.875433 17256 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.893359 17289 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:31.941943 17168 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:31.898180 17189 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:31.974944 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:31.975783 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70990.6us
I20260709 13:08:31.921450 17408 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.980492 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.985100 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.929584 17275 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.916150 17422 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:31.959438 17276 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.960170 17272 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.888644 17377 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:31.949054 12629 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 11, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 11 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:31.992130 12771 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:31.998222 17390 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.998761 17390 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:31.999662 17390 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:31.991950 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 173250us
I20260709 13:08:32.004411 17370 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:32.008632 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:32.014919 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.023299 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.023921 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.984930 17153 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.024919 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.031204 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet cc76143509f64c4faa68973765829aec (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:32.025695 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.031536 13512 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:32.030319 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.030730 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.036734 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.040068 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.038899 12801 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:32.051039 12878 pending_rounds.cc:85] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 8
I20260709 13:08:32.051443 12878 pending_rounds.cc:107] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:32.051697 12878 raft_consensus.cc:2889] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:32.056666 17419 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:08:32.057878 17415 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:32.059594 12879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2417) took 1264 ms. Trace:
W20260709 13:08:32.059856 17425 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:32.060078 12879 rpcz_store.cc:276] 0709 13:08:30.795196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.800883 (+  5687us) service_pool.cc:224] Handling call
0709 13:08:30.801407 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.358986 (+557579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.359021 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.363480 (+  4459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.568817 (+205337us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:31.706050 (+137233us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.824619 (+118569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.824703 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.059269 (+234566us) raft_consensus.cc:1685] finished
0709 13:08:32.059294 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.059508 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487811,"prepare.queue_time_us":232792,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":405512,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":38022,"thread_start_us":493466,"threads_started":2,"wal-append.queue_time_us":547493}
W20260709 13:08:32.061759 17431 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:32.063344 12808 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:32.064818 12808 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:08:32.065109 12808 pending_rounds.cc:85] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 5
I20260709 13:08:32.065326 12808 pending_rounds.cc:107] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:32.065557 12808 raft_consensus.cc:2889] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.991570 17406 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.067487 12808 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.069205 12808 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:32.070825 12808 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:32.072527 17379 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.188s	user 0.005s	sys 0.013s
I20260709 13:08:32.077884 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:31.950240 16914 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.087409 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:32.087318 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56680.3us
I20260709 13:08:31.968818 17286 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.038165 17303 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.094327 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:32.091514 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.025010 12629 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 8 to 4, leader changed from <none> to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) added, now has a pending config: VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:32.095906 12799 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:32.102293 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:32.103220 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:32.103799 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:32.104468 12732 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:32.106541 12733 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:32.106841 12847 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.096849 17177 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:32.093309 17418 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:08:32.114084 12730 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:32.109516 12731 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:32.115478 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2414) took 1347 ms. Trace:
W20260709 13:08:32.098093 17423 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:08:32.098978 12808 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:32.115880 12877 rpcz_store.cc:276] 0709 13:08:30.767997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.786453 (+ 18456us) service_pool.cc:224] Handling call
0709 13:08:30.792448 (+  5995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.031535 (+239087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.031571 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.065821 (+ 34250us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.412933 (+347112us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b180035a400. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:08:31.628750 (+215817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:31.628793 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.628860 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.115172 (+486312us) raft_consensus.cc:1685] finished
0709 13:08:32.115194 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.115410 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285888,"raft.queue_time_us":264472,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9161,"spinlock_wait_cycles":37212544,"thread_start_us":215588,"threads_started":1,"wal-append.queue_time_us":595204}
I20260709 13:08:32.110594 12629 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 8 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.095310 17333 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.128509 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:32.125757 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.127537 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.127792 12731 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:32.098589 17303 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.133424 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.135342 12808 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.136677 12808 raft_consensus.cc:1240] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:32.139492 12803 raft_consensus.cc:1240] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:32.148240 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.149020 12808 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.137568 17303 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.153069 12801 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.154631 17157 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:32.155184 17157 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.128429 12629 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 3 to 5, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 5 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.158409 12629 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.166693 17143 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:32.167901 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 122385us
I20260709 13:08:32.169704 17358 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:32.174467 16899 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.178284 17174 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.183110 17405 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:32.187291 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.185207 12629 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:32.190721 17238 consensus_queue.cc:1059] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:32.196838 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.197643 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.197803 17303 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.202468 17351 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:32.203145 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.207521 17253 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.209817 13514 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:32.213742 17253 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.214349 17253 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.217670 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:32.217785 17283 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.218689 17283 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.207223 17270 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:32.197851 12629 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 11, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:32.198077 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.234787 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.239516 16899 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:32.240350 16899 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:32.233139 12629 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.242274 16899 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.242199 17280 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.233026 17303 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:32.249017 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 48686.9us
I20260709 13:08:32.250489 17405 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.250049 12629 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 8, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 8 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:32.252206 17405 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.252286 17168 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:32.254408 17387 log.cc:927] Time spent T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.351s	user 0.005s	sys 0.010s
I20260709 13:08:32.254181 17168 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.261056 17384 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.253085 17405 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.264744 17198 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:32.265403 17198 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:32.267727 17424 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.242s	user 0.004s	sys 0.000s
I20260709 13:08:32.270319 17327 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.274257 12806 raft_consensus.cc:1275] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:32.275584 17408 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.271096 17327 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.279187 17198 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.281234 17280 consensus_queue.cc:1048] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.286298 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.287495 12806 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 10: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:32.290347 17327 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.291997 17327 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:32.293802 17327 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:32.247648 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.302310 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.303512 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:32.305270 12806 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:32.307260 17280 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:32.306352 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59765.1us
I20260709 13:08:32.313213 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:32.313939 12799 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:32.313505 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:32.315217 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:32.309393 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:32.253242 12629 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.360101 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47367us
I20260709 13:08:32.360450 12629 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 11, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.324729 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.160635 17378 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.361454 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:32.363829 12873 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:32.127003 17422 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:32.367393 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58082.9us
W20260709 13:08:32.370903 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46283.4us
I20260709 13:08:32.372285 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:32.362919 12629 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:32.329552 17386 consensus_meta.cc:287] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.904s	user 0.010s	sys 0.005s
W20260709 13:08:32.376763 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 110062us
I20260709 13:08:32.379225 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:32.390683 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:32.319114 17256 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.392570 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:32.384378 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:32.403781 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:32.402410 17124 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:08:32.302889 17327 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.302904 17157 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.408435 17327 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.408581 17189 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.394554 17386 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.410712 17386 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.411336 12802 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:32.413837 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.406817 17388 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.137774 17333 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.369073 17400 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.369441 17378 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.394865 17434 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:08:32.426410 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:32.370065 17280 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:32.400864 17174 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.419328 12629 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.418610 12773 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:32.440903 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.435542 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:32.442965 12807 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.396309 17198 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.427824 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:32.628857 12728 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:32.403252 17351 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.630102 17351 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.630595 17351 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:32.632874 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.635244 17157 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.662994 17184 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.677208 16914 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.677937 16914 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:32.681694 12696 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.3:36899 timed out after 1.928s (SENT) [suppressed 12 similar messages]
W20260709 13:08:32.703883 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.569397 17281 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.042s	user 0.008s	sys 0.004s
I20260709 13:08:32.612097 12803 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:32.484071 17333 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.493965 17275 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:32.564992 12629 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 11, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.435380 17378 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.422533 17177 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:32.493525 17425 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:32.460677 17272 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.560699 17371 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.481794 17283 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.581521 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:32.746321 12808 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.506160 12879 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.422811 17256 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.464649 17280 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.428965 17435 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.423375 17402 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:32.467581 17426 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:08:32.471064 17291 consensus_meta.cc:287] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: Time spent flushing consensus metadata: real 1.059s	user 0.011s	sys 0.000s
W20260709 13:08:32.468890 17204 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.951s	user 0.013s	sys 0.000s
I20260709 13:08:32.421417 17252 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:32.505179 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:32.775466 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 356437us
I20260709 13:08:32.459053 17124 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:32.708303 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.780103 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.634177 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:32.723604 12805 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
W20260709 13:08:32.781175 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 147102us
I20260709 13:08:32.779958 12882 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:32.614691 17431 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:32.739156 12802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1618) took 1204 ms. Trace:
I20260709 13:08:32.784713 12802 rpcz_store.cc:276] 0709 13:08:31.534865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.537693 (+  2828us) service_pool.cc:224] Handling call
0709 13:08:31.538070 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.411729 (+873659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.738800 (+327071us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54002b25d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:32.739066 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007920384}
W20260709 13:08:32.672011 17443 log.cc:927] Time spent T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:08:32.714032 17434 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:08:32.770956 17289 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:32.765575 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:32.783406 17405 consensus_meta.cc:287] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.002s
I20260709 13:08:32.719767 17177 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.832401 17177 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.720569 17401 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:32.774274 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:32.776458 12773 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:32.774277 17338 consensus_meta.cc:287] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 1.521s	user 0.015s	sys 0.000s
W20260709 13:08:32.722550 17455 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:08:32.764428 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:32.781003 17408 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.784443 17373 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.786442 17238 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.806510 12808 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:32.779335 17406 consensus_queue.cc:1059] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:08:32.795442 17253 consensus_meta.cc:287] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.578s	user 0.013s	sys 0.001s
I20260709 13:08:32.769059 17256 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.786805 17204 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.792733 17189 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.817376 17445 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.337s	user 0.000s	sys 0.003s
I20260709 13:08:32.761186 17371 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.813640 17289 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:32.804620 17456 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.794513 17450 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:08:32.817613 17198 consensus_queue.cc:1059] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:32.849169 17272 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:32.850251 17401 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.859067 17238 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.860579 17296 consensus_meta.cc:287] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.008s
I20260709 13:08:32.850541 17338 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.865634 17204 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.881814 17289 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:32.895105 17452 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:08:32.897058 17401 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.891815 17272 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.846714 17405 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.900625 17371 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:32.903817 17283 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.761234 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.851440 16914 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:32.892328 17238 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.874159 17189 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:32.864595 17253 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:32.902990 17256 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.072722 17242 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.105669 17256 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.071863 17153 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.106946 17256 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.030198 12880 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.048192 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:33.068943 17204 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.113633 12877 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.114847 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37676 (request call id 2344) took 1078 ms. Trace:
I20260709 13:08:33.087558 17272 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.030922 12881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2338) took 1484 ms. Trace:
I20260709 13:08:33.116479 17256 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:33.116884 12881 rpcz_store.cc:276] 0709 13:08:31.546694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.553882 (+  7188us) service_pool.cc:224] Handling call
0709 13:08:31.554229 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.570203 (+ 15974us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:31.786593 (+216390us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.936190 (+149597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.249518 (+313328us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:32.250041 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.250200 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:32.250245 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.258775 (+  8530us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.875253 (+616478us) raft_consensus.cc:1685] finished
0709 13:08:33.030103 (+154850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.030641 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186868,"prepare.queue_time_us":236460,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":25461,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":13749,"spinlock_wait_cycles":31874432,"thread_start_us":62717,"threads_started":1,"wal-append.queue_time_us":136740}
I20260709 13:08:33.070284 17252 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.121658 17256 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:32.991221 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1624) took 1454 ms. Trace:
I20260709 13:08:32.862223 17373 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:32.980496 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 203890us
I20260709 13:08:33.105521 17242 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.107074 17153 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.074712 17168 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:33.081180 17271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.005s	sys 0.002s
I20260709 13:08:33.065951 16899 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.118216 17253 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:33.132941 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 65815.4us
I20260709 13:08:33.115409 12880 rpcz_store.cc:276] 0709 13:08:32.036364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.036486 (+   122us) service_pool.cc:224] Handling call
0709 13:08:33.114481 (+1077995us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b5400381b54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:33.114718 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280095616}
I20260709 13:08:32.990727 12800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1622) took 1454 ms. Trace:
W20260709 13:08:32.970938 12699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.010s
I20260709 13:08:32.989419 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2400) took 1021 ms. Trace:
I20260709 13:08:32.989180 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1626) took 1451 ms. Trace:
I20260709 13:08:33.045383 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:33.133664 12805 rpcz_store.cc:276] 0709 13:08:31.536724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.540229 (+  3505us) service_pool.cc:224] Handling call
0709 13:08:32.990646 (+1450417us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002b3ed4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:32.990933 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713332992}
W20260709 13:08:33.163815 17143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.011s	sys 0.010s
I20260709 13:08:32.933991 17458 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.180956 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:33.126878 17177 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:33.218289 12847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.006s	sys 0.019s
W20260709 13:08:33.220791 12847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.007s	sys 0.019s
I20260709 13:08:33.221909 17242 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:33.222532 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 829979us
I20260709 13:08:33.223065 17242 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:33.224324 17271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.006s	sys 0.002s
I20260709 13:08:33.227358 17271 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.209393 12800 rpcz_store.cc:276] 0709 13:08:31.536199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.536340 (+   141us) service_pool.cc:224] Handling call
0709 13:08:31.536715 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.540446 (+  3731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.540492 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.541186 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.023165 (+481979us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:32.041297 (+ 18132us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.163793 (+122496us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b18002e4320. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:08:32.164005 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.164111 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.989769 (+825658us) raft_consensus.cc:1685] finished
0709 13:08:32.990040 (+   271us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.990433 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12941,"prepare.queue_time_us":17981,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":136596,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":13197,"spinlock_wait_cycles":10538240,"thread_start_us":357980,"threads_started":1,"wal-append.queue_time_us":549326}
I20260709 13:08:33.228251 16899 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.223893 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:33.231688 17406 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.231647 16899 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:33.233556 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.234220 13486 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.235494 17405 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.236215 17450 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.237247 17450 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:33.240367 17444 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
I20260709 13:08:33.210460 12804 rpcz_store.cc:276] 0709 13:08:31.537181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.086359 (+549178us) service_pool.cc:224] Handling call
0709 13:08:32.090445 (+  4086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.165590 (+ 75145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.165626 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.166128 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.180687 (+ 14559us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:32.180732 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.180810 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.651920 (+471110us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:32.988269 (+336349us) raft_consensus.cc:1685] finished
0709 13:08:32.988327 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.988876 (+   549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74614,"raft.queue_time_us":76163,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":151428992,"thread_start_us":14228,"threads_started":1,"wal-append.queue_time_us":234140}
I20260709 13:08:33.240407 17168 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:33.242931 17327 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:33.243893 17327 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.248054 17460 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:33.249725 17408 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.250329 17408 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:33.250790 17460 consensus_queue.cc:1059] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:33.252292 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 204498us
I20260709 13:08:33.251535 17408 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.253826 17408 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.227985 17271 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:33.257524 17371 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.257449 17271 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.258222 17371 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.258814 17371 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.930891 17435 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:33.261283 17435 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:33.265558 12699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.010s	sys 0.014s
I20260709 13:08:33.209873 12803 rpcz_store.cc:276] 0709 13:08:31.967973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.147409 (+179436us) service_pool.cc:224] Handling call
0709 13:08:32.147719 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.707583 (+559864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.988822 (+281239us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54001a2554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:32.989215 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066962176}
I20260709 13:08:33.235657 17373 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:33.269227 17143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.012s	sys 0.010s
I20260709 13:08:33.298074 13514 raft_consensus.cc:1813] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:33.300256 13514 raft_consensus.cc:2393] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 13: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
W20260709 13:08:33.306347 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 83089.8us
I20260709 13:08:33.311337 17450 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.296979 17256 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.311370 17189 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:33.339939 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.333134 12806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.006s
W20260709 13:08:33.355798 12806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.011s	sys 0.007s
W20260709 13:08:33.333489 17470 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:08:33.330775 17458 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:33.370970 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 944567us
I20260709 13:08:33.372560 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.372848 12805 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:33.373185 12805 pending_rounds.cc:85] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 7
I20260709 13:08:33.373435 12805 pending_rounds.cc:107] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:33.373718 12805 raft_consensus.cc:2889] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.373958 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:33.375952 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:33.376747 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:33.378193 17460 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.381035 17153 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.381650 17153 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.381726 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.382395 17153 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.382902 17450 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.383778 17373 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.399031 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.386637 17271 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.408866 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:33.410051 12733 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:33.416286 17338 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.427064 17168 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.427819 17168 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.431962 17289 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:33.397301 17473 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 13:08:33.432717 17168 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.433365 17373 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.434405 17168 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.434846 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.436283 17124 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.436617 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.436702 17280 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:33.437448 12881 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:33.440419 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58899.4us
I20260709 13:08:33.441583 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.441982 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.445824 17475 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:33.446760 17475 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.448647 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.437460 17280 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.449692 12882 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:33.361620 17456 consensus_queue.cc:1059] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:08:33.436947 17124 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.453074 17456 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.453119 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.455741 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.465329 12877 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:33.465833 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.457077 17437 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.466688 17437 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.469143 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.469924 12880 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 10.
I20260709 13:08:33.471235 17280 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:33.457825 17475 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.453861 17456 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.472584 17456 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.472913 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:33.473865 17351 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.843s	user 0.013s	sys 0.008s
I20260709 13:08:33.443542 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:33.474892 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 116887us
I20260709 13:08:33.500840 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.461470 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:33.485679 17373 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.463146 17256 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:33.453861 17124 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:33.407871 17327 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.469225 17437 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.531450 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.539776 12882 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:33.522254 17399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.020s	sys 0.028s
I20260709 13:08:33.540073 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:33.540258 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:33.541579 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 80201.5us
I20260709 13:08:33.545189 17153 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.545930 17238 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:33.546737 17276 consensus_meta.cc:287] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 1.524s	user 0.005s	sys 0.024s
I20260709 13:08:33.529050 17177 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.547989 17204 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.550597 17204 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.503688 17351 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.552211 17484 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:33.552850 12873 raft_consensus.cc:2368] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:33.553460 17351 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.553498 12801 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:33.554840 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.548339 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.555240 17263 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.564682 17263 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:33.567126 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 100975us
I20260709 13:08:33.555014 17238 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.561805 17333 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.573630 17333 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.574002 17333 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.563438 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2405) took 1491 ms. Trace:
I20260709 13:08:33.572669 13512 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:08:33.575431 12801 rpcz_store.cc:276] 0709 13:08:32.071782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.153917 (+ 82135us) service_pool.cc:224] Handling call
0709 13:08:32.154181 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.554806 (+1400625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.563126 (+  8320us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001a2a54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:33.563370 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3216180096}
I20260709 13:08:33.576279 13512 pending_rounds.cc:85] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Aborting all ops after (but not including) 11
I20260709 13:08:33.577003 13512 pending_rounds.cc:107] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:33.577586 13512 raft_consensus.cc:2889] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.581496 17263 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.585659 12881 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:33.586481 17286 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.587010 17286 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.588521 17458 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.590548 17458 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.590598 17286 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:33.592901 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47772.9us
W20260709 13:08:33.593277 17378 consensus_meta.cc:287] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.847s	user 0.003s	sys 0.014s
I20260709 13:08:33.593943 17378 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.543181 12806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1635) took 1260 ms. Trace:
W20260709 13:08:33.607946 17399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.020s	sys 0.029s
I20260709 13:08:33.473959 17456 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.621331 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:33.626623 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:33.608805 12806 rpcz_store.cc:276] 0709 13:08:32.283222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.318978 (+ 35756us) service_pool.cc:224] Handling call
0709 13:08:32.693577 (+374599us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5800047a98. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eaceeee 0000000000375939 00007f0f46b421e0 00007f0f46c0b0c4 00007f0f46c0b131 00007f0f46bccfc0 00007f0f46bb7929 00007f0f46bb73d2 00007f0f4012ebd4
0709 13:08:32.693815 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.694621 (+   806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.694661 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.695337 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.408413 (+713076us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:33.495115 (+ 86702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.501198 (+  6083us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.506607 (+  5409us) raft_consensus.cc:1685] finished
0709 13:08:33.506628 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.543128 (+ 36500us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2909,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":13269,"spinlock_wait_cycles":69009024,"thread_start_us":660618,"threads_started":1,"wal-append.queue_time_us":501565}
I20260709 13:08:33.634064 13514 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:33.632539 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:33.635396 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 192042us
I20260709 13:08:33.635906 13517 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:33.636195 17283 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:33.638372 17456 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.641862 12845 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:33.642844 17283 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.643260 17283 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.643590 17283 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.644433 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.646164 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.646976 17168 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.648339 17484 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.648779 17484 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:33.649148 17484 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.650580 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:33.652206 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:33.653110 12725 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.659422 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.622599 17263 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.660313 12879 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:33.660524 17263 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.661406 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.662560 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.663868 12879 raft_consensus.cc:2410] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:33.663956 17399 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.664449 17399 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:33.662930 17263 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.629994 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:33.626181 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.665216 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.665768 12801 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:33.666465 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.681341 12877 raft_consensus.cc:2393] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.670086 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.671375 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.682772 12881 raft_consensus.cc:2410] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:33.675806 17399 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.676909 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.620294 17371 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.685124 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.685312 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.685935 12876 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.686232 12879 raft_consensus.cc:2393] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.686587 17371 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.686759 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.687158 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.688102 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.689025 17204 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.689122 17435 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.690172 12699 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.690495 17399 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.691121 17204 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:33.692327 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 154362us
I20260709 13:08:33.692718 12725 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:33.693400 17276 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.693539 12773 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.691748 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.695247 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.706990 13486 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:33.707816 12876 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:33.694677 17276 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.691460 17435 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.697081 17378 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.719583 17238 raft_consensus.cc:2804] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:33.725260 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.727645 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.728861 12876 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.719400 17204 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:33.736626 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44971.7us
I20260709 13:08:33.739598 12874 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.712150 17333 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.729516 17371 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:33.727079 17238 raft_consensus.cc:697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:33.740460 17276 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.749029 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.756274 13512 raft_consensus.cc:2368] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:33.763170 17468 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:33.764318 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.764667 17468 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.765169 17468 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.765475 12881 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:33.766268 17468 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.769420 17333 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.757786 17371 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.772156 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:33.772847 12730 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.773605 17371 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:33.775063 17238 consensus_queue.cc:237] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.767810 17468 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.758558 17276 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:33.782032 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.781342 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.786482 17276 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.799335 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:33.802831 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 206109us
I20260709 13:08:33.801594 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.802397 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.806178 12876 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:33.806769 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 91671.2us
I20260709 13:08:33.808940 12848 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:33.809923 17358 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:33.811455 17351 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:33.820498 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.823576 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.853201 12881 raft_consensus.cc:3060] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.811822 17456 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.835014 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.819331 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.868072 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:33.843598 12730 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
I20260709 13:08:33.811920 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:33.870059 13486 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:33.871394 12696 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:33.834856 17408 consensus_meta.cc:287] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 13:08:33.884419 17153 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.885674 17327 raft_consensus.cc:2804] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.886327 17327 raft_consensus.cc:697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:08:33.886425 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67270.3us
I20260709 13:08:33.886929 17481 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.887697 17153 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:33.887856 17481 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:33.887527 17327 consensus_queue.cc:237] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.891168 17263 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.816929 17168 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:08:33.893407 17168 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.893723 17263 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:33.895819 12878 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:08:33.900439 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.901248 13484 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.818682 17458 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:08:33.904633 17458 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:33.907292 17289 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.907706 17289 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.908630 17289 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.910291 17333 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.911336 17289 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.869050 17450 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.912846 17450 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:33.913254 17450 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.914136 17450 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:33.825285 17484 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:33.917899 17484 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:33.820708 17460 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:33.919780 17388 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.920754 17388 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.915880 13484 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:33.838626 13487 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.700s (SENT)
I20260709 13:08:33.928416 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:33.930363 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.930073 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 118251us
I20260709 13:08:33.812336 17351 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:33.937528 13484 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:33.944929 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:33.947760 12876 raft_consensus.cc:3060] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.893844 17168 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:33.944177 17437 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:33.947646 17435 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.960009 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:33.953131 17189 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.919970 17283 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:33.958166 17333 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.952270 17408 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:33.987095 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 57999.8us
I20260709 13:08:33.960945 17437 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:33.966044 17435 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.993587 12879 raft_consensus.cc:1813] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Handling vote request from an unknown peer 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:33.994490 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 197136us
I20260709 13:08:33.995869 12879 raft_consensus.cc:2368] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14.
I20260709 13:08:33.956195 16899 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:33.996433 12881 raft_consensus.cc:2468] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:33.993160 17271 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.992857 17437 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.993120 17435 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.012784 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 123374us
I20260709 13:08:34.001838 17271 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.005715 17358 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.994234 17276 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.027357 17358 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.011009 17408 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:34.033936 12699 connection.cc:256] RPC call timeout handler was delayed by -1.5060422940000535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:08:34.036296 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.017397 17271 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.001961 17168 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:34.042258 12699 connection.cc:256] RPC call timeout handler was delayed by -1.4552744379999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:08:34.026106 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 139619us
W20260709 13:08:34.043380 12699 connection.cc:256] RPC call timeout handler was delayed by -1.3818422939999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:08:34.045765 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:34.045801 12699 connection.cc:256] RPC call timeout handler was delayed by -1.3458422940000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:08:34.046525 12699 connection.cc:256] RPC call timeout handler was delayed by -1.1504969779999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:08:34.048434 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 94077.9us
I20260709 13:08:34.052326 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:34.056296 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.036355 17270 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:34.060961 17495 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 13:08:34.064560 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.065119 17168 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.067858 17408 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.071934 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.082897 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.083864 12801 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:34.084093 12728 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:34.084873 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.085650 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.086611 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.068776 17327 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.026754 17351 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.083956 12733 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:34.097107 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.097419 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.098026 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.089032 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.092785 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.072248 17468 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.088428 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.094296 12876 raft_consensus.cc:2468] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
I20260709 13:08:34.087985 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.099629 12732 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:34.076223 17388 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.105588 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.113020 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.095364 17327 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:34.078503 17270 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.101790 17256 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.108016 12724 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:08:34.125639 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65876.6us
I20260709 13:08:34.127660 12801 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:34.131567 12725 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:34.131625 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 104785us
I20260709 13:08:34.134457 12806 raft_consensus.cc:1240] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.135251 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:34.141239 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.136407 12803 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:34.106904 17283 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.130870 17327 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.155393 12732 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.159729 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.162868 12801 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:34.169286 12730 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
W20260709 13:08:34.171495 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.172618 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.172672 12699 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.174443 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:34.176724 12881 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:34.176960 12730 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.175606 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:34.180945 17504 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:34.181501 17504 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.181967 17504 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.183517 12699 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.184690 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:34.187198 17388 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.188220 17388 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.161514 17358 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.188606 17388 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:34.190066 17388 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.190645 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:34.191475 13516 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.191721 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.192981 12728 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:34.192931 17153 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.194475 17388 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.194888 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:34.196875 12696 leader_election.cc:400] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:34.197212 12696 leader_election.cc:403] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.197852 17204 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:34.204178 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.204883 12800 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.207847 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.208467 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.209517 12806 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:34.186139 17437 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.203739 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.183686 12725 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:34.217928 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:34.220969 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.218827 12882 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:34.153281 17481 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:34.228663 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.234473 12799 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:34.234923 13516 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.235250 12800 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:34.236641 12845 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:34.237957 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.239516 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.241366 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:34.225436 17498 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
I20260709 13:08:34.246932 12805 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 15: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:34.258958 12803 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:34.263104 17437 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.268581 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:34.275130 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.276502 17198 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:34.249837 17399 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:34.290446 17399 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:34.221082 17256 consensus_queue.cc:1059] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:34.229324 17358 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:34.302990 12732 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:34.308379 12730 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.271898 17270 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:34.309543 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68329.6us
I20260709 13:08:34.309991 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.291806 17399 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.314716 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.304446 17484 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:34.304388 17468 raft_consensus.cc:2764] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:34.319340 12730 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:34.324081 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 132424us
I20260709 13:08:34.313746 17204 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.352017 12731 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:34.313550 17460 raft_consensus.cc:3055] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:34.355909 17501 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:08:34.356019 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.356828 12732 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:34.357772 17503 log.cc:927] Time spent T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:08:34.321765 17484 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.347177 17502 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:08:34.365793 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.365990 17507 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:08:34.368829 12732 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:34.362926 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.371239 12729 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:34.372648 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.369019 12727 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:34.373523 12729 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:34.367197 17518 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:34.377470 12771 leader_election.cc:400] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:34.360585 17460 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:34.362022 17484 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.381141 12771 leader_election.cc:403] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.379837 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.384876 12800 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:34.386039 17408 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.396131 12730 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:34.360447 17481 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:34.378207 17518 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:34.381641 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.421895 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.423288 12730 raft_consensus.cc:2410] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:34.425340 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.425247 17327 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.426614 17460 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:34.428493 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52226.2us
I20260709 13:08:34.422099 12729 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.431339 13512 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:34.406091 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.394929 17276 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.411767 12804 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.412830 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.414083 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.405747 17289 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.415861 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.416401 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.387493 17271 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.400264 17521 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:34.446224 12808 raft_consensus.cc:2368] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:34.447036 12803 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:34.396898 17408 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.452872 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.457653 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.457741 17518 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.459157 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.443838 17458 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:34.460999 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.428452 17460 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.465844 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 82464.1us
I20260709 13:08:34.452543 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.468292 12728 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.468918 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.470089 12730 raft_consensus.cc:2410] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:34.471642 12803 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:34.473312 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.473958 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:34.430409 17481 consensus_queue.cc:1243] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:34.482287 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.444533 17514 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:34.483004 12808 raft_consensus.cc:2376] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13. Re-sending same reply.
I20260709 13:08:34.487491 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.487412 12729 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.498771 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.482074 17198 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.504067 17198 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.504276 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.505007 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.505661 17515 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:34.502076 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 138225us
I20260709 13:08:34.504547 17198 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.505110 12726 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:34.512856 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.513485 17271 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:34.516188 12771 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:34.449290 17505 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:34.502399 12732 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.506276 17515 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.493225 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:34.464589 17519 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:34.519847 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.485898 17327 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.525558 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.527076 12799 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:34.528332 17405 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.537376 12728 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:34.539839 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.540964 12730 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.543066 12848 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:34.536319 17388 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:08:34.545111 17388 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.545019 17271 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:34.545711 17388 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:34.546834 17388 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.452564 17521 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.545523 17514 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.549783 17521 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.550192 17514 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.550413 17408 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:34.554705 17435 consensus_meta.cc:287] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:08:34.555209 17435 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.490497 17458 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:34.560962 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.562000 12728 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:34.562992 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.565675 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.570860 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.577966 12732 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:34.579783 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.589447 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.542956 17276 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.590652 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.591574 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.592308 12732 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:34.593240 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.594340 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.595603 12729 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.595623 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.598102 12732 raft_consensus.cc:2410] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:34.601652 12731 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:34.604471 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.610141 12729 raft_consensus.cc:1240] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.612686 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:34.613101 17526 log.cc:927] Time spent T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:08:34.614198 17198 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.584904 16899 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:34.623479 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.626112 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.629521 12730 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.635134 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.638409 12730 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.623580 12808 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:34.647439 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.597515 17276 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.657095 12728 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.659613 12800 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:08:34.660989 12730 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:34.617805 17517 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:34.596215 17271 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:34.686223 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.699093 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.617908 17529 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:34.711992 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.720901 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:34.721252 17456 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:34.721844 17456 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:34.722776 17456 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.732920 17283 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.733668 17518 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:34.735438 17504 consensus_meta.cc:287] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:08:34.618472 17177 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:08:34.618990 17198 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:34.674772 17276 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.737378 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 140603us
I20260709 13:08:34.697566 17388 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.750872 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 142888us
I20260709 13:08:34.680102 16899 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:34.754460 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:34.754619 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.754768 12728 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.755964 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:34.655573 17286 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:08:34.706774 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.675686 17484 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.760833 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.759644 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.773229 17198 consensus_queue.cc:1059] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.774768 17198 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.775147 17198 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:34.713874 17271 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.778394 17271 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:34.780331 16899 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.781556 17484 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.782444 12727 raft_consensus.cc:2393] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:34.738168 17529 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:34.763614 12728 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
W20260709 13:08:34.788604 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.735878 17504 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.757169 17351 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:34.733739 17283 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.806594 12724 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:34.802235 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 322147us
I20260709 13:08:34.818297 12725 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 15: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:34.819849 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69208.2us
W20260709 13:08:34.823755 12699 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.950s (SENT)
I20260709 13:08:34.827888 13512 raft_consensus.cc:1240] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.829083 12724 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:34.829967 12728 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.830963 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:34.832893 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46394.7us
I20260709 13:08:34.799755 17528 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:34.829473 12724 pending_rounds.cc:85] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 6
I20260709 13:08:34.790963 17198 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.837018 17435 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:34.878000 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54910.4us
I20260709 13:08:34.878687 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.880187 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.838028 12724 pending_rounds.cc:107] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:34.884637 12724 raft_consensus.cc:2889] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.869293 12728 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:34.862424 12725 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:34.845248 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:34.887176 12730 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.886150 12699 leader_election.cc:400] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
W20260709 13:08:34.895888 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.887692 12728 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:34.907023 12728 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:34.887692 12699 leader_election.cc:403] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.912582 12728 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.912933 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.913534 12803 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.914333 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.914908 12808 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.914866 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:34.898191 12773 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:34.846105 17450 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:34.949071 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 430798us
I20260709 13:08:34.909876 17518 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.910228 17263 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.846426 17456 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.922677 12725 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:08:34.968604 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 132072us
W20260709 13:08:34.948374 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69557.9us
I20260709 13:08:34.951601 12730 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:34.869980 17515 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.869787 17504 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:34.863817 17198 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.863409 17459 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:08:34.865952 17276 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:34.965727 17263 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:34.957683 12727 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:34.983258 17263 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.985148 17283 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:34.991807 17168 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:34.841769 17529 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:34.973834 17530 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.992025 12799 raft_consensus.cc:2410] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:35.006040 12731 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: [10.6-13.8]
I20260709 13:08:35.009830 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:35.011502 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:34.994390 12728 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:34.995030 12725 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: [10.6-13.8]
I20260709 13:08:34.970300 12730 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:08:34.974531 12726 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.974678 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:34.979780 17522 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.479s	user 0.000s	sys 0.003s
I20260709 13:08:35.003938 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:34.922014 17484 consensus_queue.cc:1059] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:35.027244 12803 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:35.017105 12808 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:34.967190 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:35.026077 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 128011us
I20260709 13:08:35.032892 12802 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:08:35.031553 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 64690.8us
I20260709 13:08:35.035374 12771 leader_election.cc:400] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14.
I20260709 13:08:35.035729 12771 leader_election.cc:403] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:35.035501 12847 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.046299 12728 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.995113 17276 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.048604 17405 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.049281 17405 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.051431 17405 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.053395 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.057041 17333 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.059486 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.060637 17459 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:35.061299 17459 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.062309 17459 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.062920 12728 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:35.063439 17435 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:35.063946 17435 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.003770 17530 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:35.066413 17289 raft_consensus.cc:3055] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:35.066921 17289 raft_consensus.cc:740] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:34.992317 17168 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:35.004213 17458 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:35.028245 17537 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.077353 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:35.058295 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:35.093282 12773 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.070853 13484 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.101663 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.098450 12847 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.106462 17276 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.106815 17508 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.108556 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.109285 12731 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:35.109753 12731 pending_rounds.cc:85] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 6
I20260709 13:08:35.110191 12731 pending_rounds.cc:107] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:35.110265 17371 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.110708 12731 raft_consensus.cc:2889] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.111596 17388 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.112879 17289 consensus_queue.cc:260] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:35.109798 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:35.115206 17276 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:35.099295 17521 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.115859 17276 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:35.067158 17530 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.116704 17168 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.115887 17519 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.118136 17168 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.065145 17435 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.116855 17276 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.091732 17327 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:35.124163 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:35.125429 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.126151 12733 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:35.126323 17539 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.128201 12733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52116 (request call id 1645) took 1040 ms. Trace:
I20260709 13:08:35.128641 12733 rpcz_store.cc:276] 0709 13:08:34.087383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.096829 (+  9446us) service_pool.cc:224] Handling call
0709 13:08:35.127970 (+1031141us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400246654. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:35.128136 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364833536}
I20260709 13:08:35.123826 17351 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:35.133812 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 159251us
I20260709 13:08:35.134658 17539 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.135097 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:35.147617 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.135901 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1647) took 1047 ms. Trace:
W20260709 13:08:35.103554 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45396.1us
W20260709 13:08:35.146967 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 111701us
I20260709 13:08:35.149901 12848 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:35.149960 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.148146 12729 rpcz_store.cc:276] 0709 13:08:34.088027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.611212 (+523185us) service_pool.cc:224] Handling call
0709 13:08:34.613939 (+  2727us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:34.730915 (+116976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.730959 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:34.731731 (+   772us) log.cc:844] Serialized 52 byte log entry
0709 13:08:34.905732 (+174001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:34.963916 (+ 58184us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.064867 (+100951us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18003f2560. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f3eb08a40 00007f0f3eb034e4 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287 00007f0f41c0e208
0709 13:08:35.065308 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.065517 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.095707 (+ 30190us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400245c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:35.095826 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.133139 (+ 37313us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b18003f2560. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ea80c0a 00007f0f481c0219 00007f0f45ac758f 00007f0f3eb06571 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd
0709 13:08:35.135664 (+  2525us) raft_consensus.cc:1685] finished
0709 13:08:35.135684 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.135839 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28728,"prepare.queue_time_us":61674,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":1521,"raft.queue_time_us":122969,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":4779,"spinlock_wait_cycles":284356480,"thread_start_us":173412,"threads_started":1,"wal-append.queue_time_us":335530}
I20260709 13:08:35.152498 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.077344 17263 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.174196 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48844.5us
W20260709 13:08:35.162813 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.184751 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:35.152796 17283 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.191408 12804 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:35.152153 17351 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.194036 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.190657 17529 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.183727 17521 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.173786 17518 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:35.186098 17537 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:35.201370 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66359.6us
I20260709 13:08:35.204725 12699 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.195416 17529 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.188515 17505 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:35.217561 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.191471 17283 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:35.221351 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:35.222966 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 154811us
I20260709 13:08:35.203209 17519 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:35.231281 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:35.232911 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:35.191066 17528 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:35.241812 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.241881 12882 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:35.216171 17529 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:35.242935 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53427.7us
I20260709 13:08:35.248924 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.248970 12879 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:35.218711 17537 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.252844 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.255597 12876 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:35.235229 17450 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:35.261096 12699 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.231066 17283 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.265725 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:35.267735 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:35.238035 17505 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:35.279441 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:35.281168 13487 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.239575 17518 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:35.292347 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:35.296414 12730 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.275794 17450 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.284686 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:35.299223 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.306304 12879 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:35.299991 17481 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.284492 17371 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.285221 16899 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.293289 17508 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:35.295472 17327 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:35.316565 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74581.1us
I20260709 13:08:35.310200 13487 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.321040 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.326066 17549 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.328217 13487 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.329728 17549 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:35.304406 17450 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.279878 17276 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:35.307896 17460 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.348608 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.349772 12730 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:35.350061 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.356814 12847 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:35.358259 17551 log.cc:927] Time spent T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:08:35.362637 17552 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:08:35.364632 17460 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.368983 17550 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:35.371662 17528 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.372255 17528 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:35.372763 17553 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:35.375970 12847 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.373195 17528 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.379122 17528 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.382612 17505 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.383841 17263 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.359640 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2202) took 1082 ms. Trace:
I20260709 13:08:35.336452 17518 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.388525 12724 rpcz_store.cc:276] 0709 13:08:34.277579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.912170 (+634591us) service_pool.cc:224] Handling call
0709 13:08:34.912530 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.920230 (+  7700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.920253 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.951503 (+ 31250us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.093470 (+141967us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:35.093520 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.093595 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.359373 (+265778us) raft_consensus.cc:1685] finished
0709 13:08:35.359405 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.359572 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":98569,"threads_started":1,"wal-append.queue_time_us":213876}
W20260709 13:08:35.392707 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 142322us
I20260709 13:08:35.397401 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.399061 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.355829 17560 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.413147 17560 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.413434 17537 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.415540 17560 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.354753 17508 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:08:35.416872 17554 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:35.416967 17508 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:35.363801 17276 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:35.419188 16899 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.351205 17270 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:35.392613 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 123313us
W20260709 13:08:35.421751 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.301028 17351 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.412722 17481 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:35.516571 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.571614 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 149358us
I20260709 13:08:35.572770 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.419745 17561 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.600183 17168 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.423277 16899 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:35.432603 17286 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.425983 17204 raft_consensus.cc:2764] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:08:35.424275 17518 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.419369 17276 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:35.593405 17561 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:35.426644 17450 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.615375 17567 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.627898 17565 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:35.628017 17518 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.616225 16899 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.625429 17286 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:35.650256 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.623921 17529 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:35.684207 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.659906 17388 consensus_meta.cc:287] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:08:35.657379 17204 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.693590 12728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.047s
I20260709 13:08:35.654776 17565 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.631918 17567 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.697078 12728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.007s	sys 0.047s
I20260709 13:08:35.716902 12800 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:35.719967 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:35.720629 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 344731us
I20260709 13:08:35.723053 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.724786 17450 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:35.726290 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.743005 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:35.710320 17388 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14.
I20260709 13:08:35.745960 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:35.751471 12802 raft_consensus.cc:2393] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:35.753044 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:35.719854 17568 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.758116 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.755815 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:35.756884 17569 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:35.757184 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.760829 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:35.707463 17204 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.762233 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:35.740645 17504 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:35.773682 17566 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:08:35.773885 17204 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.762537 17263 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.761936 17286 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.780396 17565 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.783026 17521 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.002s
I20260709 13:08:35.783752 17521 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.691702 17561 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.796981 17521 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.797712 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.798220 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.798031 17521 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.760718 17562 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:35.792646 17263 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:35.805951 17204 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.802357 17481 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:35.812971 17351 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:35.763345 17568 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.813791 17561 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.818188 17276 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:35.837657 17564 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:08:35.848822 17351 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.832959 17560 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:35.853914 17569 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:35.838963 17481 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.865471 12771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.048s
I20260709 13:08:35.874173 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.837450 17204 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:35.885797 12771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.048s
I20260709 13:08:35.887591 12771 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
W20260709 13:08:35.893669 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 76502.7us
I20260709 13:08:35.893677 17560 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.906155 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:35.863032 17529 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:35.874009 17276 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.918893 12771 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:35.873719 17388 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:35.904892 17283 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
I20260709 13:08:35.925279 17567 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.925220 17388 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.928627 17567 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.926180 17283 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.925467 17276 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.916487 17484 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.941972 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:35.922538 17573 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.935366 17584 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.936558 17579 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:35.933090 17578 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:35.944015 17529 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.958448 17572 log.cc:927] Time spent T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:35.963766 17539 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:35.964349 17539 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:35.920686 17263 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.967986 12727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2213) took 1687 ms. Trace:
I20260709 13:08:35.952682 17283 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:35.985486 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 228149us
W20260709 13:08:35.984402 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 65548.6us
I20260709 13:08:35.997323 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:35.976464 12727 rpcz_store.cc:276] 0709 13:08:34.280762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.983828 (+703066us) service_pool.cc:224] Handling call
0709 13:08:35.013853 (+ 30025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.066804 (+ 52951us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:35.222384 (+155580us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.421828 (+199444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.422362 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.422505 (+   143us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:35.425014 (+  2509us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.726120 (+301106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.726234 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.966414 (+240180us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18002447e0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb06522 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:35.967735 (+  1321us) raft_consensus.cc:1685] finished
0709 13:08:35.967762 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.967913 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254596,"prepare.queue_time_us":34309,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":123,"raft.queue_time_us":215392,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":165567,"spinlock_wait_cycles":4989184,"thread_start_us":425691,"threads_started":3,"wal-append.queue_time_us":385703}
I20260709 13:08:35.977008 17562 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.001490 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:36.005041 16899 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.007761 16899 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.012494 17578 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.013217 17578 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:36.014070 17576 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260709 13:08:36.016053 17574 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:08:35.957087 17529 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.020541 17568 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.952600 17569 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.021293 17529 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.015956 17578 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.003360 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.023535 17204 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:35.948885 17351 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.034446 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.038549 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.041841 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:35.956331 17584 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:35.955899 17579 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:36.061249 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:36.062410 12808 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.063455 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:36.029896 17562 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.067734 12808 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.100602 12804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1693) took 1217 ms. Trace:
I20260709 13:08:36.098384 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:36.102290 12804 rpcz_store.cc:276] 0709 13:08:34.883307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.000271 (+116964us) service_pool.cc:224] Handling call
0709 13:08:35.000544 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:35.194444 (+193900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.100366 (+905922us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002b34d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:36.100546 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438535552}
I20260709 13:08:36.065528 17529 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:36.097462 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.072176 12805 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:36.066985 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.108062 17593 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:36.065599 17594 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.098977 17286 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:36.071719 17560 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.108716 17593 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.109025 17562 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.109323 17286 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.111411 17593 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.112231 17568 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.113986 17569 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:36.114566 17569 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:36.115028 17569 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.093621 17505 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.109181 17594 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.117913 17578 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.118278 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1683) took 1238 ms. Trace:
I20260709 13:08:36.119273 17594 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:36.122977 17583 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 13:08:36.111685 17286 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:36.066625 16899 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:36.117547 17505 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:36.140218 17270 consensus_meta.cc:287] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.006s
I20260709 13:08:36.141741 17579 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:36.145713 17276 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.104446 17537 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:36.171275 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.164624 12724 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:36.172003 12730 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:36.172091 12729 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:36.150484 17584 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.156802 12728 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:36.166684 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.169560 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.173571 12726 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.166348 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.175045 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.168135 17270 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.167016 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.175724 12733 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:36.164429 17573 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.182266 12725 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.182255 17573 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.184958 17573 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.177500 17505 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.167950 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.206202 12731 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.181582 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.176342 16899 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:36.164064 17504 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:36.189332 17558 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.770s	user 0.000s	sys 0.012s
I20260709 13:08:36.175606 17537 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:36.209196 17537 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:36.118623 12807 rpcz_store.cc:276] 0709 13:08:34.879897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.880016 (+   119us) service_pool.cc:224] Handling call
0709 13:08:34.922271 (+ 42255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.922481 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.922502 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.965899 (+ 43397us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.155246 (+189347us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:35.192595 (+ 37349us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.117591 (+924996us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b180047b840. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f4179b4bc 00007f0f3eae948b 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f41beb060 00007f0f41bfd716 00007f0f41c0e287
0709 13:08:36.117735 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.117836 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.117877 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:36.117967 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.118103 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33562,"prepare.queue_time_us":34706,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1804,"raft.queue_time_us":41657,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7653,"spinlock_wait_cycles":12190592,"thread_start_us":230252,"threads_started":2,"wal-append.queue_time_us":278617}
I20260709 13:08:36.193819 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.210646 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.211230 12733 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.194205 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.196585 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.196779 12727 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:36.187811 17556 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.774s	user 0.005s	sys 0.018s
I20260709 13:08:36.212859 12732 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:36.210191 17537 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:36.207470 12728 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:08:36.212705 12725 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:36.214002 17537 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:36.210395 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.215138 16899 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.067430 17591 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:08:36.211359 12726 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:36.221563 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:36.221778 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 122954us
I20260709 13:08:36.222695 12729 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:36.210788 17198 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.232867 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.233554 12729 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
W20260709 13:08:36.229732 17459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.007s	sys 0.016s
I20260709 13:08:36.205407 17569 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.237123 17601 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:36.246556 17289 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.246845 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.232678 17177 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:36.250377 12725 raft_consensus.cc:2393] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:36.240965 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.250401 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.252875 12876 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:36.241695 17459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.007s	sys 0.017s
I20260709 13:08:36.254375 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:36.223649 17504 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.256455 12877 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:36.260010 12731 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.249085 17584 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:36.263584 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.267246 17530 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:36.261967 17270 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.267671 17530 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.268234 17270 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:36.268841 17530 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.268968 17270 raft_consensus.cc:3060] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.237005 17198 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.271822 17198 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.274624 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.274322 17539 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.275578 17539 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:36.276188 17515 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.276656 17515 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.277088 17515 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.240993 17351 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:36.280941 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.285287 17569 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.286211 12630 catalog_manager.cc:5697] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 12 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.289543 17460 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.290659 12630 catalog_manager.cc:5697] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 11, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 11 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:36.295358 17519 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.295953 17519 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:36.298593 17573 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.299171 17573 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.304661 17521 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.305907 13518 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:36.309954 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:36.311600 17591 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.312091 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46358.8us
I20260709 13:08:36.312175 17591 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.312966 17388 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.313521 17388 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.313966 17388 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.314602 12879 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:36.314988 17569 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:36.315614 17569 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:36.275504 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:36.315958 12874 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:36.322808 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:36.323773 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.315896 17388 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:36.324748 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49309.4us
I20260709 13:08:36.325656 12881 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:36.334554 17606 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:36.335031 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.329299 17521 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.337608 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:36.338177 17505 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.337915 17530 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.338790 17505 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.339506 17388 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:36.341988 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.331199 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.240768 17405 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:08:36.344704 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.347265 17521 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.347877 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.321725 17569 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.349294 12874 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:36.321046 17460 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.344241 17530 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.349733 17521 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.351562 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.355300 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.358011 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.358320 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.347451 17204 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.376607 12880 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:36.362879 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.356266 17539 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.378741 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.355654 17276 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:36.378363 17539 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.380625 17204 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.381397 17539 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.377281 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.356660 17521 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.352567 17460 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.385897 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.389397 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.389992 12876 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:36.343667 17565 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:36.395761 12875 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:36.396978 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.362275 17528 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:36.397574 12879 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.361969 17530 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.398262 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.404842 17611 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.376607 17484 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.405072 12630 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 9 to 10, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:36.407871 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.408280 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.408631 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.384730 17481 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.409057 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.418721 12881 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:36.410355 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.415181 17484 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.399639 17388 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.423923 17591 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.424177 17504 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.424577 17204 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.424604 17573 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.427400 17484 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.400208 17528 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.428653 17528 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.409865 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.410928 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.442381 12876 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:36.411381 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.411804 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.411975 17561 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.412209 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.384927 17579 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.458905 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.408481 17270 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.415849 12875 raft_consensus.cc:2410] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:36.383198 17505 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.440500 12630 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 4 to 8, term changed from 10 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted, no longer has a pending config: VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2), VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:36.454864 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45064.4us
I20260709 13:08:36.444025 12878 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.457854 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.406571 17530 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.424243 17388 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.466082 12773 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.467276 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.400074 17515 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.474351 12876 raft_consensus.cc:2410] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:08:36.459120 17579 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.501374 17579 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.459156 17561 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.505223 17561 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.478477 17568 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.505759 17568 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.506155 17568 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.464335 17591 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:36.478984 17263 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.480243 12801 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:36.515173 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.515425 17263 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.516396 12801 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:36.515872 12876 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:36.517817 17263 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.480636 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.481493 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.482245 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.520480 12806 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:36.482939 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.483572 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.521891 12802 raft_consensus.cc:2410] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:36.484426 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.522858 12805 raft_consensus.cc:2393] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.485536 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.523594 12804 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:36.486217 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.524549 12803 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:36.520017 17519 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.526903 17568 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.495837 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.528429 12807 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.471675 17388 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.529213 17568 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.463498 17481 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.472568 12630 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:36.536495 12630 catalog_manager.cc:5697] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 12 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:36.537397 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 106896us
I20260709 13:08:36.538231 12630 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 8, term changed from 11 to 13, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to <none>, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 13 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:36.478756 17371 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:36.540683 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.541342 12724 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.539906 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.542542 12727 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:36.470600 17530 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.440323 17611 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.543772 12879 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:36.545656 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:36.546732 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.546121 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 53031.3us
I20260709 13:08:36.543111 12630 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 11 to 12, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:36.551187 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.556639 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.554224 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.557267 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.535392 17515 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.560957 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.565856 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.566459 12727 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.562795 12728 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:36.541126 17591 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:36.548952 17484 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.545848 17562 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.546222 17189 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:36.584416 17189 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:36.584813 17189 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:36.585709 17189 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:36.586862 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.587033 17189 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.571892 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.589648 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.589841 17578 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.590340 17578 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.590690 17578 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.572120 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.592180 17276 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.592628 17276 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.592881 12725 raft_consensus.cc:2393] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:36.593073 17276 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.596150 17484 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.598443 17484 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.548794 17371 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.603914 17371 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:36.604506 17562 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.606742 17562 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:36.607888 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:36.607996 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:36.610646 17578 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.576929 17270 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:36.579402 17611 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.580413 17519 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.580639 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:36.568900 17573 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.575260 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.634640 12729 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.546020 17481 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.575407 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.562794 17460 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:36.629791 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.631942 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.642763 12876 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:36.628518 12727 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:36.664743 17388 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.667268 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.668596 12726 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:36.669133 12629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 193) took 22725 ms (client timeout 15000 ms). Trace:
I20260709 13:08:36.642594 17573 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.671281 17573 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.671499 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.694005 17521 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.699441 17388 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.699687 17481 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.701763 17539 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.702881 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.703353 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.703707 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.702657 17276 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.704368 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.742624 12881 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.704833 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.706555 12729 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:36.710500 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.713337 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.715085 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.717064 17578 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.718114 12724 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:36.676748 17591 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.756357 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:36.736564 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 185420us
I20260709 13:08:36.710556 17590 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.570542 17610 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 13:08:36.663640 17569 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:36.720518 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53335.8us
I20260709 13:08:36.766047 12696 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:36.732553 17519 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:36.773725 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:36.758190 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.778227 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.780431 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.786435 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.787706 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:36.802773 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44647.3us
I20260709 13:08:36.803323 12696 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.804345 12805 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:36.804893 12696 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.803535 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.806996 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.807742 12873 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14.
I20260709 13:08:36.807618 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:36.808372 12805 raft_consensus.cc:2393] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.759382 17515 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.811721 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.811936 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:36.812424 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.812839 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.813539 12876 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14.
I20260709 13:08:36.814527 12875 raft_consensus.cc:1275] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:36.813158 12729 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:36.752012 17481 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:36.819689 12800 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.820693 12877 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:36.821604 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.821967 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:36.814610 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:36.816195 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.822937 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.823458 12806 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:36.824371 12878 raft_consensus.cc:1275] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:36.824795 12729 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:36.824617 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.826927 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.830507 12808 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:36.832351 12727 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:36.669543 12629 rpcz_store.cc:269] 0709 13:08:13.843406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.843629 (+   223us) service_pool.cc:224] Handling call
0709 13:08:13.965565 (+121936us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b54001c0610. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3eaceb71 00007f0f3eacf0b2 00007f0f47a48a89 00007f0f479e0da6 00007f0f479b2088 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc
0709 13:08:36.568245 (+22602680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:33.640313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:33.641066 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:33.641129 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:08:33.641164 (+    35us) tablet.cc:662] Decoding operations
0709 13:08:33.642893 (+  1729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:33.642981 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:33.643010 (+    29us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:08:33.693842 (+ 50832us) tablet.cc:701] Row locks acquired
0709 13:08:33.693904 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:08:33.694064 (+   160us) write_op.cc:270] Start()
0709 13:08:33.694232 (+   168us) write_op.cc:276] Timestamp: P: 1783602513694001 usec, L: 0
0709 13:08:33.694279 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:08:33.731759 (+ 37480us) log.cc:844] Serialized 8413 byte log entry
0709 13:08:34.358425 (+626666us) op_driver.cc:464] REPLICATION: finished
0709 13:08:34.590279 (+231854us) write_op.cc:301] APPLY: starting
0709 13:08:34.590431 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:34.635777 (+ 45346us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:34.635967 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:35.005535 (+369568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:35.005957 (+   422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:08:35.006035 (+    78us) write_op.cc:312] APPLY: finished
0709 13:08:35.006607 (+   572us) log.cc:844] Serialized 187 byte log entry
0709 13:08:35.006808 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:35.007010 (+   202us) write_op.cc:454] Released schema lock
0709 13:08:35.007103 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:35.043294 (+ 36191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:35.043334 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30219,"reported_tablets":48,"spinlock_wait_cycles":5856000,"child_traces":[["op",{"apply.queue_time_us":184812,"apply.run_cpu_time_us":35525,"apply.run_wall_time_us":436310,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":255921,"prepare.run_cpu_time_us":42904,"prepare.run_wall_time_us":282445,"raft.queue_time_us":229887,"raft.run_cpu_time_us":24849,"raft.run_wall_time_us":172417,"replication_time_us":642513,"thread_start_us":508365,"threads_started":4,"wal-append.queue_time_us":223262,"wal-append.run_cpu_time_us":34036,"wal-append.run_wall_time_us":2048933}]]}
I20260709 13:08:36.828413 12802 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:36.823362 12805 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:36.759409 17611 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.833534 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.828007 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.834880 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:36.837424 12804 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:36.831632 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.838822 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.839622 12731 raft_consensus.cc:2393] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.739589 17528 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.836095 13484 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for earlier term 13. Current term is 14.
I20260709 13:08:36.838269 17562 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.845176 17562 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.832320 17515 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.838490 17371 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.819932 17289 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:36.847920 12873 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:36.844775 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.817405 17460 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:36.813486 17204 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.806035 16899 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:36.813732 17505 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.820425 17484 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.849254 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:36.849766 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.817958 17504 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:36.850975 12804 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:36.853530 17561 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:36.844818 17621 log.cc:927] Time spent T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:36.856384 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:36.857213 12724 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:08:36.863919 12881 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:36.865937 12728 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:36.933830 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:36.934118 12728 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:36.871373 12729 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:36.871783 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:36.801667 17590 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.943034 17590 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.876149 12808 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:36.873780 17481 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:36.943460 17610 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.943929 17481 consensus_queue.cc:1243] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 14.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:36.878510 17263 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.872956 17578 consensus_queue.cc:1059] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:08:36.833262 17593 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.945559 17561 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.946290 17405 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.880602 17521 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.881603 12806 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:36.880702 12802 raft_consensus.cc:1240] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:36.882409 17562 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.870582 17289 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:36.883540 12726 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:36.948062 17289 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:36.888960 17573 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.805794 17584 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:08:36.874490 17529 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:36.891884 12805 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:36.951578 17573 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:36.951778 17584 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:36.848402 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:36.952216 17584 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:36.945434 17578 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:36.952458 12876 raft_consensus.cc:606] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:36.952829 17578 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:36.953613 12730 raft_consensus.cc:2368] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13.
I20260709 13:08:36.953132 17584 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.953732 17530 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.927592 17568 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.939090 17536 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:36.939908 17177 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:36.939958 17459 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:36.940280 17327 consensus_queue.cc:1048] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:36.946199 17595 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.945960 17593 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.914433 17270 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:36.913861 17504 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.952984 12876 raft_consensus.cc:614] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:36.953903 17578 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:36.946589 12799 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:36.907238 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:36.873844 17460 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:36.907868 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:37.009009 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 101218us
I20260709 13:08:36.935745 12728 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:36.964689 12733 raft_consensus.cc:2468] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:36.986650 12727 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:37.010313 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:36.914312 12803 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:37.011142 12727 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:36.867326 17594 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:08:37.012733 12727 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:36.912107 17505 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.945515 17515 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.010936 12733 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:36.955386 17568 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.019793 17611 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:37.022223 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 115089us
I20260709 13:08:36.933169 17585 consensus_queue.cc:1048] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:08:37.024201 12727 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:37.006433 17504 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:37.031553 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 97798.9us
I20260709 13:08:37.032320 17611 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.944149 17610 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:36.945333 17571 consensus_queue.cc:1059] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:08:37.006402 17519 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:37.020609 17584 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.025527 17505 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.043462 12733 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:37.038848 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.040946 17611 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:37.061303 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 246736us
I20260709 13:08:37.035499 17204 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.034061 17177 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.084465 17177 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.085609 17177 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.086802 17177 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.062903 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.089206 12847 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:37.090323 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:37.090517 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.091034 12805 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.095885 17286 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.040645 17351 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.039868 17539 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.063467 17530 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.077781 17568 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.078388 17578 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.081033 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:37.069519 17595 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.136083 12733 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 11.
I20260709 13:08:37.091755 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.071682 17601 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.121687 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:37.134158 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 315075us
I20260709 13:08:37.139489 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.145344 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.095957 17565 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.151089 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: a865487bf1854df8a5619d42465bb36c
I20260709 13:08:37.117271 17351 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.116925 17515 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.153309 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 61649.2us
I20260709 13:08:37.142879 17595 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.125805 17270 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:37.195562 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44622.7us
I20260709 13:08:37.196568 12847 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.156890 17536 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.046970 17460 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.171031 17351 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.155546 17568 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.158118 17530 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.218492 12805 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:37.219591 12771 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.215363 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.229946 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:37.199949 17539 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.238204 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.216780 17270 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:37.243225 17629 log.cc:927] Time spent T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:08:37.245107 17636 log.cc:927] Time spent T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:08:37.244901 17289 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.246313 17569 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:37.248781 17594 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.249692 17560 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.274042 12729 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:37.252825 17579 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.000s
I20260709 13:08:37.254400 12847 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.275135 17579 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.275483 17610 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:37.175253 17519 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.277520 17579 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.278439 12847 leader_election.cc:400] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13.
I20260709 13:08:37.234977 17530 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:37.198143 17628 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.226522 17600 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:37.260597 17641 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.265529 17529 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:37.272449 17289 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.255265 17639 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.257519 17595 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.280422 12847 leader_election.cc:403] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:08:37.296175 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.176765 17515 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.259248 17586 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:37.281507 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 142129us
I20260709 13:08:37.262440 17270 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.286298 17569 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:37.282147 17198 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:37.298308 17628 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:37.281241 17637 raft_consensus.cc:2804] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.299129 17586 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.287771 17565 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:37.301321 17595 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.302834 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.259397 17539 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.296569 17600 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.284296 17536 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:37.309026 17586 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.287395 17640 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:37.288866 17530 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.317332 17641 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.317479 17637 raft_consensus.cc:697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.332471 17628 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:37.333631 17637 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.295780 17594 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.328253 17634 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.335651 17634 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.337855 17634 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.318316 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.318228 17460 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.340415 12696 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:37.341318 17484 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.342094 17484 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.342177 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.342579 17484 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:37.343039 17484 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.343782 17645 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.314114 17639 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:08:37.287701 17286 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:37.350247 17586 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:37.284019 17504 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.334935 17594 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.352689 17484 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.353578 17504 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.353632 17594 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.354813 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.310364 17177 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.362178 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:37.369395 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.372962 17643 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.373875 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.374895 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.375581 12732 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.382097 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.385349 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:37.370056 17504 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.390460 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.395910 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.400988 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.364126 17611 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.410192 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.415707 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.404568 17484 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.429318 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.424753 17529 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.425268 17586 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.425865 17634 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.455461 12732 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:37.459798 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:37.463284 12807 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:37.455444 17591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.017s	sys 0.029s
I20260709 13:08:37.469117 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.470623 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.408710 17600 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.477092 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:37.466858 17591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.018s	sys 0.030s
I20260709 13:08:37.465164 17634 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.490341 17528 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.494004 17515 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.497697 17204 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.498390 17204 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:37.509305 17635 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.393s	user 0.000s	sys 0.003s
I20260709 13:08:37.473117 17530 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:37.461491 17529 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.525352 17634 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:37.526044 17615 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.665s	user 0.000s	sys 0.004s
I20260709 13:08:37.527400 17611 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.530248 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.531255 12724 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.540282 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2410) took 1126 ms. Trace:
I20260709 13:08:37.485890 17539 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.546864 12801 raft_consensus.cc:1240] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:37.540729 12882 rpcz_store.cc:276] 0709 13:08:36.413587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.437462 (+ 23875us) service_pool.cc:224] Handling call
0709 13:08:36.437751 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.438186 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.438231 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.439127 (+   896us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.570278 (+131151us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:36.570318 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.570397 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.525349 (+954952us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:37.539007 (+ 13658us) raft_consensus.cc:1685] finished
0709 13:08:37.539032 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.540204 (+  1172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3250,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14667,"spinlock_wait_cycles":16325120,"thread_start_us":102145,"threads_started":1,"wal-append.queue_time_us":299172}
I20260709 13:08:37.546727 12799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45496 (request call id 2435) took 1068 ms. Trace:
I20260709 13:08:37.558166 12799 rpcz_store.cc:276] 0709 13:08:36.478731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.481189 (+  2458us) service_pool.cc:224] Handling call
0709 13:08:37.546433 (+1065244us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540028d554. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:37.546658 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979759104}
I20260709 13:08:37.489073 17505 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.582684 17611 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.600389 12726 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:37.601226 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.603165 12724 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:37.604211 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.606600 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.608024 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.608373 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.609335 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.608500 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:37.610687 12726 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:37.616467 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.618378 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.619715 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.607256 17351 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.621719 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.623025 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:37.626894 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.631026 12728 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:08:37.638679 12728 pending_rounds.cc:85] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 5
I20260709 13:08:37.638913 12728 pending_rounds.cc:107] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:08:37.639158 12728 raft_consensus.cc:2889] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.632884 17504 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.635993 17601 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:37.638231 17651 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:37.640563 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:37.645406 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.737828 12882 raft_consensus.cc:606] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:37.623809 17351 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:37.750949 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.751720 12726 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.605181 17611 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:37.759114 12728 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:37.761982 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.762823 12724 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.641078 17601 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.769484 17640 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:37.802692 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:37.756956 17504 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:37.810702 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:37.810228 12732 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:37.808113 12724 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:37.808452 12803 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:37.816078 12724 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:37.816255 12726 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:37.818125 12804 raft_consensus.cc:2368] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:37.796469 17578 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:37.818789 12725 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:37.819845 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:37.776391 17351 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:37.834574 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:37.835434 12802 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.810971 17204 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.821235 17529 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.847599 12803 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.814723 17198 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:37.857931 17204 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:37.858929 17198 consensus_queue.cc:1243] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:37.859532 17198 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.859872 17198 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.860363 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.861169 12881 raft_consensus.cc:2368] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:37.860819 17198 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.861901 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.862103 12808 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.862258 17198 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.863762 17611 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:37.815721 17435 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:37.817728 17565 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:37.832247 17460 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.836962 17630 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:37.817163 17504 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:37.870051 12699 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.78.2:36791 timed out after 1.550s (SENT) [suppressed 10 similar messages]
I20260709 13:08:37.875909 12803 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:08:37.879567 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:37.829474 17578 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.863907 12808 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.871774 17584 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:37.910423 12803 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:37.913154 12800 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:08:37.892597 17177 consensus_meta.cc:287] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.001s
I20260709 13:08:37.914965 12802 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:37.891017 17586 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:37.898341 17286 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:37.892771 17595 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:37.935910 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 65908us
W20260709 13:08:37.946424 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.898586 17536 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:37.941004 17177 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13.
W20260709 13:08:37.956525 17270 consensus_meta.cc:287] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.005s
W20260709 13:08:37.964285 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 70967.9us
I20260709 13:08:37.951224 17286 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:37.969261 12696 leader_election.cc:400] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:37.969622 12696 leader_election.cc:403] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.935109 17584 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:37.943903 17586 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:37.950140 17595 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:37.958170 17565 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:37.981173 17595 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:37.973527 17611 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.972779 17177 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:37.990094 17504 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:37.991786 12729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1697) took 1149 ms. Trace:
I20260709 13:08:37.993185 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:37.994326 17584 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:37.995831 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1712) took 1195 ms. Trace:
I20260709 13:08:38.012154 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:37.969663 17270 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:37.997820 17586 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.003096 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:38.008008 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.008603 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.008154 12729 rpcz_store.cc:276] 0709 13:08:36.842010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.936538 (+ 94528us) service_pool.cc:224] Handling call
0709 13:08:36.936906 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.274656 (+337750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.991498 (+716842us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400063954. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:37.991686 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774706048}
I20260709 13:08:38.010782 13518 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:38.011301 12803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:38.012393 12801 rpcz_store.cc:276] 0709 13:08:36.800458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.800622 (+   164us) service_pool.cc:224] Handling call
0709 13:08:37.546636 (+746014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.547450 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.995623 (+448173us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540028d550. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:37.995769 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714691328}
I20260709 13:08:38.009572 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.014213 12803 raft_consensus.cc:606] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:38.013878 13518 pending_rounds.cc:85] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Aborting all ops after (but not including) 10
I20260709 13:08:38.014699 12803 raft_consensus.cc:614] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.014823 13518 pending_rounds.cc:107] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:38.016098 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.016472 13518 raft_consensus.cc:2889] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.013707 12879 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:38.017963 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.018903 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.019670 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.023170 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.023703 12808 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.024019 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.025379 12801 raft_consensus.cc:2368] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:38.005779 17634 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:38.027570 12875 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:38.028640 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.030270 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.030887 12801 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.020119 17504 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:38.032135 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.021484 17529 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.032657 12773 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.022637 17578 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.012820 17177 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.038866 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.045333 12729 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:38.029085 17286 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.046335 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.046789 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.047093 12729 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 10: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:38.048138 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.048740 12802 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:38.054415 17653 log.cc:927] Time spent T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:08:38.033468 17634 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.056573 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.056907 17634 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.057687 17634 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:38.057922 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.058126 17634 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.058605 17634 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.058738 12724 raft_consensus.cc:2368] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:38.059680 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.025636 17586 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.060072 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.079944 12730 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:38.081276 12730 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:38.061512 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.041177 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.082808 12733 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:38.064930 12878 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.065588 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:38.083737 12728 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.069211 12808 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.070066 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:38.085391 12879 raft_consensus.cc:3060] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.074863 12724 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:38.087847 12724 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:38.089798 12733 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:38.091385 12803 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:38.035531 17530 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:38.078028 12802 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.048022 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.094743 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:38.075860 12847 leader_election.cc:400] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:38.029655 17584 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:38.106982 12881 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:38.098500 12808 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.098865 12847 leader_election.cc:403] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:38.100063 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67462us
I20260709 13:08:38.096601 12730 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:38.111245 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47476us
I20260709 13:08:38.114931 17327 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.115530 17327 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.115710 13486 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:38.120271 17529 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:38.120677 17648 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.594s	user 0.004s	sys 0.000s
I20260709 13:08:38.121567 17529 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.122836 12731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1692) took 1292 ms. Trace:
I20260709 13:08:38.038873 17504 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:38.123282 12731 rpcz_store.cc:276] 0709 13:08:36.840496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.956262 (+115766us) service_pool.cc:224] Handling call
0709 13:08:37.006868 (+ 50606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.313651 (+306783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.313686 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.314205 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.405131 (+ 90926us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:37.427227 (+ 22096us) log.cc:844] Serialized 14 byte log entry
0709 13:08:37.427488 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.515108 (+ 87620us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540040ea54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:37.515161 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.119980 (+604819us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:38.122602 (+  2622us) raft_consensus.cc:1685] finished
0709 13:08:38.122624 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.122773 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21655,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3905,"raft.queue_time_us":918,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":18551,"spinlock_wait_cycles":731197568,"thread_start_us":87956,"threads_started":1,"wal-append.queue_time_us":151835}
I20260709 13:08:38.118032 17327 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.079037 17616 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:38.148398 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 117895us
I20260709 13:08:38.136535 12879 raft_consensus.cc:2468] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 12.
I20260709 13:08:38.171203 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.186028 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.150754 17539 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:38.128983 16899 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:38.188155 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47847.6us
I20260709 13:08:38.129093 17460 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.092422 17586 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:38.194546 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 84849.6us
W20260709 13:08:38.192651 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73962.6us
I20260709 13:08:38.150929 17204 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:38.181234 17351 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12.
I20260709 13:08:38.201481 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.202687 17680 raft_consensus.cc:2804] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.203069 17270 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:38.185335 17616 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.217890 12808 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:38.191059 17593 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:38.189847 16899 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.229465 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.250211 12879 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
I20260709 13:08:38.236485 12805 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:38.215565 12728 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:38.255270 12728 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:38.189357 17539 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.191290 17569 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:38.196689 17460 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.192950 17667 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:08:38.200846 17637 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:08:38.266027 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97009.6us
W20260709 13:08:38.246069 17650 log.cc:927] Time spent T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.725s	user 0.003s	sys 0.000s
I20260709 13:08:38.278514 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.278517 12728 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:38.286552 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.246904 17276 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.232571 17204 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.248936 17641 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:38.297019 17276 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.309515 17276 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:38.310541 17276 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.235581 17504 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.295650 17595 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:38.322583 12874 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
W20260709 13:08:38.336136 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 94227us
W20260709 13:08:38.341485 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.347505 12773 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.353353 17435 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:38.358281 17435 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:38.361934 17664 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:08:38.365722 17586 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.327596 17177 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:38.367923 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.327804 17595 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.350167 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.352617 12773 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.332161 17611 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:38.350852 17680 raft_consensus.cc:697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:08:38.382805 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.383729 17680 consensus_queue.cc:237] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.384914 17640 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:38.349453 17687 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.386284 17640 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.386413 17687 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.384608 17595 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.387409 17687 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.388159 17595 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.389061 17539 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.387447 17640 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.391368 17640 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.308220 17641 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.392905 12878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37670 (request call id 2485) took 1018 ms. Trace:
I20260709 13:08:38.394021 17641 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.394251 17481 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.395006 17481 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.395358 17616 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.396660 17460 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.397936 17683 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.398545 17683 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.394083 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1712) took 1012 ms. Trace:
W20260709 13:08:38.355378 17672 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:08:38.403527 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 125078us
I20260709 13:08:38.402287 12725 rpcz_store.cc:276] 0709 13:08:37.381904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.764846 (+382942us) service_pool.cc:224] Handling call
0709 13:08:37.816796 (+ 51950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.826765 (+  9969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.393886 (+567121us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b5400063e50. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf28ad 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:38.394023 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118304128}
I20260709 13:08:38.391412 12726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2263) took 1008 ms. Trace:
I20260709 13:08:38.416114 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.393347 12878 rpcz_store.cc:276] 0709 13:08:37.374493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.376230 (+  1737us) service_pool.cc:224] Handling call
0709 13:08:38.392725 (+1016495us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54004209d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:38.392843 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308870912}
I20260709 13:08:38.417313 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.420997 12801 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:38.416065 12726 rpcz_store.cc:276] 0709 13:08:37.382749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.821370 (+438621us) service_pool.cc:224] Handling call
0709 13:08:37.821656 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.900685 (+ 79029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.900719 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.900762 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:37.900794 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.391141 (+490347us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b540038f254. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:38.391194 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.391347 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181228800}
I20260709 13:08:38.421814 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.433125 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:38.435784 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.357177 17204 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:38.401482 17530 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.323319 16899 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.440271 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.442427 12799 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:38.443946 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.431360 17682 raft_consensus.cc:2764] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:38.454734 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.455138 12803 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:38.458719 12873 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.458843 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.459535 12881 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:38.459161 12873 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:38.448375 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 95863.2us
I20260709 13:08:38.448611 17530 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:38.450738 17481 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.460860 12727 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:38.418990 17634 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.462301 12773 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.463575 12801 raft_consensus.cc:2368] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:38.441357 17529 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:38.461688 12873 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.468129 12878 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:38.469312 12873 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.471695 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.472259 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.481375 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.462415 17691 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.485563 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.476989 17682 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.493763 12807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45512 (request call id 1713) took 1692 ms. Trace:
I20260709 13:08:38.509182 12807 rpcz_store.cc:276] 0709 13:08:36.801426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.803016 (+  1590us) service_pool.cc:224] Handling call
0709 13:08:36.803278 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.463980 (+660702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.493490 (+1029510us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54001b6054. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:38.493675 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514284928}
I20260709 13:08:38.476663 17435 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:38.495087 17690 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.522586 17690 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:38.511142 12873 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:08:38.483335 17481 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:38.515965 17693 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:38.520251 17669 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:38.507059 17686 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:38.488135 17177 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.466012 17530 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.503368 17578 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.493440 17683 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.530107 12873 pending_rounds.cc:85] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 5
I20260709 13:08:38.631779 12873 pending_rounds.cc:107] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:08:38.632200 12873 raft_consensus.cc:2889] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:38.633375 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 152844us
W20260709 13:08:38.638365 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 108323us
I20260709 13:08:38.643913 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.501771 17601 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.556080 17669 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.493140 17691 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.553215 17693 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:38.647933 12882 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:38.679224 17634 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.679014 17669 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.680289 17669 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.678081 17601 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.681903 17687 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.630689 17177 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.691016 17177 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:38.696499 17198 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:38.674691 17693 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.701773 12877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2430) took 1097 ms. Trace:
I20260709 13:08:38.702195 12877 rpcz_store.cc:276] 0709 13:08:37.605031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.609638 (+  4607us) service_pool.cc:224] Handling call
0709 13:08:37.609967 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.610335 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.610368 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.204516 (+594148us) spinlock_profiling.cc:243] Waited 991 us on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:38.205044 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.459514 (+254470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:38.459548 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.459616 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.701501 (+241885us) raft_consensus.cc:1685] finished
0709 13:08:38.701522 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.701716 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":404,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":8239,"spinlock_wait_cycles":2918528,"thread_start_us":222022,"threads_started":1,"wal-append.queue_time_us":418073}
I20260709 13:08:38.555871 17481 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.697062 17198 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.701320 12875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2437) took 1094 ms. Trace:
I20260709 13:08:38.710009 12875 rpcz_store.cc:276] 0709 13:08:37.606667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.734654 (+127987us) service_pool.cc:224] Handling call
0709 13:08:37.734920 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.031591 (+296671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.701056 (+669465us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54002094d4. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:38.701255 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672648448}
I20260709 13:08:38.721850 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.722856 12800 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:38.723819 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.724853 13484 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.728086 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:38.729017 12882 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.649456 17530 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:38.708559 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.729434 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.734942 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:38.732620 12848 leader_election.cc:400] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:38.730747 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:38.734858 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.736601 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.737249 12877 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.711138 17505 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:38.740901 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 269412us
I20260709 13:08:38.743319 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.720474 17687 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.730557 17681 raft_consensus.cc:2749] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.732477 17678 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.748253 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.739229 17595 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:08:38.749644 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.751430 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.753139 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.754750 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.755612 12874 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 10: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:38.756212 17639 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:38.757905 12732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52120 (request call id 2270) took 1352 ms. Trace:
I20260709 13:08:38.758301 17270 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:38.759292 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.759840 12724 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.734889 17536 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.760193 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.760879 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:38.761183 12847 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:38.762218 17405 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:38.758344 12732 rpcz_store.cc:276] 0709 13:08:37.405754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.476436 (+ 70682us) service_pool.cc:224] Handling call
0709 13:08:38.757674 (+1281238us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400245c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:38.757803 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609294720}
I20260709 13:08:38.742981 17670 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:38.769680 17691 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.770834 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:38.772428 17505 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.747289 17682 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:38.773113 17505 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.774175 16899 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.707903 17198 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.775405 17505 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.775552 17198 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.772353 17536 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.743578 17683 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:38.732618 17675 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:38.781176 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.813869 12733 raft_consensus.cc:2410] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:38.783493 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:38.776168 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.782618 12880 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:38.804530 12882 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:38.780400 17694 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:38.759807 17678 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.829298 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86042.6us
I20260709 13:08:38.831815 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.775990 17505 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.848299 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.826593 17694 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.825006 17666 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.849671 17670 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:38.850237 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 89145.1us
I20260709 13:08:38.850425 17529 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:38.850131 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 89695.6us
I20260709 13:08:38.863238 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.850512 17405 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.762145 17565 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.760684 17481 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.855443 17568 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.781484 17536 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:38.861280 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.863394 17690 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.849679 12726 raft_consensus.cc:2368] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:38.860491 17678 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.873855 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.882004 12731 raft_consensus.cc:2393] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 13: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:38.882674 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.863483 17694 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.862793 12725 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:38.879264 12733 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:38.879382 12773 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.876683 17204 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:38.779148 17693 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.856516 17537 consensus_queue.cc:1059] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:38.865893 17670 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.896900 12773 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.886070 17634 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.902120 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.893714 17687 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.904789 17667 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:38.906177 17693 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.908207 17504 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:38.908911 17504 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.911083 17639 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.911629 17639 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.911933 17666 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.913110 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 78) took 4898 ms. Trace:
I20260709 13:08:38.912732 17639 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.913031 17666 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.915938 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41076
I20260709 13:08:38.916786 17682 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:38.917670 17670 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.918445 17504 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.918668 17678 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.919256 17670 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.920085 13512 raft_consensus.cc:1240] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:38.922375 12875 raft_consensus.cc:2410] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:38.894363 17690 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:38.923816 17690 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.924610 17676 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.925297 17676 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:38.926803 17539 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.927316 17539 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:38.876447 17565 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.928134 17539 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.892505 17640 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:08:38.932181 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.933732 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.922250 17678 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:38.932971 17683 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.937747 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.939167 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:38.939810 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.941648 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.940074 17675 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.942953 17675 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.943289 17675 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.944494 17565 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:38.944972 17707 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:38.933207 17634 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.946624 17634 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.948889 17270 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.949396 17270 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:38.892804 17204 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:38.952775 17204 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:38.952881 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52272.9us
I20260709 13:08:38.941826 17682 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.954440 17682 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.954607 12848 leader_election.cc:400] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:38.954803 17693 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.954903 17682 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.955427 17693 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:38.955827 17693 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.950421 17270 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.956938 12848 leader_election.cc:403] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.957242 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.913640 12630 rpcz_store.cc:276] 0709 13:08:34.027460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.051318 (+ 23858us) service_pool.cc:224] Handling call
0709 13:08:38.913009 (+4861691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.890226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.890871 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.890916 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:36.890936 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:36.891879 (+   943us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.891943 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.891973 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:36.892744 (+   771us) tablet.cc:701] Row locks acquired
0709 13:08:36.892761 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:36.892935 (+   174us) write_op.cc:270] Start()
0709 13:08:36.893063 (+   128us) write_op.cc:276] Timestamp: P: 1783602516892880 usec, L: 0
0709 13:08:36.893082 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.900114 (+  7032us) log.cc:844] Serialized 3196 byte log entry
0709 13:08:37.472300 (+572186us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.623626 (+151326us) write_op.cc:301] APPLY: starting
0709 13:08:37.623722 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:38.027158 (+403436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:38.033614 (+  6456us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:38.450027 (+416413us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:38.450327 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:38.450392 (+    65us) write_op.cc:312] APPLY: finished
0709 13:08:38.450770 (+   378us) log.cc:844] Serialized 80 byte log entry
0709 13:08:38.619733 (+168963us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:38.642087 (+ 22354us) write_op.cc:454] Released schema lock
0709 13:08:38.645283 (+  3196us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:38.656583 (+ 11300us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:38.656620 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1275848,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":145992,"apply.run_cpu_time_us":37899,"apply.run_wall_time_us":1032897,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":236844,"prepare.run_cpu_time_us":17417,"prepare.run_wall_time_us":146644,"raft.queue_time_us":169450,"raft.run_cpu_time_us":9160,"raft.run_wall_time_us":162514,"replication_time_us":569666,"thread_start_us":566574,"threads_started":5,"wal-append.queue_time_us":430586,"wal-append.run_cpu_time_us":34380,"wal-append.run_wall_time_us":1278410}]]}
I20260709 13:08:38.962734 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:38.955844 17709 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:08:38.957379 17704 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.972735 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:38.967051 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.985487 12725 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:38.986819 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.994896 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:38.996160 12699 leader_election.cc:400] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:38.997726 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:38.998622 12874 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.998912 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.000654 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.004745 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.005482 17694 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:39.007262 17504 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:39.002604 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.012187 17505 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.013716 17679 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.007925 17694 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.012372 12725 raft_consensus.cc:2368] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14.
I20260709 13:08:38.935818 17676 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.022634 12881 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:08:39.023119 12881 pending_rounds.cc:85] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 5
I20260709 13:08:39.023392 12881 pending_rounds.cc:107] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:39.023702 12881 raft_consensus.cc:2889] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.990574 17591 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.964619 17405 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.024606 17591 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.025771 17591 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:38.976974 17704 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.027830 17704 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.958446 17529 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:39.028650 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:38.951361 17675 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.030112 12800 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:38.977571 17568 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:39.031222 17675 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.031416 17568 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.032497 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a839b697aea46da87cb69b00515389e with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41706
I20260709 13:08:39.033903 17683 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:39.035151 17698 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:39.035321 17270 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.035660 17698 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.036829 17698 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.040751 12733 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:38.965499 17639 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.043494 12699 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:39.047021 12731 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:39.051673 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.055111 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.059630 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:39.060268 12880 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
W20260709 13:08:39.062940 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 164051us
I20260709 13:08:39.066426 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.067196 12699 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:38.993321 17682 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.069104 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.072117 12730 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:39.072350 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.077665 12874 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:39.079005 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.081456 12733 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.057271 17694 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:39.086817 12847 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.060518 17698 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.032632 17568 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.065637 17505 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.080103 17611 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:39.102263 17611 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:39.090281 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.069433 17504 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:39.052904 17675 consensus_queue.cc:1059] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:39.057888 17530 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:39.062569 17680 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:39.119580 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.120165 12728 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:39.108860 12733 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:39.125015 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.129733 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:39.129232 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.125538 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.134819 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.136718 12808 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:39.105468 17694 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:39.131213 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.134840 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.135125 12728 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:39.114856 17634 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.119786 17504 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:39.167023 17504 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.144075 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.144290 17611 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.164388 17720 tablet_replica.cc:333] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:08:39.129055 17690 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.169049 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.171396 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.138260 17683 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:39.193403 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:39.195338 12801 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:39.196455 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.197301 12728 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.198280 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.203399 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:39.204890 12803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:39.205578 12803 raft_consensus.cc:606] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:39.205648 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.206018 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.190761 17481 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.209964 12804 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:39.210578 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.211525 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.192404 17683 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.215148 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:39.201542 17204 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.223639 12728 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:39.229018 17405 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:39.213872 17676 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:08:39.230427 17712 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:08:39.230757 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:08:39.231289 17714 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:39.224565 17204 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.214407 17481 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.218458 17694 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.220723 17568 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:39.235520 17696 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.211512 17675 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.194635 17690 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.218318 17529 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.209656 17591 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:08:39.259595 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 49106.9us
W20260709 13:08:39.261418 17716 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:39.262382 17204 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.262254 17568 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:39.262540 17481 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.277087 12807 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:39.245534 17693 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.281579 17690 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.284243 17634 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.260130 17683 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:39.285815 17683 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.277922 17204 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.290033 12808 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:39.294960 17536 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:39.295455 17536 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:39.274564 17704 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.303944 12802 raft_consensus.cc:1240] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:08:39.296406 17536 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.305949 17720 raft_consensus.cc:2243] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.306435 17536 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.307139 17720 raft_consensus.cc:2272] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.311208 17720 ts_tablet_manager.cc:1916] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:39.312193 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.312561 17505 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.315836 12805 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:39.322599 17704 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:39.328961 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 107643us
I20260709 13:08:39.330355 12773 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:39.331496 17687 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.332352 17687 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.331947 12773 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:39.337683 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.341074 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.336199 17704 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:39.344470 17704 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.344843 17704 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.350512 12801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:39.351272 12801 raft_consensus.cc:606] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:39.358790 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.385998 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.359724 12730 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:39.391193 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:39.396113 17710 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.505s	user 0.002s	sys 0.004s
I20260709 13:08:39.400465 17687 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.401579 17693 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:39.412567 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 325843us
I20260709 13:08:39.414439 12847 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:39.412590 17177 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.424772 17601 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.425637 17270 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:39.426262 17270 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.429152 12877 raft_consensus.cc:2955] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:39.440351 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.446491 12882 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:39.447803 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.448523 12878 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:39.451159 17177 consensus_queue.cc:1059] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:39.451538 17537 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:39.452384 17177 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:39.452970 17177 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:39.452641 17537 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:39.454252 17177 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.455147 17537 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:39.456175 17537 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.457486 17537 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.444310 17732 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:39.460830 17732 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:39.463479 17732 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:39.464440 17177 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.468230 17504 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.468972 17504 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.471395 17504 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:39.472860 17730 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:39.475306 17270 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.479542 17720 ts_tablet_manager.cc:1929] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.7
I20260709 13:08:39.488415 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:39.488950 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.490090 12771 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:39.490747 12730 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:39.493149 12800 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:39.459951 12847 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.501058 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.505467 12878 raft_consensus.cc:2410] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:39.508106 12730 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:39.507982 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48136.6us
I20260709 13:08:39.509917 12847 leader_election.cc:400] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 9. Current term is 10.
I20260709 13:08:39.511039 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.505352 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:39.516059 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:39.520921 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.523859 17435 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.524868 17729 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:39.524689 17435 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.526618 12730 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:39.521696 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.534433 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.537740 12696 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.527156 17539 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:39.525513 17729 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.570313 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.533824 17667 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.530936 17717 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.544919 17539 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:39.556331 17696 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.557714 17286 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.558207 17721 log.cc:927] Time spent T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.305s	user 0.006s	sys 0.002s
I20260709 13:08:39.542860 17504 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.561154 17630 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.565435 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.531658 17698 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.530725 17720 log.cc:1199] T 4a839b697aea46da87cb69b00515389e P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/4a839b697aea46da87cb69b00515389e
I20260709 13:08:39.571695 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.639207 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.572176 12731 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15. Ops: [10.6-14.9]
I20260709 13:08:39.535573 17687 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:39.563827 17435 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:39.603363 17730 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:39.624105 17286 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.646106 17697 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.646405 17630 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.646688 17697 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.647387 17286 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.596122 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:39.604635 17539 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.648636 17630 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.606308 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.650719 17481 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:39.651384 17481 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:39.587479 12729 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:39.652321 17729 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.652173 17600 consensus_queue.cc:1059] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:39.588652 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.653868 12878 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:39.589583 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.654533 12874 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.589187 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.598197 12879 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:39.660053 12876 raft_consensus.cc:1275] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:39.614315 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.617492 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.622991 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.653085 17600 raft_consensus.cc:3055] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:39.664747 12727 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:08:39.667749 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.669401 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.671622 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.671753 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.585350 17637 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:39.542559 17669 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:08:39.610121 17204 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:08:39.651881 17481 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.676463 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.690750 12874 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:39.716459 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.673497 17729 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.667732 17600 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:39.673635 17726 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:39.727200 12726 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.692479 17678 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.618331 17696 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.648576 17697 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.692837 17728 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.669718 17704 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.746511 17270 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.746935 17286 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.751322 17405 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.750331 17505 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.738813 17726 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.744925 17729 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:39.775244 17697 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.775761 17694 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.794775 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 198779us
I20260709 13:08:39.791481 12726 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:39.780124 17667 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:39.809393 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.786904 17405 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.799742 17687 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:39.778333 17286 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.773967 17270 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.817705 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:39.821321 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 127058us
I20260709 13:08:39.804900 17697 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:39.812139 17735 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:39.828421 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.829768 12803 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:39.834908 17737 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:39.836639 17286 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.791442 17600 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.837734 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.838413 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.838676 12875 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:39.799688 17694 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.840981 17694 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.825809 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.837813 17600 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.844381 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.845048 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:39.845541 17270 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.847146 17748 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:39.847756 17748 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.812808 17667 consensus_queue.cc:1243] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:39.854096 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.856412 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:39.819185 17177 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.862924 12771 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:39.866261 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:39.867081 12726 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.869237 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.871722 12874 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:39.872721 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:39.849746 17639 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.875001 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:39.907522 12878 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:39.824431 17687 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.878636 17405 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:39.824801 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:39.879122 17198 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:39.914317 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 89593.4us
I20260709 13:08:39.872413 17693 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:39.882685 17704 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.937974 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.884088 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 4a839b697aea46da87cb69b00515389e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:08:39.939996 12618 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 88269.4us
I20260709 13:08:39.888545 17748 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:39.889233 17734 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.457s	user 0.003s	sys 0.000s
I20260709 13:08:39.889652 17726 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.896382 17696 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.896775 12726 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:39.942085 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.942704 12726 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:39.943506 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.943881 12799 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:39.901419 17481 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:39.906454 12873 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:39.944003 12726 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:39.945092 12873 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:39.908118 12878 pending_rounds.cc:85] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 7
I20260709 13:08:39.946297 12878 pending_rounds.cc:107] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:39.921139 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.946532 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.946820 12732 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:39.947551 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.947863 12732 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:39.946570 12878 raft_consensus.cc:2889] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.922032 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.948800 12729 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:39.923484 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.926824 12730 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:39.945776 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:39.949522 12731 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:39.852288 17660 consensus_queue.cc:1048] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:39.953025 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:39.985065 12802 raft_consensus.cc:2393] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:39.993577 17481 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.998040 17504 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.007153 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:40.008200 12879 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:40.009405 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.010118 12879 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:39.931811 17505 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:40.011570 12879 raft_consensus.cc:1240] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.012418 17698 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:40.012950 17698 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:40.013751 17698 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.017293 17687 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.012075 17505 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.007825 12876 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.033764 12804 raft_consensus.cc:2393] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:40.023474 17732 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.036077 17732 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.037147 17505 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.037894 17578 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:40.038900 17732 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:39.895759 17697 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:39.930853 17717 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.937049 17693 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.936877 17536 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.047452 12873 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.075789 12873 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.048502 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66023.5us
I20260709 13:08:40.050724 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.079077 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.053169 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.054051 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.080096 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.061460 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.065498 12727 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:39.937184 17747 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.068166 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.083019 12731 raft_consensus.cc:2393] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:40.068218 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.070163 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.085850 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.086753 12879 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:40.071398 12876 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:40.058885 12802 raft_consensus.cc:1240] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:39.983472 17405 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:40.092123 12773 leader_election.cc:400] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14.
I20260709 13:08:40.087896 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.089694 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.083630 17717 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.091913 17728 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:40.111256 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.152964 12879 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:40.149056 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:40.128782 12724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.022s	sys 0.030s
I20260709 13:08:40.074811 17693 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.155867 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:40.156561 12724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.022s	sys 0.031s
I20260709 13:08:40.157095 12876 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:40.083878 17536 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.108652 17732 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:40.162336 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:40.164738 12845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.091854 17405 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:40.167407 12876 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 8: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:40.176517 12873 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:40.180883 12873 pending_rounds.cc:85] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 6
I20260709 13:08:40.181411 12873 pending_rounds.cc:107] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:40.182009 12873 raft_consensus.cc:2889] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.158038 17728 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:40.178287 12876 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:40.157480 17670 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.159765 17611 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.187350 12876 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:40.108564 17746 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:08:40.186139 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.186082 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.151361 17568 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:40.168133 17536 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.160290 17726 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:40.198745 12876 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:40.200999 12876 pending_rounds.cc:85] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 6
I20260709 13:08:40.201396 12876 pending_rounds.cc:107] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:40.202099 12876 raft_consensus.cc:2889] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.206600 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:40.183986 17732 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:40.208757 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.189775 17728 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:40.191322 17630 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:40.220547 12881 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:40.176975 17539 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:40.193964 17670 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:40.297684 17600 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.229473 17637 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.228523 17683 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:40.307130 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 121183us
I20260709 13:08:40.298312 17600 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.196195 17405 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.310070 17637 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.336656 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 180882us
W20260709 13:08:40.332867 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 190520us
I20260709 13:08:40.356065 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.339541 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.358685 12847 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.364833 12847 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.366274 12804 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 8.
I20260709 13:08:40.370057 12804 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:40.375758 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.354669 17697 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:40.357095 17637 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.376495 12799 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:40.361136 17717 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.363394 17669 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.372238 17405 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.371435 17198 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.334362 17732 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.404543 17565 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.405797 17669 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.380520 17708 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:40.381071 17697 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.419821 17481 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.421612 17435 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.405033 17687 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:40.437130 17565 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.450860 17669 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.455353 17752 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:08:40.453333 17755 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:40.455708 17708 consensus_queue.cc:1243] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:40.461253 17776 consensus_queue.cc:1059] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:40.423609 17773 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:40.451764 17763 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.484606 17670 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:40.486311 17600 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.471110 17565 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.459560 17435 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:40.503644 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 138834us
I20260709 13:08:40.509580 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:40.510329 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 103281us
I20260709 13:08:40.514496 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.515302 12876 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:40.462051 17481 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.518944 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.519644 12876 raft_consensus.cc:2410] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:40.522970 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.523113 12874 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:40.525086 17481 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.525431 17198 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:40.525976 17198 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.510254 17435 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.547502 12696 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.550531 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:40.548333 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 179582us
I20260709 13:08:40.557503 17748 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.560804 12725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 2301) took 1221 ms. Trace:
I20260709 13:08:40.561285 12725 rpcz_store.cc:276] 0709 13:08:39.339862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.340206 (+   344us) service_pool.cc:224] Handling call
0709 13:08:39.340664 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.349221 (+  8557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.349275 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.350166 (+   891us) log.cc:844] Serialized 52 byte log entry
0709 13:08:39.845039 (+494873us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b18001a7d00. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f417930d1 00007f0f41baea0f
0709 13:08:40.157894 (+312855us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.157994 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.158109 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.552114 (+394005us) raft_consensus.cc:1685] finished
0709 13:08:40.552137 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.560721 (+  8584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8057,"raft.queue_time_us":28828,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":15273,"spinlock_wait_cycles":2379136,"thread_start_us":312572,"threads_started":1,"wal-append.queue_time_us":905159}
I20260709 13:08:40.513876 17769 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:40.566533 17693 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.570930 17728 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.520546 17765 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.573745 17765 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:40.574117 17765 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.576896 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65731us
I20260709 13:08:40.563050 17669 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.577628 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.579633 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:40.580350 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.582621 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.583127 12804 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:40.586349 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.587105 12730 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:40.585007 17505 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.544411 17670 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:40.589355 17505 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.589432 17750 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:40.589833 17505 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.590005 17750 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:40.591051 17750 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.596387 17697 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.597944 17568 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:40.598646 17568 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:40.584425 17751 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.224s	user 0.004s	sys 0.000s
I20260709 13:08:40.547582 17536 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.600515 17769 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:40.601423 17536 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.599498 17568 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.602310 12882 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.598001 17728 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.605683 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.607264 17777 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.607689 17777 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:40.608629 17746 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:40.608538 17777 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:40.609241 17746 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.609917 17777 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.612960 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.613289 17693 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.613776 12724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1740) took 1752 ms. Trace:
I20260709 13:08:40.614991 17765 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.614171 12724 rpcz_store.cc:276] 0709 13:08:38.860981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.861166 (+   185us) service_pool.cc:224] Handling call
0709 13:08:38.861523 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:38.867721 (+  6198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:38.873690 (+  5969us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.568833 (+695143us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003a8e80. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb05c02 00007f0f4178d20b 00007f0f41792d23 00007f0f4179323a 00007f0f41bfda2a
0709 13:08:40.161189 (+592356us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:40.559525 (+398336us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:40.607712 (+ 48187us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b2c000014c8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:40.608261 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 13:08:40.608419 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:40.608454 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.608532 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.613526 (+  4994us) raft_consensus.cc:1685] finished
0709 13:08:40.613545 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.613682 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8779,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":11437,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":10838,"spinlock_wait_cycles":13718656,"thread_start_us":592081,"threads_started":1,"wal-append.queue_time_us":1435090}
I20260709 13:08:40.616776 17746 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.617056 17765 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.618539 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:40.619751 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 67159.1us
I20260709 13:08:40.621234 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.622066 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.623651 12881 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:40.625487 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:40.626164 12881 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:40.626446 17539 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:40.632433 17667 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.632651 17539 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:40.633154 17539 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.633059 17667 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.635373 17667 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.632102 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.636098 12726 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.591537 17637 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.638801 17637 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.615285 17198 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.632450 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.641328 17198 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.551782 17481 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.627756 12873 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:40.622148 12724 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:40.629575 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.643533 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.649717 12727 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.649962 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.650643 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.648975 12726 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
W20260709 13:08:40.632225 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51934.5us
I20260709 13:08:40.656881 12771 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.658565 17780 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.659709 17776 raft_consensus.cc:993] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:40.667754 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.669296 12727 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:40.674722 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.675032 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.660168 17776 raft_consensus.cc:1081] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:40.683243 12847 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:40.683658 12848 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.689481 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.652545 17769 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:40.700960 17669 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.650972 17765 consensus_queue.cc:1059] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:40.687945 12847 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.662016 17435 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.696146 17779 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.698140 17780 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.698580 17481 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.688690 17639 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.660462 17529 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:40.680405 17717 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:40.718588 17717 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.718977 17717 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.683247 17767 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.690505 17729 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.691879 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.671463 17405 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:40.708113 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:40.715970 17670 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:40.683564 17687 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:40.705705 17769 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.704926 17773 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.728353 12847 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.704295 17728 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:40.738080 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46300.6us
I20260709 13:08:40.742506 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.744832 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.745793 12727 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.749295 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.749970 12802 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:40.750368 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.750775 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.751410 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.713781 17481 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:40.731606 17729 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:40.755082 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.727909 17670 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:40.755270 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.794340 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:40.771744 12727 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:08:40.779245 17481 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.783722 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.736593 17351 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:40.780243 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.731274 17773 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.800832 12875 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:08:40.753077 17726 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.802424 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:40.715485 17505 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.753808 17177 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:40.743727 17637 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.800859 12879 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:40.713984 17779 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.787662 17746 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.812675 12725 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.817821 12877 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:40.743639 17728 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.784297 17696 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:40.715688 17780 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:40.827870 17405 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.779067 17578 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:40.753221 17504 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:08:40.791630 17667 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.812906 17773 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.736696 17769 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.842911 12804 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:40.831827 17177 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:40.854826 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.840636 17405 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.864173 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.865485 12804 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:40.829603 17637 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.871634 12725 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:40.879106 17726 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.865615 17578 consensus_queue.cc:1243] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:40.868793 17405 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.879578 17726 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.887712 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.888775 12805 raft_consensus.cc:2368] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:08:40.901611 17435 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.902340 17780 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:40.861194 17539 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.845983 17670 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:40.902750 17785 log.cc:927] Time spent T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:40.903542 17670 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.904407 17539 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.904863 17769 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:40.908689 17791 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:40.909616 17637 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.846622 17667 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.913513 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:40.916590 13516 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:40.919229 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:40.887705 17729 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:40.867786 17565 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.928745 12805 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:08:40.931372 12805 pending_rounds.cc:85] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
W20260709 13:08:40.927991 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 142105us
I20260709 13:08:40.931686 12805 pending_rounds.cc:107] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:40.901678 17696 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.931980 12805 raft_consensus.cc:2889] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.940891 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:40.943357 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:40.927347 17769 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.955509 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:40.958042 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:40.960840 12880 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:40.921453 17504 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.963406 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:40.964735 17778 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.965411 17778 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:40.959326 17351 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:40.967823 17729 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.969034 12805 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 16: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:40.969713 17750 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.970319 17779 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.959954 17769 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.971516 17769 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.980262 17505 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.981117 17717 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:40.984127 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 229114us
I20260709 13:08:40.959986 17696 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.966925 17778 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.950073 17435 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.990363 17696 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.990931 17435 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.992444 17505 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:40.992743 17696 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.993435 17435 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.985450 17504 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:40.994333 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:40.994923 12733 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:40.995100 17505 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.995982 17504 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:40.997596 17717 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.995431 17773 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.000538 17773 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.003958 12696 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.014925 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:41.017001 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 214622us
I20260709 13:08:41.018954 12848 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:40.990289 17667 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:40.919425 17177 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.023479 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.028211 12882 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:41.028554 12730 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:41.030164 12728 raft_consensus.cc:1240] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:41.030659 12729 raft_consensus.cc:1240] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:08:41.032629 12732 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:41.023804 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.026466 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.037320 12879 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:41.038460 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.013456 17198 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.043561 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.045708 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.048656 12882 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:41.029742 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.049219 12731 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.049563 12879 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:41.046413 12728 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:08:41.015959 17696 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.013703 17504 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.064002 17787 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:41.066247 17786 consensus_queue.cc:1059] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:41.067765 17683 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.068210 17683 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.069161 17683 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.072518 17796 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.070557 17683 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.017490 17505 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:41.048290 17793 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.087157 12731 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:41.090170 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:41.093758 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.075253 17530 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:41.094408 17773 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.058604 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:41.095229 17767 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:41.079653 17504 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.098608 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.099138 17687 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:41.100474 17505 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.133716 17530 consensus_queue.cc:1243] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:41.133985 17505 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:41.134572 17505 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.100492 17693 consensus_queue.cc:1059] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:41.136377 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.101724 17787 consensus_queue.cc:1059] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:41.082383 17728 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.102380 17793 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.137862 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.138626 12877 raft_consensus.cc:2368] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
I20260709 13:08:41.138707 17405 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.139213 17793 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.139863 17781 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:41.140549 17795 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.141134 17795 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.141498 17795 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.104686 17565 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.012545 17351 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.146031 12730 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.146510 12730 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.056398 17198 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.136512 17693 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.132369 12773 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:41.144985 12878 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:41.109325 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.115092 12881 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:41.147450 12771 leader_election.cc:400] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
I20260709 13:08:41.150256 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.153710 12771 leader_election.cc:403] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.154672 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.154484 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.157053 12729 raft_consensus.cc:2393] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:41.158614 12882 raft_consensus.cc:1240] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:41.158712 17530 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:41.161303 17530 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.162161 17530 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.156409 17787 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.167209 12876 raft_consensus.cc:2410] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:41.152659 17693 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.173417 17746 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.173234 17693 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.174584 17693 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.174690 17769 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:41.144623 17773 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:41.176941 12729 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:41.177968 12879 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:41.149446 17728 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:41.178568 17773 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:41.178721 17728 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.183166 12771 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:41.183369 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:41.179131 17769 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:41.184334 13516 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.191658 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.147451 17697 consensus_queue.cc:1059] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:08:41.214610 13516 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:41.216274 12771 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.198673 17687 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.205695 17787 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:41.221518 12730 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.171712 17726 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.205454 17781 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:41.222743 17696 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:41.228617 17769 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:41.245720 17405 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.257236 17504 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.262302 17481 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.234799 17787 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.263594 17787 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.264195 12731 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:41.264570 17767 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.265215 17767 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.225682 17728 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:41.269614 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.271301 12731 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:41.272450 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.274452 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.274953 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.280248 17767 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.284883 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.255863 17777 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:41.286655 17777 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.240917 17696 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:41.287595 17777 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:41.289721 17807 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:41.287937 17696 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.288702 17481 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:41.289060 17805 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:41.293494 17198 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.293684 17795 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.294857 17732 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.296922 12732 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:41.290864 17696 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.298976 17539 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.290786 17505 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.301141 12728 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 14. Ops: [12.8-12.8]
I20260709 13:08:41.314229 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.323501 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.299605 17539 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.295460 17732 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.326246 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.322072 17768 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.295841 17795 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.325417 17769 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.377707 17568 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:08:41.393410 17539 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.401554 17539 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:41.402735 17539 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.405299 12727 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:41.405681 17539 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.325565 17504 consensus_queue.cc:1059] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:08:41.407984 17504 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:41.408432 17504 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:41.409318 17504 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.410586 17504 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.416288 12875 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
W20260709 13:08:41.430850 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 102802us
I20260709 13:08:41.332479 17780 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:08:41.439848 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.443181 12874 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:08:41.339814 17768 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.430420 17795 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:41.448383 17795 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.448907 17732 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.449422 17768 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.450682 17795 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.457100 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.457858 12873 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:41.459318 12875 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:41.452693 17505 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.468144 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.462678 17687 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10.
W20260709 13:08:41.601131 17809 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.380s	user 0.000s	sys 0.009s
W20260709 13:08:41.616389 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.468325 17767 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:08:41.560772 17769 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:41.603646 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.606208 17728 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.635196 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:41.607838 17783 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.891s	user 0.015s	sys 0.004s
I20260709 13:08:41.464115 17698 consensus_queue.cc:1059] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:08:41.610169 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:41.662796 13516 raft_consensus.cc:2368] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:41.636512 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.664295 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.637816 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.665793 12732 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.639037 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.666531 12727 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.666105 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:41.640293 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:41.642277 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.654866 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.672591 12733 raft_consensus.cc:2393] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 11: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:41.672683 12725 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:41.655531 12875 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:41.604792 12877 raft_consensus.cc:2410] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:41.674028 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.677106 12729 raft_consensus.cc:2410] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:41.682214 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.683264 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.683951 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.684134 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.684824 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.685042 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.685214 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.685686 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.687403 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.676790 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:41.687873 12733 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:41.604729 17505 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.689961 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.687623 12727 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:41.691366 12808 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:41.690783 12725 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:41.656797 17795 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.658774 17780 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.700757 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.655802 17732 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:41.688614 17611 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:41.716568 12807 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 16: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:41.732257 12732 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
W20260709 13:08:41.735126 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58498.7us
I20260709 13:08:41.742830 12732 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:41.738739 17778 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:41.659694 17787 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.680823 17781 consensus_queue.cc:1059] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:41.689357 17687 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:08:41.700363 17698 consensus_queue.cc:1243] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:41.712760 17773 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:41.758839 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:41.761977 12773 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:41.674629 17728 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:41.698596 17505 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.743151 17697 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:41.782770 17697 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:41.783296 17697 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:41.784301 17821 log.cc:927] Time spent T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:41.784886 17693 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.785295 17693 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.733026 17732 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.779102 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:41.765875 17778 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.788275 12800 raft_consensus.cc:2368] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:41.789729 12845 leader_election.cc:400] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:41.794003 12845 leader_election.cc:403] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.716526 17795 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.796689 12730 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.788903 12847 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:41.770100 17781 consensus_queue.cc:1243] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:41.802201 12731 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:41.785635 17693 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.800874 17775 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.811559 17530 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.811874 17405 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:41.812201 17530 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.812444 17405 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.812922 17405 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.813228 17530 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.816154 17667 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.817420 17530 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.797120 17729 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:41.791234 17778 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.818441 17667 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.777945 17773 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.818522 17505 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.820811 17693 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:41.826318 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68178.6us
I20260709 13:08:41.788518 17351 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.766988 17767 consensus_queue.cc:1059] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:41.836169 12699 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.841468 12699 leader_election.cc:400] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:08:41.791177 17819 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:41.842197 12699 leader_election.cc:403] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.845183 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:41.850332 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 110158us
W20260709 13:08:41.852164 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.852936 17667 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.855230 17728 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:41.855588 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.857039 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:41.857661 17823 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:41.858423 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.859737 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:41.861477 17773 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:41.862238 17481 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:41.863575 17481 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.867725 17795 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.846890 17504 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11.
I20260709 13:08:41.843802 17802 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.869031 17787 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.870620 17732 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.843142 17351 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:41.875690 17683 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:41.875432 17351 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.876278 17683 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:41.876940 17817 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.877429 17817 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:41.878414 17683 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:41.879338 17817 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:41.854969 17829 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:41.874208 17789 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.885468 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.887216 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.893114 12799 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:41.888509 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.894325 12805 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:41.855816 17728 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.889804 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.898171 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.890668 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.899114 12874 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:41.891340 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.900385 12877 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.905153 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:41.921608 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.937156 12878 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:41.939360 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.942901 12874 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:41.943367 12874 pending_rounds.cc:85] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Aborting all ops after (but not including) 8
I20260709 13:08:41.938251 12877 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:41.940272 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:41.939603 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:41.942924 12800 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.943663 12874 pending_rounds.cc:107] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:41.955472 12874 raft_consensus.cc:2889] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.896308 17789 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:41.900552 17795 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.950151 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:41.959600 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:41.961807 12873 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:08:41.967432 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.969862 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.971798 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:41.977442 12804 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
W20260709 13:08:41.981283 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 198318us
I20260709 13:08:41.984611 12880 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:41.909888 17578 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:41.992200 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:42.011111 12880 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.979032 17698 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:42.017406 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.018392 12805 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
W20260709 13:08:42.021221 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.025267 12800 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:42.027264 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.001051 17578 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:42.029660 17578 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:42.031250 17794 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.034s	user 0.004s	sys 0.000s
I20260709 13:08:42.000656 12771 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.002657 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.003671 12802 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:42.001449 12696 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.004788 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:41.936386 17481 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.031134 17578 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.036090 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.038556 12874 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:42.039736 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.041671 17697 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.050803 12877 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:08:41.997767 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.059170 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 199486us
I20260709 13:08:42.059402 12696 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.060390 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.062453 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.056728 12880 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:42.001272 17732 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:08:42.064981 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.071725 12728 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:42.006992 17802 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.065671 12730 raft_consensus.cc:1240] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:08:42.075943 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:42.076953 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.080631 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.081632 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.056186 17779 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.057540 17505 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.064181 17666 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.034489 17698 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:42.049377 17789 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.125573 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.089228 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.093609 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.168699 12799 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:42.081611 17829 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.081826 17481 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:42.102365 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.164166 12679 placement_policy_util.cc:248] tablet 4a839b697aea46da87cb69b00515389e: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:42.093356 17830 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.091477 17693 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.092000 17505 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.084599 17729 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.156454 17835 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:42.177776 17781 consensus_queue.cc:1175] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45825bb09c34201b13ddcec07c4b3f1" responder_term: 16 status { last_received { term: 16 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:42.147843 17838 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:42.083693 17611 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:42.172614 17795 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:42.241405 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 139168us
I20260709 13:08:42.245136 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.116479 17775 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809) with higher term. Message: Invalid argument: T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:42.097754 17687 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:08:42.089988 17529 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:08:42.111048 17666 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.295185 12699 leader_election.cc:400] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15.
I20260709 13:08:42.240865 17481 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:42.211115 17829 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:42.312026 12847 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.317744 17611 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.290311 17835 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.334935 17693 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:42.246238 17802 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.250960 17505 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.293483 17817 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:42.242645 17405 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.358347 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.234552 17732 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:08:42.365480 17481 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.289541 17838 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:42.367223 17837 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:08:42.368149 17836 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:42.368371 17405 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.368937 12878 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:42.370273 17666 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.318418 17728 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:42.374375 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.377626 12727 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.383773 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.386718 12727 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:42.389415 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.360669 17778 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.403298 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.403987 12800 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 11.
I20260709 13:08:42.391053 12727 raft_consensus.cc:1240] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:42.404860 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.405485 12800 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:42.406325 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.335649 17693 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.373442 17198 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:42.410526 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:42.407223 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
W20260709 13:08:42.385330 17840 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:08:42.413756 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:42.415774 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.374568 17817 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.418215 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:42.402156 17778 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.393678 17666 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.423725 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:42.421567 12800 raft_consensus.cc:2393] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:42.426648 12727 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:42.427721 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.428570 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.428855 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.432104 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.435696 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.436697 12727 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:42.422087 17778 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.438930 17835 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.440507 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:42.452507 12805 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:42.455022 12805 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:42.458266 17838 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.458907 17838 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.410665 17829 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.439131 17693 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.466261 17775 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.466712 17832 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.467926 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:42.463941 17841 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:08:42.440398 17630 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.441709 17578 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:42.443861 17666 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:42.419250 17198 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.439608 17835 raft_consensus.cc:493] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:42.440019 17351 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:42.498538 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 114248us
I20260709 13:08:42.485504 17639 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.484163 17775 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:42.485780 17630 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:42.512459 17666 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.545789 17750 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:42.532871 17630 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.499214 17835 raft_consensus.cc:515] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:42.486760 17832 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.498914 17578 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:42.540674 17845 log.cc:927] Time spent T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:42.499159 17351 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.541491 17843 log.cc:927] Time spent T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:08:42.529028 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 100501us
I20260709 13:08:42.535290 17726 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.563042 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:42.566236 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57192.9us
I20260709 13:08:42.567543 12847 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.570890 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:42.574157 17775 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.560719 17351 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.553370 17750 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.583098 17835 leader_election.cc:290] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:42.572078 17768 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:42.590473 17852 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:42.593751 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 108574us
I20260709 13:08:42.595599 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.596405 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.597944 12728 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:42.597947 12727 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:42.597117 12733 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:42.587208 17773 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:42.583148 17639 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:42.616358 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.617226 12725 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 15: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:42.599208 17768 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:42.619262 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:42.601078 17630 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.618243 17832 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.627701 17750 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.617993 17778 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.615391 17773 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.636889 17851 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:42.653744 17704 raft_consensus.cc:3055] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.654420 17704 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:42.651717 17789 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.631932 17505 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.651814 17851 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.673065 17849 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:08:42.659192 17857 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:42.674461 17857 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.676676 17857 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:42.677608 17853 log.cc:927] Time spent T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:42.670455 17851 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.644160 17768 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.701444 17726 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:42.704597 17726 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.703141 17697 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.655637 17704 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.713289 17704 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.717233 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.718228 17630 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.719218 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.725481 17351 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:42.730751 17844 log.cc:927] Time spent T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
I20260709 13:08:42.732026 12803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2503) took 1049 ms. Trace:
I20260709 13:08:42.737787 17857 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:42.738088 17667 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:42.739009 17775 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.739387 17775 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:42.739720 17505 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.740202 17775 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.741465 17775 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:42.756925 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.737875 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:42.737332 12803 rpcz_store.cc:276] 0709 13:08:41.682947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.683293 (+   346us) service_pool.cc:224] Handling call
0709 13:08:41.683550 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.789041 (+105491us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:41.952124 (+163083us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.111653 (+159529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.111738 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:42.111822 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.731669 (+619847us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400033c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:42.731736 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.731945 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17923,"prepare.queue_time_us":329654,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":956,"raft.queue_time_us":23203,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7063,"spinlock_wait_cycles":242134400,"thread_start_us":308157,"threads_started":2,"wal-append.queue_time_us":192321}
I20260709 13:08:42.774091 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.775206 12731 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
W20260709 13:08:42.777216 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 158011us
I20260709 13:08:42.756590 17505 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.741820 17851 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.782150 12848 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:42.769052 17746 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.791122 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.771159 17639 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.776821 17504 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:42.800696 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.801729 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:42.803623 12848 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:42.807158 12799 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:42.803223 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:42.808892 12800 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.810817 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.812450 12803 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:42.812546 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.801707 17667 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.815296 17697 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:42.805209 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.783803 17726 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.801306 17351 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.818854 17630 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.801373 17639 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.802101 17746 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.805274 17504 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.803385 17505 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.840240 12800 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:42.843585 17539 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.848676 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:42.852864 17773 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.853585 17747 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.854174 17747 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:42.855823 12802 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:42.856200 12802 pending_rounds.cc:85] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:08:42.856382 17747 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.857223 17777 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.856418 12802 pending_rounds.cc:107] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:42.857707 12802 raft_consensus.cc:2889] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.858237 17697 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:42.858922 17697 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:42.859961 17697 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.864503 17817 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.865803 17851 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.834347 17778 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:42.873804 17746 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.848505 17351 raft_consensus.cc:2764] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:42.876945 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:42.877871 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:42.879972 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.880908 12880 raft_consensus.cc:2410] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:42.835731 17639 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.886010 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.886448 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.887038 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.889501 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:42.892207 12800 raft_consensus.cc:2410] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:42.890651 12799 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:42.873840 17504 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.881340 17505 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:42.903330 17818 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 1.245s	user 0.003s	sys 0.015s
I20260709 13:08:42.904754 12806 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:42.906416 12807 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.914641 12807 raft_consensus.cc:2410] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:42.916651 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:42.917181 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.927943 17539 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.928752 17539 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.929399 17578 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.930588 13487 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:42.931136 17539 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.932400 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:42.933641 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37670 (request call id 2542) took 1661 ms. Trace:
I20260709 13:08:42.934017 12882 rpcz_store.cc:276] 0709 13:08:41.272477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.272853 (+   376us) service_pool.cc:224] Handling call
0709 13:08:41.273195 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.296606 (+ 23411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.296638 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.297156 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.420626 (+123470us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.420678 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.426866 (+  6188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.902550 (+1475684us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:42.933338 (+ 30788us) raft_consensus.cc:1685] finished
0709 13:08:42.933360 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.933578 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22953,"raft.queue_time_us":23922,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":41941504,"thread_start_us":123034,"threads_started":1,"wal-append.queue_time_us":170975}
I20260709 13:08:42.935977 17660 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.936369 17746 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.936849 17746 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.937201 17746 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.941704 17539 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.942324 17539 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:42.944454 17698 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:42.947520 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:42.952955 17198 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:42.962997 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 159449us
I20260709 13:08:42.964202 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:42.944555 17539 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:42.965238 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:42.986478 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:42.987092 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.987401 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:42.988209 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:42.988889 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.989070 12877 raft_consensus.cc:2410] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:42.972812 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:42.997753 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:42.998791 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.001201 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:43.002224 12880 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.005827 12879 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:43.005744 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.007021 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.008224 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.008555 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.009347 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.009500 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.010834 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:43.011468 12730 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.012156 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.014297 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:43.017086 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51945us
I20260709 13:08:43.020874 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.024647 12879 raft_consensus.cc:2410] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:43.031126 12882 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:42.998574 17775 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.034221 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.015120 12878 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:43.046111 12800 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:43.038094 12806 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.001488 17351 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.056526 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.059469 12730 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:43.048235 12880 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:43.021944 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f17b4815ff84374bc9e1b330d886c34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:43.062265 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.027025 17777 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.065169 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.046998 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:43.072388 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.003379 17851 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:43.013273 17857 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:43.037745 17732 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.081048 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.082218 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.093067 12725 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:43.080423 12732 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:43.087705 12731 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:43.088295 12882 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 12: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:43.095906 17857 consensus_queue.cc:1243] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:43.098827 17732 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.105136 17732 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.108557 12771 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:43.110244 12771 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:43.113464 17568 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.114382 17568 raft_consensus.cc:2764] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:43.115080 17568 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.115597 17568 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:43.077920 17817 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:43.132381 12877 raft_consensus.cc:1217] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Deduplicated request from leader. Original: 9.5->[12.6-12.6]   Dedup: 12.6->[]
I20260709 13:08:43.133178 12877 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:43.136133 12875 raft_consensus.cc:2393] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:43.086051 17777 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:43.076990 17789 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:08:43.161239 12877 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:43.141960 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.162004 12882 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:43.148195 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:43.163497 12807 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:43.153228 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:43.155423 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:43.165318 12802 raft_consensus.cc:2393] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 12: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:43.156718 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:43.160178 12808 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:43.146457 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:43.165462 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.167944 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:43.168164 12808 raft_consensus.cc:1217] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-16.9]   Dedup: 12.7->[14.8-16.9]
I20260709 13:08:43.170369 12808 pending_rounds.cc:85] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 7
I20260709 13:08:43.170957 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.171324 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.170624 12808 pending_rounds.cc:107] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:43.172418 12808 raft_consensus.cc:2889] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.172333 17529 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.173743 17529 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.174202 17529 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.182173 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:43.193305 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:43.164109 17667 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:43.198405 17667 consensus_queue.cc:1243] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:43.199821 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:43.204104 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.206413 12848 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:43.208837 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.160948 17777 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.135946 17780 consensus_queue.cc:1059] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:43.216627 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.183748 17539 raft_consensus.cc:2749] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:43.210942 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:43.165205 17776 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:08:43.211542 17768 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.215488 17778 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.212386 17789 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:43.250336 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:43.311757 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 61552.2us
I20260709 13:08:43.313660 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.257009 17568 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.232528 17763 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.203434 17504 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:08:43.296428 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 92397.6us
W20260709 13:08:43.304425 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 93550us
I20260709 13:08:43.349798 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:43.208078 17696 consensus_queue.cc:1059] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:08:43.308144 12882 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:08:43.335832 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.336159 17775 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.352258 12696 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.354270 12805 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:43.357100 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:43.309242 17778 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.341503 17838 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.374136 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:43.360019 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:43.348750 17871 log.cc:927] Time spent T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:43.375483 12696 leader_election.cc:304] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.340050 17802 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:43.404316 12696 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.359782 17829 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:43.411113 12848 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:43.376998 17778 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.399987 17763 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:43.399899 17729 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.411195 17838 raft_consensus.cc:2749] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.403069 17666 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.407111 17802 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:43.431533 17781 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.431857 17802 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:43.426108 17763 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.432687 17763 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.432829 17789 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:43.433355 17789 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:43.435272 17789 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:43.415422 17775 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:43.436545 17870 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:43.425899 17776 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.437695 17776 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:43.438898 17776 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.441316 17829 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.425674 13513 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:43.445281 17887 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:43.446161 17887 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:43.474568 12801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45496 (request call id 2515) took 1072 ms. Trace:
I20260709 13:08:43.453459 17887 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.475209 12801 rpcz_store.cc:276] 0709 13:08:42.401957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.404127 (+  2170us) service_pool.cc:224] Handling call
0709 13:08:42.404421 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.416540 (+ 12119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.416581 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:42.950432 (+533851us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b2c000354a8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:42.950962 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.169895 (+218933us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:43.411448 (+241553us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.474042 (+ 62594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.474139 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.474195 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:43.474323 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.474493 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49791,"prepare.queue_time_us":64499,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":36164,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":4472,"spinlock_wait_cycles":8864000,"thread_start_us":460086,"threads_started":3,"wal-append.queue_time_us":413864}
W20260709 13:08:43.477806 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 66783.5us
I20260709 13:08:43.479208 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:43.426488 17847 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.481771 17781 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.494001 12848 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:43.489611 17639 consensus_meta.cc:287] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.006s
W20260709 13:08:43.510725 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 170602us
I20260709 13:08:43.544689 17781 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.499651 17847 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.547674 17698 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:43.548123 17698 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:43.549213 17698 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.550529 17698 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.531529 17529 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.554401 17777 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.518409 17639 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.556854 17529 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.547089 17763 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:43.569422 17877 log.cc:927] Time spent T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
W20260709 13:08:43.571063 17886 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
W20260709 13:08:43.575711 17875 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:08:43.577405 17880 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:08:43.596071 17874 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 13:08:43.584846 17847 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.599499 17847 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:43.600935 17873 log.cc:927] Time spent T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.169s	user 0.003s	sys 0.001s
W20260709 13:08:43.601126 17879 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:08:43.603066 17763 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:43.539856 17746 consensus_meta.cc:287] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:08:43.604507 17746 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.607427 17829 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.607897 17746 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.593941 17777 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.589706 17639 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.672606 12726 raft_consensus.cc:2368] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
W20260709 13:08:43.687119 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 193095us
I20260709 13:08:43.710171 17351 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.711616 17351 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.712914 17639 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.714001 17639 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.743837 17773 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:43.744726 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 68065.6us
W20260709 13:08:43.745712 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.747586 17777 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:43.759891 17351 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.766168 17777 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:43.766811 17777 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:43.768525 17777 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.770040 17777 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.773382 17778 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:43.782992 17907 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:08:43.783350 17835 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:43.767360 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.753198 17704 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:43.798247 17704 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:43.783974 17835 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:43.801371 17835 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.802259 17704 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:43.803359 17835 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:43.806257 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.820356 12726 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:43.821712 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:43.819008 17778 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.830307 12727 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:08:43.837191 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 431158us
I20260709 13:08:43.838604 12696 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:43.840029 12807 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:43.841601 12808 pending_rounds.cc:85] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 7
I20260709 13:08:43.841997 12808 pending_rounds.cc:107] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:08:43.842316 12808 raft_consensus.cc:2889] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.845558 12728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52116 (request call id 1822) took 1075 ms. Trace:
I20260709 13:08:43.846093 12728 rpcz_store.cc:276] 0709 13:08:42.769805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.770001 (+   196us) service_pool.cc:224] Handling call
0709 13:08:42.772757 (+  2756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.883255 (+110498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.883303 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:42.883920 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 13:08:43.372508 (+488588us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:43.372560 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.574859 (+202299us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:43.844895 (+270036us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400308754. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf3e01 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:43.844970 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.845088 (+   118us) raft_consensus.cc:1685] finished
0709 13:08:43.845107 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.845341 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":637,"raft.queue_time_us":925,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":304629760,"thread_start_us":388454,"threads_started":1,"wal-append.queue_time_us":581898}
I20260709 13:08:43.860474 12804 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:08:43.863175 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 98316us
I20260709 13:08:43.865916 17896 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.867036 17896 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:43.888803 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:43.893812 12804 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:43.866075 12627 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.893719 12726 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.896706 17852 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.905622 17838 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.905840 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:43.906596 17838 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.907250 12804 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.908361 17852 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:43.911159 17852 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:43.912544 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:43.920622 12803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:43.921686 12803 raft_consensus.cc:606] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:43.922103 12803 raft_consensus.cc:614] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.891561 17773 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:43.923209 17773 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.929374 17904 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:43.929752 12696 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:43.927831 17773 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.949302 17904 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.950856 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:43.950021 17838 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:43.941478 17351 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.965052 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:43.966615 17198 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.967706 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.967435 17198 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.970148 17198 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.962080 17639 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:43.944273 17896 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.983337 12627 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 5 to 7, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:43.984479 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:43.981781 12728 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:43.986722 12627 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.976495 17838 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.986037 17351 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:43.986428 17895 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:44.000907 12873 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:44.001385 17351 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.006697 12726 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:44.011657 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.014369 12804 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:44.016278 17894 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.019045 17838 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.022372 17838 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.022620 17763 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:44.023661 17763 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.026777 17763 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.027439 12874 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:44.018316 12728 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:44.037683 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64952f9027442eb482fbc10cf426fe" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.041785 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:44.043417 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 157586us
I20260709 13:08:44.044818 12873 raft_consensus.cc:2410] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:44.035028 17894 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.037225 12627 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.040078 17904 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.041698 17789 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
W20260709 13:08:44.053913 12771 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6a3cae9c8f5497a965082c096899998. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.058698 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:44.059533 12882 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.062364 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.052837 17835 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.073906 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
W20260709 13:08:44.075155 17698 consensus_meta.cc:287] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.502s	user 0.025s	sys 0.004s
W20260709 13:08:44.082748 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.082794 12725 raft_consensus.cc:2393] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 15: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:44.084299 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:44.084975 12873 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.074501 17835 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.067358 17789 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:44.089393 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:44.090194 17777 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.099925 12874 raft_consensus.cc:2393] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:44.100730 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:44.092283 17912 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:44.100147 12627 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 5 to 8, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 8 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:44.105571 17894 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.109457 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.113070 12882 raft_consensus.cc:2410] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:44.121858 12727 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:44.126430 12873 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:44.127782 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:44.129479 12803 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.131551 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.117806 17777 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.136216 17778 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.137058 12774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.130690 17789 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:44.139668 12728 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:44.145098 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.143049 17778 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.147061 17838 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:44.147364 12873 raft_consensus.cc:1240] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:44.149286 17778 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.152490 17899 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:44.154872 17899 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:44.160692 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:44.157809 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:44.163578 17915 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
I20260709 13:08:44.163779 17847 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.164181 17847 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.164711 17847 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.168438 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.169426 12875 raft_consensus.cc:2393] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:44.170714 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.172286 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:44.164134 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 79213.7us
I20260709 13:08:44.174759 12875 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:44.176210 12847 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.177347 12803 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:44.178191 17899 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:44.179879 17899 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:44.179908 17838 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:44.181305 17895 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:44.181787 17895 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:44.182790 17895 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.181442 17899 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.184298 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.186039 17680 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.186476 17639 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.187178 17895 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.187518 17639 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.201514 12874 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:44.189220 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.200430 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.204981 17639 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.206089 17351 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:44.206656 17351 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.207021 17351 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.209316 17847 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.211452 17698 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.212294 17835 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.212080 17698 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.214430 17698 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.219406 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.211771 17847 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.188225 12627 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 8 to 3, term changed from 13 to 11, leader changed from <none> to a865487bf1854df8a5619d42465bb36c (127.11.78.4), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) added. New cstate: current_term: 11 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:44.224116 17916 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:44.224203 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.216408 17777 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.225095 12803 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:44.224725 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.230331 12805 raft_consensus.cc:2410] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:44.228546 12806 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:08:44.222985 17835 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.244848 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.248356 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.248950 12726 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.248221 12729 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:44.248381 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.254288 12727 raft_consensus.cc:2410] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:44.243175 17777 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.258670 17899 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:08:44.259558 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70507us
I20260709 13:08:44.266706 12847 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.281279 12874 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:44.282480 17899 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.284456 17899 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:44.286188 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.260004 17777 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.291694 12696 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.298473 17777 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.288300 17899 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:44.309003 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.312259 17896 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:44.315467 12773 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.320129 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:44.322772 12875 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:44.324009 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.302534 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:44.303679 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.328248 17835 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.331651 12726 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:44.332973 12873 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:44.344975 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.346391 17896 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.347028 17896 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.349531 17896 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.334960 17777 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.353113 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.353621 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:08:44.354569 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 100493us
I20260709 13:08:44.358727 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:44.359618 12805 raft_consensus.cc:2368] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:44.361645 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.362690 12877 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:44.363605 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.367628 12733 raft_consensus.cc:1240] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:44.354725 17777 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.368583 17777 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.369220 12771 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.370900 17789 raft_consensus.cc:2749] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:44.372288 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.373762 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.375310 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:44.377727 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.357499 12874 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:44.379464 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.378176 17776 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:44.381733 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.381983 12803 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:44.381737 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.384603 12773 leader_election.cc:400] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:44.385139 12773 leader_election.cc:403] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.388252 17704 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:44.389113 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:44.389837 12873 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.388442 12805 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:44.393594 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:44.395571 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:44.396152 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.396953 12726 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.395586 17896 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.398995 17923 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:44.399492 17923 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:44.399958 17923 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.405146 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.405932 12733 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.408943 12874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:44.409720 12874 raft_consensus.cc:606] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:44.417644 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:44.421586 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.447108 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.448979 12731 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:44.449214 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.451683 12771 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.452723 17698 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.454406 12771 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.455289 17698 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:44.455952 17698 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:44.456506 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.457036 17698 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.456723 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.462809 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.463491 12733 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:44.469712 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:44.471813 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 78276.3us
I20260709 13:08:44.472427 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.472488 12873 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:44.473946 12726 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:44.387445 17351 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.426009 17896 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:44.489348 12882 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:44.484323 12801 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:44.479413 17776 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.497656 17776 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.498104 17776 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.504685 17896 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.496065 17894 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:44.481384 17789 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:44.520210 17778 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.520967 17778 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.523048 17763 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:44.523667 17763 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.526161 17763 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.530411 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.530694 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.531152 12733 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:44.531893 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.532806 12733 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:44.533028 12726 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:44.535295 12727 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:44.535476 17902 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:44.536597 17902 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.537868 17923 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.484974 17777 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.542374 17777 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.546082 17351 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.519822 17899 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.548967 17899 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.552080 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.553365 17902 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.553874 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.535708 12727 pending_rounds.cc:85] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 7
I20260709 13:08:44.568321 17198 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.568706 12727 pending_rounds.cc:107] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:44.569041 12727 raft_consensus.cc:2889] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.569126 17198 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:44.556066 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 71194.7us
I20260709 13:08:44.558861 17351 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.559243 12773 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.560515 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:44.523821 17778 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.581013 17894 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:44.583009 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.589967 17198 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.594071 12847 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.578544 17923 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.601683 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.603606 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.590956 17778 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.603411 12696 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.606320 12726 raft_consensus.cc:2393] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:44.606418 12725 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:44.608220 17198 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:44.588748 17776 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.612555 17198 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.610189 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.598351 17899 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.627079 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:44.628823 12731 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.588660 17838 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:44.591866 17351 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.607787 17778 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.600339 17835 consensus_queue.cc:1059] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:44.602727 17894 consensus_queue.cc:1059] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:44.641520 17778 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:44.699152 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 95605.9us
W20260709 13:08:44.700712 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92843.6us
I20260709 13:08:44.702539 17198 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.692418 17896 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:44.702735 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66379.5us
I20260709 13:08:44.717406 12773 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.689211 17899 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:44.728986 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 109280us
I20260709 13:08:44.730638 12696 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.737706 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.753881 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.693056 17847 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:44.761649 17351 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:44.702019 17923 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:08:44.704128 17777 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:44.768545 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:44.749493 17698 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:44.774261 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:44.772953 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:44.813689 12724 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:44.767318 17896 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.771077 17704 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.823252 17941 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.824101 17944 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:08:44.834345 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 82907.8us
I20260709 13:08:44.816220 17777 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.835110 17698 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.856552 17777 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.857270 17777 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.857726 17698 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.858321 17698 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.858557 17904 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.859017 17776 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:44.859174 17904 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:44.851992 17894 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:44.860445 17939 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.831976 17941 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.843127 17899 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:44.927886 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 53962.3us
I20260709 13:08:44.917448 17895 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:44.940184 12848 leader_election.cc:400] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:44.879938 17778 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.940768 12848 leader_election.cc:403] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:08:44.947990 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 173801us
I20260709 13:08:44.935892 17895 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:08:44.961246 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 207840us
I20260709 13:08:44.939006 17904 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:44.970750 17198 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16.
I20260709 13:08:44.972972 12847 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:44.994102 12848 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:44.990204 12773 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.001817 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:45.029594 17945 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.029981 12875 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:45.030395 17945 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.052983 17778 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.053041 17945 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.008983 17951 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.971812 17895 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:45.065177 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56761.3us
I20260709 13:08:45.066262 17895 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.066751 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:45.068089 17951 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.076273 17896 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.072365 12848 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.105620 17951 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:44.995354 17639 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:45.106693 12731 raft_consensus.cc:2468] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:44.988418 17952 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:44.992458 17942 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.108886 17639 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:45.113660 17639 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.110383 17958 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:45.114794 17958 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:45.115810 17958 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:45.126238 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 136285us
I20260709 13:08:45.127370 12773 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:45.128571 17959 raft_consensus.cc:2749] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.129633 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:45.130671 17777 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:45.130846 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:45.131196 17777 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.131671 17777 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.132385 17763 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.132905 17763 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.133219 17763 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.123582 12848 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.140568 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.164729 17704 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.165858 17704 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:45.166625 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.172210 12847 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:45.175856 17351 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:45.176537 17351 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:45.177628 17351 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.187636 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.187872 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:45.188406 12873 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.195143 12873 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:45.203938 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:45.204201 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.206928 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.135727 17952 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.159224 17847 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.216251 12730 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:08:45.216753 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63540.1us
I20260709 13:08:45.219045 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.213143 17952 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.157910 17778 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:45.237512 17967 ts_tablet_manager.cc:933] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.237831 17777 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.239475 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.229549 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:45.230096 17966 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:45.235486 17941 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.208315 17923 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:45.158756 17942 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.256434 12724 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:45.257952 12727 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:45.158726 17776 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:45.263202 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.264123 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.262445 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.267055 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:45.281363 12731 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.281538 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.268741 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.272368 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.284456 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:45.282081 17955 raft_consensus.cc:2804] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:45.289541 12771 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.287380 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.294618 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.294673 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.302472 17639 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:45.304728 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 80350.3us
I20260709 13:08:45.294132 17958 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:45.303941 17777 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.309689 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.310729 12875 raft_consensus.cc:1240] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:45.313043 12804 raft_consensus.cc:2410] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:45.297606 17945 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.277412 17959 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:45.300145 17698 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.278889 17923 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.320621 12808 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:45.336131 12806 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:45.296865 17971 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:08:45.341131 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51695.7us
I20260709 13:08:45.343999 12731 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:08:45.344194 12771 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:45.338771 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.346545 12802 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:08:45.346796 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.334192 17777 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.318141 17958 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.360296 17945 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.361234 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:45.364204 17942 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.376490 17777 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.394917 12876 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 13:08:45.403149 17974 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:08:45.439329 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58315.4us
I20260709 13:08:45.401728 17777 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.396103 17923 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.389979 17959 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:45.396185 17945 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:08:45.496538 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.434083 17639 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.518538 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.517895 12873 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:08:45.521137 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.521885 12873 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 16: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:45.528198 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59707.8us
I20260709 13:08:45.540454 12881 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:45.536821 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.545426 12876 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:45.463729 17967 tablet_copy_client.cc:323] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:08:45.561113 12802 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:45.562820 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:45.563964 17939 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.564472 17939 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.564791 17939 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.474424 17959 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.568468 17959 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.570462 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.570940 17904 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.571115 12800 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 7.
I20260709 13:08:45.541127 17952 consensus_queue.cc:1059] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:45.603446 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.610344 17945 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:45.618247 17986 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:45.592579 17895 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:45.632236 12879 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:45.635001 17943 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.631016 17639 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.636519 17639 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.638273 12802 raft_consensus.cc:1240] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:45.638808 17639 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.649802 17958 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.626024 17895 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.654037 17698 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:45.654474 17698 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:45.629927 17959 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.655079 17959 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:08:45.655366 17698 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.657168 17959 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:45.658257 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:45.667670 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.667804 12725 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:45.669706 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.672268 17990 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.664222 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:45.662827 17763 consensus_meta.cc:287] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.005s
I20260709 13:08:45.665673 17895 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.690433 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.697151 17943 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.682825 17763 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.700784 12807 raft_consensus.cc:2368] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15.
I20260709 13:08:45.705173 12728 raft_consensus.cc:2410] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:45.708896 17949 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.672843 17990 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.717078 17847 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:45.720543 17990 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.715293 17942 consensus_queue.cc:1059] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:08:45.721526 17763 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.721940 17942 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:45.722366 17942 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:45.723280 17988 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.723896 17988 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.726137 17988 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.697767 17943 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:45.746877 17964 log.cc:927] Time spent T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.490s	user 0.010s	sys 0.000s
W20260709 13:08:45.749197 17976 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.490s	user 0.002s	sys 0.002s
I20260709 13:08:45.717358 12847 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:45.714534 17698 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:45.772501 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.765014 17937 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.755512 17949 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.785221 17639 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:45.786147 17951 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.791800 17939 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.794011 17942 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.822057 17942 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.825377 12801 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:45.826831 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.827517 12801 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:45.828742 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.829283 12801 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:45.829737 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.831032 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.832746 17990 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:45.832993 17988 consensus_queue.cc:1059] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:45.834569 17990 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:45.834990 17959 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:45.836289 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.834993 17990 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:45.838078 17990 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.840022 17990 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.832769 12848 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:45.798450 17970 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.511s	user 0.000s	sys 0.006s
W20260709 13:08:45.860208 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47317.8us
I20260709 13:08:45.860324 17952 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.860424 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.861240 17952 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.861644 17952 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:45.800141 17923 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.783968 17949 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.805343 17902 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:45.862248 17923 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:45.787021 17937 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:45.862532 17952 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.813534 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:45.862702 17902 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.863517 17923 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.865168 17923 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.866009 17902 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.863654 17937 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.813601 12803 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:45.869699 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.820578 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.875459 12800 raft_consensus.cc:2410] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:45.875654 17980 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.863884 17952 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.877625 12848 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.878253 17980 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.878938 17980 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.879226 12848 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:45.880118 17953 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:45.881345 17953 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:45.881778 17953 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.882141 17953 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.884218 17639 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.884600 17639 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:45.885108 12879 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:08:45.885481 17639 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.886859 17639 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.886426 12630 catalog_manager.cc:5697] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.821122 17943 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:45.850205 17999 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:08:45.850652 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:45.851128 17992 raft_consensus.cc:993] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:45.851569 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:45.854718 12724 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:08:45.855953 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.870645 17902 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.818826 17957 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.889988 12728 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:45.890115 17957 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.888305 12630 catalog_manager.cc:5697] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 10 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 12 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.891652 12630 catalog_manager.cc:5697] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.892455 17957 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.796165 17939 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:45.893196 12630 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 3 to 8, term changed from 11 to 14, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3), VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:45.888563 17992 raft_consensus.cc:1081] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:45.909961 12802 raft_consensus.cc:1240] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:45.911492 12804 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:45.895053 12630 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 14 to 17, leader changed from a865487bf1854df8a5619d42465bb36c (127.11.78.4) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:45.913338 17955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.012s	sys 0.004s
W20260709 13:08:45.914074 17955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.013s	sys 0.004s
I20260709 13:08:45.914395 17955 raft_consensus.cc:697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:45.915514 17955 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.919049 17953 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.922189 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:45.922456 17953 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:45.924149 17992 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:45.924314 12699 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.925233 17992 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:45.925848 17992 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.933259 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.926205 17939 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.936120 12848 leader_election.cc:400] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15.
I20260709 13:08:45.936685 12848 leader_election.cc:403] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.941018 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:45.941782 12877 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.942631 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.943492 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:45.944391 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.945006 12732 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:45.945516 17945 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.945565 17959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55986 (request call id 0) took 2691 ms. Trace:
I20260709 13:08:45.947252 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.948230 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.947012 17959 rpcz_store.cc:276] 0709 13:08:43.254000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.254142 (+   142us) service_pool.cc:224] Handling call
0709 13:08:43.785977 (+531835us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000354a8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fba0a 00007f0f404fb693 00007f0f404fb631 00007f0f41c2e902 00007f0f41c2e6dd 00007f0f41bf9f3f 00007f0f41bf96b3 00007f0f46bb9d29 00007f0f401381d4 00007f0f40138162
0709 13:08:43.838255 (+ 52278us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b580082e8d0. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41b4f0aa 00007f0f41bd1447 00007f0f41bee70a 00007f0f41bef76a 00007f0f41bee91b 00007f0f41bfa03c 00007f0f41bf96b3 00007f0f46bb9d29 00007f0f401381d4 00007f0f40138162
0709 13:08:43.885642 (+ 47387us) log.cc:844] Serialized 492 byte log entry
0709 13:08:44.162709 (+277067us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f4178e86e 00007f0f4178dbb6 00007f0f4178d7d8 00007f0f41797221 00007f0f417971d9 00007f0f41797169
0709 13:08:45.945468 (+1782759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19575,"raft.queue_time_us":26784,"raft.run_cpu_time_us":2532,"raft.run_wall_time_us":8183,"spinlock_wait_cycles":132385920,"thread_start_us":53116,"threads_started":1,"wal-append.queue_time_us":132048,"wal-append.run_cpu_time_us":7679,"wal-append.run_wall_time_us":1208107}
I20260709 13:08:45.949236 17939 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:45.946000 12730 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.949836 17939 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.948642 17952 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.939483 17902 raft_consensus.cc:3060] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.963761 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:45.972298 12732 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:45.979562 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:45.982805 12699 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.984378 12733 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:08:45.985716 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:45.946655 17945 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.988979 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.971774 17943 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:45.994565 12773 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.984645 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:45.999668 17989 raft_consensus.cc:2749] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.991094 17835 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:45.988399 17351 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:46.006319 17943 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:45.997354 17942 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.013628 17942 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:46.016717 12627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 164) took 22884 ms (client timeout 15000 ms). Trace:
I20260709 13:08:46.017805 17945 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.018898 17952 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.019518 17952 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.020354 17952 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.029999 12773 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:45.992226 17899 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.030838 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.034389 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.029306 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.040961 12878 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:46.042719 12730 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:46.050487 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.053339 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.055598 17776 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.055697 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.056689 12880 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:46.032648 17639 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:46.059636 17639 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:46.060735 17639 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.063248 17990 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:46.064126 17990 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:46.040303 17989 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.073632 12877 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:46.078040 12882 raft_consensus.cc:1240] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:08:46.078136 12878 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:46.079226 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.080677 12773 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.082185 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.083302 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:46.086306 12773 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:08:46.090227 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.052501 17971 raft_consensus.cc:2749] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.113601 12877 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:46.092650 12807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:46.116318 12807 raft_consensus.cc:606] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:46.094255 17777 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.116875 17777 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.117257 17777 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.100553 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:08:46.101951 18006 log.cc:927] Time spent T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:08:46.108561 17990 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:08:46.109746 18004 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:46.091215 17958 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.112139 17939 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.112295 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.051405 17992 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.118288 12878 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:46.017269 12627 rpcz_store.cc:269] 0709 13:08:23.139545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.139889 (+   344us) service_pool.cc:224] Handling call
0709 13:08:46.016569 (+22876680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.689680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.762840 (+ 73160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.762910 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:08:44.762950 (+    40us) tablet.cc:662] Decoding operations
0709 13:08:44.763979 (+  1029us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.764155 (+   176us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.764206 (+    51us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:44.765013 (+   807us) tablet.cc:701] Row locks acquired
0709 13:08:44.765067 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:08:44.765248 (+   181us) write_op.cc:270] Start()
0709 13:08:44.765419 (+   171us) write_op.cc:276] Timestamp: P: 1783602524765174 usec, L: 0
0709 13:08:44.765460 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.784656 (+ 19196us) log.cc:844] Serialized 2497 byte log entry
0709 13:08:45.176517 (+391861us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.301545 (+125028us) write_op.cc:301] APPLY: starting
0709 13:08:45.301679 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.362637 (+ 60958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.362749 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.749813 (+387064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.750126 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:45.750197 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:45.750569 (+   372us) log.cc:844] Serialized 64 byte log entry
0709 13:08:45.751489 (+   920us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.751628 (+   139us) write_op.cc:454] Released schema lock
0709 13:08:45.751705 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.752158 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.752190 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25053,"reported_tablets":55,"spinlock_wait_cycles":295680,"child_traces":[["op",{"apply.queue_time_us":117856,"apply.run_cpu_time_us":15061,"apply.run_wall_time_us":450629,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29231,"num_ops":6,"prepare.queue_time_us":183456,"prepare.run_cpu_time_us":17498,"prepare.run_wall_time_us":276861,"raft.queue_time_us":86914,"raft.run_cpu_time_us":35043,"raft.run_wall_time_us":101787,"replication_time_us":410861,"thread_start_us":430557,"threads_started":4,"wal-append.queue_time_us":248098}]]}
I20260709 13:08:46.122026 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:08:46.124537 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 141813us
I20260709 13:08:46.087889 17949 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.140084 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.144940 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.117841 17942 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:46.092988 17904 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:08:46.158582 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.163167 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.138684 17958 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.164899 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:46.168466 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.169418 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.171373 12724 raft_consensus.cc:1240] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:46.162765 12802 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
W20260709 13:08:46.152604 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 168381us
I20260709 13:08:46.184099 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.187660 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet e6a3cae9c8f5497a965082c096899998 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:08:46.188395 18002 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.188844 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet e6a3cae9c8f5497a965082c096899998 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-e6a3cae9c8f5497a965082c096899998
I20260709 13:08:46.189637 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.190130 12731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:46.190459 12727 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:46.190757 12731 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.191130 12731 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.192709 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.193290 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.193439 12726 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:46.187660 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.189702 12733 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:46.197654 12771 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.202129 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.163208 17939 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.178265 17958 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.206245 17763 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:46.207048 17971 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.201483 17949 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.205560 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:46.211045 12848 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:46.213129 12731 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.241895 18009 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.242621 18009 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.243050 18009 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:46.252964 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47439.9us
I20260709 13:08:46.248093 17763 consensus_queue.cc:1243] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:46.248355 18002 consensus_queue.cc:1059] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:46.247977 12818 tablet_copy_source_session.cc:215] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:46.209082 17776 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.278656 12731 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.258891 17980 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.292868 18009 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.295373 18009 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.296451 18002 raft_consensus.cc:3055] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:46.296931 18002 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:46.297823 18002 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.299202 18002 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:46.277468 17976 log.cc:927] Time spent T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:46.274328 17942 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.290166 17980 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.378232 17980 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.369175 17942 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:08:46.383314 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 185614us
W20260709 13:08:46.387126 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 137471us
I20260709 13:08:46.389978 12696 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:46.386802 17942 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.398036 17939 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.397353 17992 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:46.409974 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.425566 12879 raft_consensus.cc:3055] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:46.410259 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.413484 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.427976 12878 raft_consensus.cc:2393] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 16: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:08:46.408589 18008 log.cc:927] Time spent T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:46.426031 12879 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:46.430962 17939 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:46.441987 17902 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 14. Current term is 15.
I20260709 13:08:46.473376 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.473042 12879 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.478631 17351 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:46.487376 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.488974 17967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3cae9c8f5497a965082c096899998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:46.489292 12727 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:46.487377 17943 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.495739 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:46.497622 12773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.498024 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.474342 12879 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.499248 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.502120 12874 raft_consensus.cc:2468] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:46.502995 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.503628 12801 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.504797 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.492151 12732 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:46.508332 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.509361 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.514866 12847 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:46.516415 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 90440.1us
I20260709 13:08:46.519901 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.441721 17939 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.437486 17777 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.528611 17992 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.529597 17777 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.530025 12805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45512 (request call id 1878) took 1286 ms. Trace:
I20260709 13:08:46.530596 12805 rpcz_store.cc:276] 0709 13:08:45.243631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.244269 (+   638us) service_pool.cc:224] Handling call
0709 13:08:46.529729 (+1285460us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b5400033c54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf72fa 00007f0f46bb8b17 00007f0f401336d4 00007f0f40133662 00007f0f40133591 00007f0f4013350c 00007f0f401327c2 00007f0f3ff2e48c 00007f0f3ff2d8c6 00007f0f3ff2d26f
0709 13:08:46.529917 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991707520}
I20260709 13:08:46.521682 12799 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:46.541272 12806 raft_consensus.cc:3055] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:46.529325 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.541741 12806 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:46.555100 17990 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:46.555620 17990 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:46.506927 17957 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.556016 17990 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:46.493203 17952 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.563381 12731 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:08:46.563982 12731 pending_rounds.cc:85] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting all ops after (but not including) 6
I20260709 13:08:46.564328 12731 pending_rounds.cc:107] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:08:46.564566 12731 raft_consensus.cc:2889] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.570748 12727 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.508911 17923 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.581307 12806 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.582703 12806 raft_consensus.cc:3060] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.585044 17894 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:46.585489 17894 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:46.585889 12773 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:46.442771 17980 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.573041 17958 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.597465 12773 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.571686 17952 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.603504 12801 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:08:46.607439 12807 raft_consensus.cc:2368] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:46.609961 17951 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.610543 17951 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.611989 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:46.615391 12878 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:46.600741 17955 raft_consensus.cc:2804] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.624574 17955 raft_consensus.cc:697] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:46.625520 17955 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.629186 12727 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:46.630523 12773 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:46.636439 12879 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:08:46.638053 12696 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:46.646473 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.647500 12874 raft_consensus.cc:2393] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:46.586431 17894 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.662786 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.667240 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.667030 18033 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:46.667896 12731 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.671973 12807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:46.672802 12807 raft_consensus.cc:606] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:46.672823 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.673691 12803 raft_consensus.cc:2368] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:46.645129 17698 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.652410 17904 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.682499 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:46.684325 12731 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:46.688555 12729 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:46.686003 17943 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:46.663378 17776 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:46.709064 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:46.662204 18018 consensus_queue.cc:1059] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:46.708894 17990 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.687789 18027 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:46.745947 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63214.3us
I20260709 13:08:46.746742 12806 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:46.748097 12806 pending_rounds.cc:85] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:08:46.748500 12806 pending_rounds.cc:107] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:46.748844 12806 raft_consensus.cc:2889] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.749728 17943 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:46.750208 18014 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.750505 12699 leader_election.cc:400] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:46.750655 18014 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.751089 12699 leader_election.cc:403] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.751291 18014 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.750808 17943 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.752772 17895 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:46.756714 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.757899 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.758525 12727 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.761427 17895 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:46.765766 12727 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:46.747601 17957 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.778858 17957 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:46.781798 17957 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:46.783066 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:46.737656 17990 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.792484 12847 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:46.764238 17951 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:46.770658 18016 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:46.767634 17943 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:46.798245 17958 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.796504 18038 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:46.799714 17943 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.804247 18014 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.809036 17980 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:46.809244 17943 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.810930 18038 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:46.812064 18038 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:46.812837 12679 auto_rebalancer.cc:629] Failed to schedule move for tablet e76bdc6d77354bafb6cab7951596cb2a: Illegal state: Replica 83d2731c4bc049b3929d6c39670f5fd8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:46.807636 17942 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.817312 12699 leader_election.cc:400] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:46.817759 12699 leader_election.cc:403] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.829566 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.830561 12807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:46.831120 12807 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:46.832007 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.833761 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.834069 12874 raft_consensus.cc:1240] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.834431 12800 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.835440 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:46.836926 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.837675 12875 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.842060 12877 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:46.843605 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.839515 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.844940 12874 raft_consensus.cc:2393] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 9: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:46.845041 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:46.845700 12881 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.847695 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:46.848402 12804 raft_consensus.cc:2410] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:46.849326 12805 raft_consensus.cc:2393] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 11: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:46.849618 12880 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:08:46.855664 17932 raft_consensus.cc:2749] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) with higher term. Message: Invalid argument: T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14.
I20260709 13:08:46.850546 17763 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:46.852057 18014 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:46.878602 17763 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.881763 12805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:46.882524 12805 raft_consensus.cc:606] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:46.882869 12805 raft_consensus.cc:614] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.892024 12875 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
W20260709 13:08:46.905334 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.915201 12803 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:46.923890 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.927073 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:46.930011 17777 raft_consensus.cc:993] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:46.930673 17777 raft_consensus.cc:1081] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
W20260709 13:08:46.950518 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 99635.5us
I20260709 13:08:46.957042 18038 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:46.961247 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:46.962222 18038 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.963512 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:46.964260 18038 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.941951 18033 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.965116 18033 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.967459 18033 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:46.968479 17942 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:46.973155 18020 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.973547 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.974152 12875 raft_consensus.cc:1240] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:46.976442 12773 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:46.975639 12881 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:46.983320 17904 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:46.983889 17904 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:46.984704 17904 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:46.986523 17894 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.991586 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:46.992604 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:46.992666 17932 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:46.997025 17932 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:46.998035 17932 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.003400 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:47.008805 17763 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:47.003619 18043 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:08:47.012142 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:47.021478 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:47.022116 12801 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 10.
I20260709 13:08:46.973764 18020 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.016826 12800 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:47.017633 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:47.018285 12727 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:08:47.037377 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:47.038005 12733 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.038380 12733 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.039593 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:47.043691 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:47.048384 12848 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:47.049651 12725 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 9.
I20260709 13:08:47.052170 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:47.052219 12806 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:47.057997 17763 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.059070 18020 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:47.065023 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.066344 12727 raft_consensus.cc:2393] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 11: Already voted for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in this term.
I20260709 13:08:47.057382 17992 raft_consensus.cc:2749] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.054713 17937 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.054270 17942 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:47.051503 18014 consensus_queue.cc:1059] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:47.099288 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:47.107375 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 172137us
I20260709 13:08:47.108067 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:47.081995 17967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38680 (request call id 431) took 2189 ms. Trace:
I20260709 13:08:47.114214 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.095738 17942 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.120209 12875 raft_consensus.cc:1240] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:47.122252 12733 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.126736 12730 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:47.127532 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:47.128113 12728 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.141166 12873 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:47.128338 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:47.078692 18033 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:47.145943 12875 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:47.126345 17942 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.152207 18019 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:47.152920 18019 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:47.153973 18019 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.156056 12733 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.160568 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:47.162417 12799 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.162855 12799 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:47.171594 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.137022 17763 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:47.172796 12725 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 11.
I20260709 13:08:47.169730 18018 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:08:47.207959 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 144379us
I20260709 13:08:47.213441 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:47.211073 12799 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.224012 12799 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.116581 17967 rpcz_store.cc:276] 0709 13:08:44.889598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.890235 (+   637us) service_pool.cc:224] Handling call
0709 13:08:45.237989 (+347754us) ts_tablet_manager.cc:934] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:08:46.487415 (+1249426us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:46.801758 (+314343us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.801906 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:46.965081 (+163175us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:47.023077 (+ 57996us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:47.067993 (+ 44916us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:47.072230 (+  4237us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":106702,"tablet-copy.queue_time_us":294794,"thread_start_us":173368,"threads_started":2}
I20260709 13:08:47.227583 17967 tablet_copy_client.cc:806] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.228219 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 79) took 7839 ms. Trace:
I20260709 13:08:47.229508 17967 tablet_copy_client.cc:670] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.237561 18035 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:47.229925 17763 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.247900 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:47.248598 12878 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.230108 12630 rpcz_store.cc:276] 0709 13:08:39.385975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.391022 (+  5047us) service_pool.cc:224] Handling call
0709 13:08:47.224784 (+7833762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:46.105160 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:46.105987 (+   827us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:46.106035 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:46.106062 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:46.106999 (+   937us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:46.107106 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:46.107149 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:46.107866 (+   717us) tablet.cc:701] Row locks acquired
0709 13:08:46.107892 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:46.132284 (+ 24392us) write_op.cc:270] Start()
0709 13:08:46.141242 (+  8958us) write_op.cc:276] Timestamp: P: 1783602526122093 usec, L: 0
0709 13:08:46.144643 (+  3401us) op_driver.cc:348] REPLICATION: starting
0709 13:08:46.270171 (+125528us) log.cc:844] Serialized 2038 byte log entry
0709 13:08:46.449454 (+179283us) op_driver.cc:464] REPLICATION: finished
0709 13:08:46.558672 (+109218us) write_op.cc:301] APPLY: starting
0709 13:08:46.558763 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:46.581266 (+ 22503us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:46.581371 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:46.652557 (+ 71186us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:46.688717 (+ 36160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:08:46.693654 (+  4937us) write_op.cc:312] APPLY: finished
0709 13:08:46.728943 (+ 35289us) log.cc:844] Serialized 56 byte log entry
0709 13:08:46.729150 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.729273 (+   123us) write_op.cc:454] Released schema lock
0709 13:08:46.729330 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:46.729764 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.729799 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66250,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":108935,"apply.run_cpu_time_us":9145,"apply.run_wall_time_us":171062,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":152469,"prepare.run_cpu_time_us":5526,"prepare.run_wall_time_us":178811,"replication_time_us":304625,"thread_start_us":138182,"threads_started":2}]]}
I20260709 13:08:47.272742 18009 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:47.273312 18009 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:47.274273 18009 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:47.276324 18050 log.cc:927] Time spent T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:47.287966 17904 raft_consensus.cc:993] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:47.266155 17939 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.290190 12802 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:47.292434 12802 pending_rounds.cc:85] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:08:47.275875 18009 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.292567 12799 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:08:47.292768 12802 pending_rounds.cc:107] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:08:47.293010 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.297926 12802 raft_consensus.cc:2889] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.296530 17939 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.299206 12878 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
W20260709 13:08:47.300670 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56259.1us
I20260709 13:08:47.311651 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:47.328609 12728 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:47.339622 18024 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:47.340349 18024 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:47.348834 12804 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:47.350872 17967 tablet_copy_client.cc:538] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:47.348904 12679 auto_rebalancer.cc:629] Failed to schedule move for tablet fb04297576e2483ca596edd2dd418b52: Illegal state: Replica c45825bb09c34201b13ddcec07c4b3f1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:47.357143 17939 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.330538 17895 consensus_queue.cc:1059] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:47.358744 17895 raft_consensus.cc:3055] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:47.359071 17895 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:47.359968 17895 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.361405 17895 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:47.321746 18045 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.245s	user 0.004s	sys 0.000s
I20260709 13:08:47.314508 17904 raft_consensus.cc:1081] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:47.333065 17932 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.365531 12799 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:08:47.319335 17943 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:47.329069 17942 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.370525 12881 raft_consensus.cc:2368] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:47.371019 12799 pending_rounds.cc:85] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 6
I20260709 13:08:47.371412 12799 pending_rounds.cc:107] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 14.7
W20260709 13:08:47.367278 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 158477us
I20260709 13:08:47.372184 12799 raft_consensus.cc:2889] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.371264 12878 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:47.386521 12731 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:47.390089 18024 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.392803 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:47.401666 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:47.409590 12800 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:47.402504 12799 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:08:47.409898 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 78559.2us
I20260709 13:08:47.414146 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:47.421802 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:47.423825 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:47.424499 12732 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.425206 12732 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.399714 17942 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:47.404397 17904 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:47.420940 17939 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:47.404891 17777 consensus_queue.cc:1059] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:47.430572 17954 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:47.428712 18068 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:47.454293 17954 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.454835 18068 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.455200 18068 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.456502 17954 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:47.458143 17967 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:08:47.460407 17939 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:47.461709 17939 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.464851 18022 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.444739 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a839b697aea46da87cb69b00515389e with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41706
I20260709 13:08:47.422765 17943 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:47.477311 12771 leader_election.cc:400] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:47.477802 12771 leader_election.cc:403] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.483207 12881 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:47.484549 12732 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.493875 18019 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.521335 18018 raft_consensus.cc:993] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:47.521976 18018 raft_consensus.cc:1081] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
W20260709 13:08:47.515015 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 93461us
I20260709 13:08:47.515479 17894 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.523393 17904 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.523793 17894 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.526786 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:47.528745 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:47.516004 12732 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.529168 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.529456 12799 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:47.529801 12799 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:47.532969 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:47.534798 12805 raft_consensus.cc:2393] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 16: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:47.543766 12731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:47.544656 12731 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.545239 12731 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.564011 12799 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.565522 12799 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.572729 18068 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.575070 18068 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.545025 17943 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:47.544771 18049 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:47.577575 18049 consensus_queue.cc:1243] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Peer 83d2731c4bc049b3929d6c39670f5fd8 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:47.551815 17894 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.612906 12808 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:47.617998 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:47.618778 12881 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 15.
I20260709 13:08:47.622654 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:47.635840 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:47.636809 12881 raft_consensus.cc:2393] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 13: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:47.642395 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 4a839b697aea46da87cb69b00515389e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:47.642762 12873 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:47.643441 12802 pending_rounds.cc:85] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 7
I20260709 13:08:47.643764 12802 pending_rounds.cc:107] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:47.643988 12802 raft_consensus.cc:2889] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.654655 12799 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:47.656134 12731 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.682701 12731 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:47.675678 17776 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:47.704965 17953 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.705881 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:47.663439 18049 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:47.726446 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:47.727165 12881 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.733008 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:47.734016 12882 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.748418 17957 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.750890 17980 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.751586 17980 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:47.752110 12845 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b39827c8d024243a5a2883bc2c2bd83. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.752838 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 88564.4us
I20260709 13:08:47.750069 12881 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:47.756300 18077 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:47.757187 18077 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:47.767328 12874 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:47.823401 12725 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:47.825317 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:47.729451 17978 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:47.864569 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 88889.6us
I20260709 13:08:47.817636 18077 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:47.780028 17895 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:08:47.880755 12731 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:47.885847 12699 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:47.886024 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51174.9us
I20260709 13:08:47.893388 12882 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:08:47.895289 12732 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:08:47.885331 18021 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:08:47.902133 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:47.902853 12728 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.888634 18019 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 11. Current term is 12.
I20260709 13:08:47.909252 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.896169 18027 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:47.873700 17988 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:47.910359 12725 raft_consensus.cc:2368] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 16. Current term is 17.
W20260709 13:08:47.902510 18076 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:08:47.928092 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.945986 12628 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:47.947465 12628 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 7, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 7 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:08:47.948792 18079 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:47.949354 12628 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:47.975533 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:47.976352 12725 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:47.976801 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:47.956823 18027 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:47.954457 17980 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:48.015789 12806 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:48.030292 12728 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 12.
I20260709 13:08:48.020210 12628 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.040174 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:48.042106 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:48.042883 12799 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:08:48.001296 17902 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.999917 18075 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.045758 18027 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.045562 12628 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 12, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.074285 12628 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.055711 18049 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:48.077101 18075 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:48.078150 18075 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.057687 17902 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.082641 17902 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:48.058844 12847 leader_election.cc:400] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 16. Current term is 17.
W20260709 13:08:48.066058 18072 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.116s	user 0.000s	sys 0.004s
I20260709 13:08:48.090430 12847 leader_election.cc:403] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:48.068307 18073 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:08:48.091423 18049 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 16. Current term is 17.
I20260709 13:08:48.096307 17992 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:48.075752 12628 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 11, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 11 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:08:48.104199 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 45508.7us
I20260709 13:08:48.103971 12628 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 9 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.106108 12628 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 6 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.111264 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:48.115674 12628 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.117873 12628 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 14, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.118978 18022 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:48.121143 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:48.145143 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:48.146092 12806 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:48.151780 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:48.152545 12806 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:48.152709 12804 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.154312 12880 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:48.124997 18022 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.143481 17980 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:48.162744 12628 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.167235 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:48.167145 12799 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:08:48.168352 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 191659us
I20260709 13:08:48.175496 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:48.177258 17943 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:48.177735 17943 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:48.178551 17943 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.184285 17980 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:48.187361 12804 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:08:48.170809 12771 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:48.195026 18085 raft_consensus.cc:2749] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.199440 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:48.199636 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:48.200353 12804 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:48.200677 12804 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:48.201419 12804 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.202324 12804 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.198765 12628 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.162257 18022 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.208748 12628 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.213905 12628 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.219260 17902 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.221407 17902 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.234994 12873 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:48.244594 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:48.245585 12806 raft_consensus.cc:2393] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in current term 16: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:08:48.246865 12804 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:48.250048 12880 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:48.251194 12880 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:48.254025 12876 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:48.185264 17980 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.258659 18066 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:48.267478 12806 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:48.268913 18091 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:48.292495 12732 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:48.310585 12628 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 11, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.313055 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46100.1us
I20260709 13:08:48.373097 12628 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.376241 12730 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:48.371555 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:48.378540 12628 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 8, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 8 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.384646 18093 ts_tablet_manager.cc:933] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:48.302064 18019 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:08:48.305058 17955 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:08:48.304769 17943 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 13:08:48.381739 18079 log.cc:927] Time spent T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:48.417402 18070 log.cc:927] Time spent T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:48.434991 12628 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.394384 17992 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:48.443709 12772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.324811 17932 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
W20260709 13:08:48.453229 18099 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:48.456579 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:48.457486 12725 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:48.443813 17902 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:48.467315 12628 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.470409 12628 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:48.427279 17895 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:48.455974 17992 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.526826 17992 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.542923 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:48.545677 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 164185us
W20260709 13:08:48.546893 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.558040 18019 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:48.565613 18033 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:48.579057 18033 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.597074 18033 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.593999 18022 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.597481 18019 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.600081 18019 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:48.602314 12882 raft_consensus.cc:2368] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:48.604382 18022 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:48.624864 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 57969.4us
I20260709 13:08:48.629801 12806 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:48.643132 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:48.644213 12733 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:08:48.645759 12773 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:48.634230 12726 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:08:48.624481 18104 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:48.674281 12875 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:48.694119 18033 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.678188 17954 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.697010 17954 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.672636 18018 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:48.699160 18018 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:48.699602 18018 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.639386 17932 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.702610 17932 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.618206 18014 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:08:48.671660 18074 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:08:48.708504 12696 leader_election.cc:400] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:48.708999 12696 leader_election.cc:403] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:48.717020 12802 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:48.734227 12873 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:48.611469 17992 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.638626 17894 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:08:48.741408 12879 raft_consensus.cc:1240] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:48.742575 12806 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:48.720377 17955 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:48.725492 18069 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.725381 18014 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:48.752863 18075 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:48.755986 17955 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.758538 17955 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:48.759349 18033 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:48.760735 17932 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:48.774078 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 201595us
I20260709 13:08:48.750982 17954 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:08:48.782207 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 223018us
I20260709 13:08:48.796161 18093 tablet_copy_client.cc:323] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:08:48.815889 12882 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:48.818215 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:48.818921 12726 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:48.821817 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:48.820573 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:48.797843 18018 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.822485 12873 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 9.
I20260709 13:08:48.822402 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:48.825606 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:48.826416 18019 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:48.826846 18019 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:48.827230 18019 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.824690 12728 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:48.793056 17932 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:48.797412 17943 consensus_queue.cc:1059] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:48.835881 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:48.839654 12728 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.845114 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:48.848085 12806 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:08:48.869855 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:08:48.872704 18107 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:48.873704 18018 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:48.876751 18069 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17.
I20260709 13:08:48.880336 17895 raft_consensus.cc:3055] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:48.880808 17895 raft_consensus.cc:740] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:48.881099 12696 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:48.884161 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74123.4us
I20260709 13:08:48.885072 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:48.881858 17967 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.830601 18027 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:08:48.909555 12732 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:08:48.920324 12847 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:48.929226 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:48.928329 12728 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:48.881698 17895 consensus_queue.cc:260] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:48.941871 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 2b39827c8d024243a5a2883bc2c2bd83 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:08:48.942633 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 2b39827c8d024243a5a2883bc2c2bd83 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-2b39827c8d024243a5a2883bc2c2bd83
W20260709 13:08:48.944885 18115 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:48.941939 17895 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.949975 17967 tablet_bootstrap.cc:492] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:48.951064 17967 ts_tablet_manager.cc:1403] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.493s	user 0.063s	sys 0.020s
I20260709 13:08:48.900508 18088 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:48.876760 17992 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:48.887197 18075 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:49.059252 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:08:49.060407 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 92981.8us
W20260709 13:08:49.066367 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 145055us
I20260709 13:08:49.075491 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.076670 12877 raft_consensus.cc:2368] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:48.972863 18088 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:48.965885 18086 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 13:08:49.091048 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.065702 17953 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:48.951885 18014 consensus_queue.cc:1175] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "83d2731c4bc049b3929d6c39670f5fd8" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 9 last_received_current_leader { term: 14 index: 10 } }
I20260709 13:08:49.100200 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:49.101651 12882 raft_consensus.cc:2368] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:49.084542 18088 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.122243 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:49.123167 12800 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.081748 18105 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.105405 17953 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.147990 12847 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:49.171116 18019 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.171478 12800 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:08:49.175592 12892 tablet_copy_source_session.cc:215] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:49.211220 12725 raft_consensus.cc:2410] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:49.144695 17953 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:49.184644 18119 log.cc:927] Time spent T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.220s	user 0.003s	sys 0.000s
W20260709 13:08:49.184866 18118 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:08:49.173575 18033 raft_consensus.cc:2804] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:49.235540 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86494.1us
W20260709 13:08:49.236204 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 91484.6us
I20260709 13:08:49.236934 12771 leader_election.cc:400] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:49.139635 18105 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:49.222610 18117 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:49.237893 12771 leader_election.cc:400] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:49.241956 12771 leader_election.cc:403] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:49.236824 12847 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:49.362084 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 385354us
W20260709 13:08:49.364151 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 157962us
I20260709 13:08:49.236606 18033 raft_consensus.cc:697] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:08:49.376226 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 98706.2us
I20260709 13:08:49.203644 17967 raft_consensus.cc:359] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:49.381428 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.383740 12800 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 8.
I20260709 13:08:49.401506 18019 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.373353 18125 raft_consensus.cc:3060] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:49.436290 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:49.447569 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:49.387039 17967 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:49.405361 18033 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.446264 17895 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:08:49.460655 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 224124us
W20260709 13:08:49.461511 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 78292.7us
I20260709 13:08:49.464061 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:49.493378 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:49.463562 18112 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:49.496592 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:49.504613 18088 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.507061 18088 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.511258 12728 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 8.
I20260709 13:08:49.514940 12803 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:49.513298 17953 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.517802 12874 raft_consensus.cc:2368] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:08:49.520218 17954 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.520759 17954 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.521540 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b39827c8d024243a5a2883bc2c2bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:49.461894 17895 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.532868 18105 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:49.546522 12724 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:49.551096 17954 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:49.517827 18112 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:49.558511 18112 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.470964 17967 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:08:49.574352 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.677101 17895 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.690562 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.691438 18125 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 14. Current term is 15.
I20260709 13:08:49.698706 17967 ts_tablet_manager.cc:1434] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.747s	user 0.014s	sys 0.011s
W20260709 13:08:49.699116 17967 ts_tablet_manager.cc:1467] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Tablet startup took 747ms
W20260709 13:08:49.699471 17967 ts_tablet_manager.cc:1469] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Trace:
0709 13:08:44.889598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.890235 (+   637us) service_pool.cc:224] Handling call
0709 13:08:45.237989 (+347754us) ts_tablet_manager.cc:934] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:08:46.487415 (+1249426us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:46.801758 (+314343us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.801906 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:46.965081 (+163175us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:47.023077 (+ 57996us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:47.067993 (+ 44916us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:47.072230 (+  4237us) inbound_call.cc:177] Queueing success response
0709 13:08:47.457656 (+385426us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:48.951420 (+1493764us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:49.160530 (+209110us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:49.184896 (+ 24366us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":106702,"raft.queue_time_us":3045,"tablet-copy.queue_time_us":294794,"tablet-download-pool.queue_time_us":6793,"tablet-download-pool.run_cpu_time_us":1601,"tablet-download-pool.run_wall_time_us":108167,"thread_start_us":173368,"threads_started":2}
W20260709 13:08:49.707340 18124 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.743s	user 0.013s	sys 0.039s
I20260709 13:08:49.707530 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59886 (request call id 527) took 1653 ms. Trace:
W20260709 13:08:49.736625 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 196734us
I20260709 13:08:49.740067 12806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.741398 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:49.741997 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.743677 12800 raft_consensus.cc:2468] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:08:49.740267 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:49.748524 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.742040 12802 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.710938 17953 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:49.723395 18093 rpcz_store.cc:276] 0709 13:08:48.053627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.055003 (+  1376us) service_pool.cc:224] Handling call
0709 13:08:48.385161 (+330158us) ts_tablet_manager.cc:934] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
0709 13:08:48.594175 (+209014us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b4400022b4c. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3ea2cc85 00007f0f3ea2d6a2 00007f0f4179f1db 00007f0f4179aaaf 00007f0f3eae90ac 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb02caa 00007f0f3eb02bd2 00007f0f46b67131
0709 13:08:49.520102 (+925927us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:49.691569 (+171467us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:49.691727 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:49.706548 (+ 14821us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:49.706920 (+   372us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:49.707267 (+   347us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:49.707423 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10823,"spinlock_wait_cycles":16029568,"tablet-copy.queue_time_us":207951,"thread_start_us":540603,"threads_started":2}
I20260709 13:08:49.786026 18069 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.786741 18069 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.789708 18069 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.779196 18084 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.793653 18084 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.793890 18069 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.795044 18068 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.795660 18068 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:49.800063 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:49.802480 18068 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:49.794783 18069 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.753605 18111 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:49.815320 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:49.816018 12728 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:49.825584 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44456.2us
I20260709 13:08:49.769634 18033 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.833312 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.835455 12728 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:49.839311 18069 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.795848 18084 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:49.781929 18035 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.840616 18093 tablet_copy_client.cc:806] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:49.844130 18033 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:08:49.860461 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 122313us
W20260709 13:08:49.861899 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 90585us
I20260709 13:08:49.864665 12773 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:49.870345 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:49.859122 18035 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.873921 18035 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:49.876109 18033 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:49.876477 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:49.877285 18033 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.880028 12802 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 9.
I20260709 13:08:49.882242 18154 raft_consensus.cc:2764] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:08:49.885437 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-e6a3cae9c8f5497a965082c096899998 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:08:49.885999 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-e6a3cae9c8f5497a965082c096899998 on tablet e6a3cae9c8f5497a965082c096899998 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:49.887343 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.888932 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:49.889735 12847 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:49.891782 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.893049 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.894918 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.896311 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:49.896934 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:49.900714 17639 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:49.855089 18069 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:49.907653 18069 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:49.908464 13517 raft_consensus.cc:1217] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:08:49.910104 18069 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:49.866901 18093 tablet_copy_client.cc:670] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:49.902338 17639 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:49.917778 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.922195 12845 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:49.925204 12847 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:49.928501 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.931442 18022 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.935899 12807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:49.940284 18116 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.941635 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:49.948433 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:49.924247 18035 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:49.977459 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.981302 12771 leader_election.cc:400] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899) with higher term. Message: Invalid argument: T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 8. Current term is 9.
I20260709 13:08:49.987061 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb04297576e2483ca596edd2dd418b52" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.987723 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.988161 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.989184 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:49.993860 18035 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:49.994935 18035 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.002346 12696 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:49.982754 18069 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:50.019675 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.037945 12699 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.024221 18069 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:50.046079 18074 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.053656 17939 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.045646 18154 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:08:50.071871 18160 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:50.090464 18093 tablet_copy_client.cc:538] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:50.068550 18161 log.cc:927] Time spent T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:50.085624 12882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:50.100206 12882 raft_consensus.cc:606] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:50.100639 12882 raft_consensus.cc:614] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.062125 18066 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:08:50.108076 18066 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:50.109380 18093 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:08:50.110397 18066 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:50.112953 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:08:50.119729 12728 raft_consensus.cc:1240] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:50.121881 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.124819 12808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:50.146867 12773 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:08:50.148141 12804 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:50.139843 12808 raft_consensus.cc:606] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:08:50.191282 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 141268us
I20260709 13:08:50.192344 12699 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:08:50.193609 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46834us
W20260709 13:08:50.204720 18156 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:50.223765 12699 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.194937 18126 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.138106 18154 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.195111 18066 consensus_queue.cc:1059] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:50.247699 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.247974 17939 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.249184 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.252542 12732 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:50.227391 18014 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.314265 18154 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:50.324223 12847 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:08:50.311937 18159 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.328s	user 0.002s	sys 0.010s
W20260709 13:08:50.317811 18152 log.cc:927] Time spent T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
I20260709 13:08:50.314574 17894 raft_consensus.cc:1064] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:08:50.327535 12803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:50.328230 12803 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:50.328577 12803 raft_consensus.cc:614] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.326149 18111 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.324726 18126 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:50.337067 12847 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:50.342160 18111 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.346264 12873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2662) took 1288 ms. Trace:
I20260709 13:08:50.350534 18133 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:50.355084 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:50.355868 12879 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:50.357172 17980 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:50.346789 12873 rpcz_store.cc:276] 0709 13:08:49.057236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.057387 (+   151us) service_pool.cc:224] Handling call
0709 13:08:49.057772 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.104374 (+ 46602us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:49.933812 (+829438us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180028d320. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eae8e07 00007f0f47943ab9 00007f0f3eb0569b 00007f0f3eb0393f 00007f0f3eb03455 00007f0f455eb3c7 00007f0f41bfd9a7 00007f0f41c0d0bf 00007f0f41c0d038
0709 13:08:50.015880 (+ 82068us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.211241 (+195361us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:50.213299 (+  2058us) log.cc:844] Serialized 52 byte log entry
0709 13:08:50.213509 (+   210us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:50.213821 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.231134 (+ 17313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.231216 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.252367 (+ 21151us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b180028d320. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:50.342845 (+ 90478us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b180028d320. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3eb063f3 00007f0f3eb087c1 00007f0f3eb08779 00007f0f3eb08709 00007f0f3eb086d1 00007f0f3eb079cd 000000000038f354 000000000038f199 00007f0f3eae983a
0709 13:08:50.345356 (+  2511us) raft_consensus.cc:1685] finished
0709 13:08:50.345381 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.345558 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78358,"prepare.queue_time_us":41489,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":78575,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":8348,"spinlock_wait_cycles":21541376,"thread_start_us":229482,"threads_started":2,"wal-append.queue_time_us":180393}
I20260709 13:08:50.336089 18126 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.363833 18126 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:50.348486 18137 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:08:50.384653 12880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37676 (request call id 2669) took 1005 ms. Trace:
I20260709 13:08:50.385064 12880 rpcz_store.cc:276] 0709 13:08:49.379184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.379372 (+   188us) service_pool.cc:224] Handling call
0709 13:08:49.379925 (+   553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.455213 (+ 75288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.455243 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:49.558625 (+103382us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18003bd460. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f479cede1 00007f0f479db5b1 00007f0f3ead42a6 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a
0709 13:08:49.559979 (+  1354us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b2c00081c68. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f404eca11 00007f0f404fc372 00007f0f41c2ea01 00007f0f41bf343a 00007f0f41bf283e 00007f0f46bb7419 00007f0f4012ebd4 00007f0f4012eb62 00007f0f4012ea91 00007f0f4012ea0c 00007f0f4012dcc2
0709 13:08:49.634863 (+ 74884us) log.cc:844] Serialized 52 byte log entry
0709 13:08:49.745094 (+110231us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:49.782576 (+ 37482us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.804312 (+ 21736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.804400 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.242584 (+438184us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b24001ff6b8. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3e98edb1 00007f0f3e98c9c4 00007f0f3e98aacb 00007f0f3eb45dc9 00007f0f3eb45a55 00007f0f3eb44fb0 00007f0f417bb488 00007f0f417bbbe8 00007f0f41793398 00007f0f4178e76a 00007f0f4178dbb6
0709 13:08:50.384460 (+141876us) raft_consensus.cc:1685] finished
0709 13:08:50.384480 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.384602 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147860,"prepare.queue_time_us":51734,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":97068,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":2797,"spinlock_wait_cycles":13207296,"thread_start_us":61913,"threads_started":1,"wal-append.queue_time_us":147669}
I20260709 13:08:50.393523 12804 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:50.407351 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:50.418187 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:50.418857 12799 raft_consensus.cc:606] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:50.425364 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.426075 12728 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:50.389624 18137 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.434005 18137 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:50.441632 18165 raft_consensus.cc:3055] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:50.442153 18165 raft_consensus.cc:740] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:50.443068 18165 consensus_queue.cc:260] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:50.448472 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 50653.3us
I20260709 13:08:50.454910 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.457331 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.459151 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:50.463436 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:50.473031 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:50.473714 12799 raft_consensus.cc:606] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:50.474045 12799 raft_consensus.cc:614] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.459847 18165 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.492471 12733 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:50.494048 12732 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:50.464104 18138 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:50.484184 18018 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:50.510568 18018 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:08:50.524864 18018 raft_consensus.cc:3060] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:50.537163 12804 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:50.542611 18136 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:50.547319 17639 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:50.548947 17639 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:50.562309 12771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.581635 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:50.582368 12802 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:50.582732 12802 raft_consensus.cc:614] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.588160 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:50.590021 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.590818 18019 raft_consensus.cc:993] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:50.591387 18019 raft_consensus.cc:1081] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:50.613379 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.559499 17894 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:50.628175 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:50.628886 12732 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.629230 12732 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.622975 12773 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:50.633112 18137 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.627588 18151 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.657557 12732 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.665804 18139 raft_consensus.cc:993] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:50.666404 18139 raft_consensus.cc:1081] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:50.608793 18018 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.669881 12725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:08:50.670740 12725 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.671185 12725 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.705966 12732 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:50.711190 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:50.711812 12879 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.716846 12725 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.736886 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:50.749413 12879 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
I20260709 13:08:50.757690 12725 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:50.767935 12696 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:50.776649 12725 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:50.772718 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:50.779194 12879 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.793812 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:50.798332 12879 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:08:50.773416 17939 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:50.799605 12696 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:50.802456 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:50.808075 17932 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:50.808614 17932 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:50.809532 17932 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.796370 18149 consensus_queue.cc:1059] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:50.815099 12725 raft_consensus.cc:2468] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:08:50.816375 12773 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:50.832964 12803 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.833381 12803 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:50.816917 17939 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:50.821559 18066 raft_consensus.cc:2804] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:50.841835 18066 raft_consensus.cc:697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:50.842823 18066 consensus_queue.cc:237] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.845541 17939 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.836825 18018 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:50.837684 18176 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:08:50.869823 12803 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.887741 12803 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.901731 12800 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:50.902180 12800 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:50.902890 12800 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:50.931458 12800 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.933508 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:50.934262 12879 raft_consensus.cc:2393] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 15: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:08:50.934911 12873 raft_consensus.cc:1240] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:50.951133 12728 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:50.964565 18177 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.235s	user 0.004s	sys 0.000s
I20260709 13:08:50.998422 12800 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:08:51.000149 12803 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
W20260709 13:08:51.013970 18154 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:51.046068 13514 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.082261 12878 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.078838 18129 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:08:51.116324 12630 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.138206 18019 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:51.196025 12730 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.202116 12803 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:51.201615 18142 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:51.205355 17939 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:51.304750 18093 log.cc:927] Time spent T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.093s	user 0.005s	sys 0.001s
I20260709 13:08:51.318420 18019 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.322310 13517 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.351733 12630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60338 (request call id 80) took 3963 ms. Trace:
I20260709 13:08:51.352299 12630 rpcz_store.cc:276] 0709 13:08:47.388193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.388351 (+   158us) service_pool.cc:224] Handling call
0709 13:08:51.351618 (+3963267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:51.234883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.235462 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.235500 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:51.235516 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:51.235833 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.235906 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.235932 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:51.236132 (+   200us) tablet.cc:701] Row locks acquired
0709 13:08:51.236148 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:51.236293 (+   145us) write_op.cc:270] Start()
0709 13:08:51.236468 (+   175us) write_op.cc:276] Timestamp: P: 1783602531236239 usec, L: 0
0709 13:08:51.236500 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.237211 (+   711us) log.cc:844] Serialized 529 byte log entry
0709 13:08:51.316432 (+ 79221us) op_driver.cc:464] REPLICATION: finished
0709 13:08:51.316929 (+   497us) write_op.cc:301] APPLY: starting
0709 13:08:51.317022 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:51.317963 (+   941us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:51.318065 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:51.318842 (+   777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:51.319010 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:51.319051 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:51.319327 (+   276us) log.cc:844] Serialized 24 byte log entry
0709 13:08:51.319515 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.319607 (+    92us) write_op.cc:454] Released schema lock
0709 13:08:51.319646 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":187100,"reported_tablets":2,"spinlock_wait_cycles":19840,"child_traces":[["op",{"apply.queue_time_us":153,"apply.run_cpu_time_us":3058,"apply.run_wall_time_us":3063,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":7112,"prepare.run_cpu_time_us":2647,"prepare.run_wall_time_us":2647,"replication_time_us":79711,"thread_start_us":9541,"threads_started":1}]]}
I20260709 13:08:51.382506 12725 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:51.384310 18154 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:51.395087 12880 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:51.418272 17939 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:51.425576 18093 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.426872 18093 tablet_bootstrap.cc:492] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:51.434250 12873 raft_consensus.cc:1275] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:51.452817 12631 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.454937 12631 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 9 to 11, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 11 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.473462 12631 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.477839 12631 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 7 to 10, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.480446 12631 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 4 to 9, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 9 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.531498 12730 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.535029 18019 consensus_queue.cc:1048] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:51.559190 12800 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:51.563584 17943 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:51.589823 18093 ts_tablet_manager.cc:1403] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.481s	user 0.051s	sys 0.022s
I20260709 13:08:51.628273 18129 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.629025 18129 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:51.632167 18129 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:51.632740 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:51.638062 18093 raft_consensus.cc:359] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:51.644285 12726 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 10.
I20260709 13:08:51.641537 12627 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index -1 to 12, term changed from 13 to 16, VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.591244 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.646188 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:51.644474 18093 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:51.683792 18093 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:51.686609 18093 ts_tablet_manager.cc:1434] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:08:51.659821 18129 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:51.694298 18129 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:51.709044 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43961.8us
I20260709 13:08:51.707157 18129 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:51.753885 12628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45902 (request call id 194) took 15266 ms (client timeout 15000 ms). Trace:
I20260709 13:08:51.758455 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:41076
W20260709 13:08:51.761564 12631 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 156) took 28241 ms (client timeout 15000 ms). Trace:
I20260709 13:08:51.710561 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a839b697aea46da87cb69b00515389e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:41706
I20260709 13:08:51.766170 12629 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:51.762046 12631 rpcz_store.cc:269] 0709 13:08:23.520522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.533951 (+ 13429us) service_pool.cc:224] Handling call
0709 13:08:51.761476 (+28227525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:51.542934 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.543599 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.543657 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:08:51.543678 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:51.545568 (+  1890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.545649 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.545682 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:51.546276 (+   594us) tablet.cc:701] Row locks acquired
0709 13:08:51.546293 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:51.546460 (+   167us) write_op.cc:270] Start()
0709 13:08:51.546590 (+   130us) write_op.cc:276] Timestamp: P: 1783602531546410 usec, L: 0
0709 13:08:51.546615 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.547390 (+   775us) log.cc:844] Serialized 2063 byte log entry
0709 13:08:51.549603 (+  2213us) op_driver.cc:464] REPLICATION: finished
0709 13:08:51.550108 (+   505us) write_op.cc:301] APPLY: starting
0709 13:08:51.550192 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:51.553156 (+  2964us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:51.553263 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:51.570780 (+ 17517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:51.570974 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:08:51.571022 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:51.571276 (+   254us) log.cc:844] Serialized 56 byte log entry
0709 13:08:51.572225 (+   949us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.572341 (+   116us) write_op.cc:454] Released schema lock
0709 13:08:51.572387 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:51.572785 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.572820 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":183885,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":267,"apply.run_cpu_time_us":7712,"apply.run_wall_time_us":22619,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20920,"num_ops":5,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":3695,"prepare.run_wall_time_us":5226,"replication_time_us":2826}]]}
I20260709 13:08:51.771090 18129 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:51.777161 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 4a839b697aea46da87cb69b00515389e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:51.785356 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:51.786021 12726 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.791363 18129 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:08:51.775640 12628 rpcz_store.cc:269] 0709 13:08:36.485768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.487062 (+  1294us) service_pool.cc:224] Handling call
0709 13:08:51.729839 (+15242777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:48.828842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:48.833626 (+  4784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:48.839243 (+  5617us) write_op.cc:435] Acquired schema lock
0709 13:08:48.843989 (+  4746us) tablet.cc:662] Decoding operations
0709 13:08:48.949083 (+105094us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:48.949167 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:48.949210 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:08:48.950905 (+  1695us) tablet.cc:701] Row locks acquired
0709 13:08:48.950925 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:48.951098 (+   173us) write_op.cc:270] Start()
0709 13:08:48.951230 (+   132us) write_op.cc:276] Timestamp: P: 1783602528951037 usec, L: 0
0709 13:08:48.951252 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.140880 (+189628us) log.cc:844] Serialized 8171 byte log entry
0709 13:08:49.858884 (+718004us) op_driver.cc:464] REPLICATION: finished
0709 13:08:50.056313 (+197429us) write_op.cc:301] APPLY: starting
0709 13:08:50.061260 (+  4947us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:50.106604 (+ 45344us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf032a 00007f0f41b75f14 00007f0f41b75ec3 00007f0f41b75e38 00007f0f41b75df3 00007f0f41b750dc 00007f0f41b9ee16 00007f0f41b86cbb 00007f0f41b7139d 00007f0f41b74d75
0709 13:08:50.539428 (+432824us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:50.539463 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:50.899764 (+360301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:50.906761 (+  6997us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:08:50.906818 (+    57us) write_op.cc:312] APPLY: finished
0709 13:08:50.908668 (+  1850us) log.cc:844] Serialized 187 byte log entry
0709 13:08:51.022474 (+113806us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.022697 (+   223us) write_op.cc:454] Released schema lock
0709 13:08:51.022774 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:51.023203 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.023247 (+    44us) write_op.cc:454] Released schema lock
0709 13:08:51.320804 (+297557us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.320840 (+    36us) write_op.cc:454] Released schema lock
0709 13:08:51.324432 (+  3592us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf032a 00007f0f41b75f14 00007f0f41b75ec3 00007f0f41b75e38 00007f0f41b75df3 00007f0f41b750dc 00007f0f41b9ee16 00007f0f41b86cbb 00007f0f41b7139d 00007f0f41b74d75
Metrics: {"mutex_wait_us":104512,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":177512,"apply.run_cpu_time_us":63976,"apply.run_wall_time_us":974313,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":226452,"prepare.run_cpu_time_us":88677,"prepare.run_wall_time_us":561686,"raft.queue_time_us":324536,"raft.run_cpu_time_us":33802,"raft.run_wall_time_us":405031,"replication_time_us":890547,"spinlock_wait_cycles":89909760,"thread_start_us":685287,"threads_started":6,"wal-append.queue_time_us":438730,"wal-append.run_cpu_time_us":33670,"wal-append.run_wall_time_us":1120980}]]}
I20260709 13:08:51.793402 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 21f97de57a4f4bf7a4ac5fde6b3bc613 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:51.794037 12807 consensus_queue.cc:237] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:51.795212 12726 raft_consensus.cc:2468] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:08:51.795099 12629 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.798122 12773 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:51.797765 12629 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 9 to 13, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.799961 12629 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 14, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 14 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } }
I20260709 13:08:51.803318 12629 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.805299 18142 raft_consensus.cc:2804] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:51.805014 12629 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 10, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.805806 18142 raft_consensus.cc:697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:51.806638 18142 consensus_queue.cc:237] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:51.806728 12629 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 11 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.808148 12629 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 10 to 13, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.809638 12629 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 10 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.811357 12629 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.815500 12629 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 10 to 13, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
W20260709 13:08:51.818985 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46516.7us
I20260709 13:08:51.817408 12629 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.824270 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.827256 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-2b39827c8d024243a5a2883bc2c2bd83 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:08:51.827744 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-2b39827c8d024243a5a2883bc2c2bd83 on tablet 2b39827c8d024243a5a2883bc2c2bd83 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:51.828121 12873 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:51.831563 12629 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 14, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.833518 12629 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.836052 13514 raft_consensus.cc:1217] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:08:51.836229 12629 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:51.837546 12629 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.839192 12629 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.840740 12629 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.851359 17943 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:51.850494 12880 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.859997 13517 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:51.860837 12728 raft_consensus.cc:1275] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:51.862814 18129 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:51.868476 18129 consensus_queue.cc:1048] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:51.876513 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:08:51.879992 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:51.921255 18129 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 6 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.926192 12725 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 6 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.971294 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 562422a4dc1a44a7bca3a549839874be with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.980224 13517 raft_consensus.cc:2955] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 6 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:51.987957 12631 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index -1 to 9, term changed from 9 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to <none>, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 12 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:51.989701 18198 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:08:51.990418 18198 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:51.999370 18198 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:52.002774 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:08:52.003707 12725 raft_consensus.cc:2368] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:52.011097 12847 leader_election.cc:400] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:52.011551 12847 leader_election.cc:403] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:52.013055 18198 raft_consensus.cc:3060] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.025208 12631 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c reported cstate change: leader changed from <none> to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:52.057770 18198 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) with higher term. Message: Invalid argument: T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 for earlier term 10. Current term is 11.
I20260709 13:08:52.062691 12629 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 165) took 7677 ms. Trace:
I20260709 13:08:52.066835 12629 rpcz_store.cc:276] 0709 13:08:44.385180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.385500 (+   320us) service_pool.cc:224] Handling call
0709 13:08:52.062624 (+7677124us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:51.853842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.854341 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.854400 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:08:51.854422 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:51.855837 (+  1415us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.855887 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.855918 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:08:51.857267 (+  1349us) tablet.cc:701] Row locks acquired
0709 13:08:51.857286 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:51.857444 (+   158us) write_op.cc:270] Start()
0709 13:08:51.857551 (+   107us) write_op.cc:276] Timestamp: P: 1783602531857392 usec, L: 0
0709 13:08:51.857573 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.892371 (+ 34798us) log.cc:844] Serialized 7408 byte log entry
0709 13:08:51.897393 (+  5022us) op_driver.cc:464] REPLICATION: finished
0709 13:08:51.897805 (+   412us) write_op.cc:301] APPLY: starting
0709 13:08:51.897799 (+    -6us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:08:51.897894 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:51.915349 (+ 17455us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:51.915375 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:51.977824 (+ 62449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:51.978088 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:08:51.978158 (+    70us) write_op.cc:312] APPLY: finished
0709 13:08:51.978763 (+   605us) log.cc:844] Serialized 172 byte log entry
0709 13:08:51.979504 (+   741us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.979674 (+   170us) write_op.cc:454] Released schema lock
0709 13:08:51.979726 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:52.004322 (+ 24596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.004356 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21106,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":21573,"apply.run_wall_time_us":106450,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79496,"num_ops":19,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":7794,"prepare.run_wall_time_us":44155,"replication_time_us":39677,"spinlock_wait_cycles":78143744}]]}
I20260709 13:08:52.073480 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:08:52.071913 12628 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.074728 12628 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 9, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 9 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.076781 12628 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.077962 12628 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.079053 12628 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.080441 12628 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.082011 12628 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.085669 12628 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.087751 12628 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 12, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.089471 12628 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.090914 12628 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.092126 12628 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 14 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.093634 12628 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 12, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.095103 12628 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.096370 12628 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 15, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.097915 12628 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 18, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.099352 12628 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.100714 12628 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 9 to 16, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.102001 12628 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 14 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.103616 12628 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.104995 12628 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.106227 12628 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 7 to 11, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 11 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.107434 12628 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.108804 12628 catalog_manager.cc:5697] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.110424 12628 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 14, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.112298 12628 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.113626 12628 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 17 to 18, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.115334 12628 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } }
I20260709 13:08:52.196556 12880 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:52.198588 18207 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:52.220991 12631 catalog_manager.cc:5697] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 6 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.233124 12725 raft_consensus.cc:1275] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:52.236776 18142 consensus_queue.cc:1048] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.270541 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 562422a4dc1a44a7bca3a549839874be with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37656
I20260709 13:08:52.306838 18211 tablet_replica.cc:333] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:08:52.313422 12804 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:52.310046 12628 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 562422a4dc1a44a7bca3a549839874be with cas_config_opid_index 6: aborting the task: latest config opid_index 10; task opid_index 6
I20260709 13:08:52.319665 13517 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:52.321272 18142 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:52.321684 12725 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:52.323411 18207 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:52.332772 18165 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.339943 12626 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 7 to 8, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 8 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.335057 13517 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.373468 17847 raft_consensus.cc:1064] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:08:52.378355 17847 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:52.401486 12628 catalog_manager.cc:5697] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 8 to 11, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.323951 18211 raft_consensus.cc:2243] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.418601 18211 raft_consensus.cc:2272] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.422206 18211 ts_tablet_manager.cc:1916] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.423575 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6a3cae9c8f5497a965082c096899998 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:52.431152 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59147.4us
I20260709 13:08:52.448944 13514 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:52.453234 12804 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:52.454985 12725 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:52.474632 18198 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:52.476081 18197 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:52.482264 17899 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:52.495292 12727 raft_consensus.cc:2955] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.510675 12628 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.519483 18211 ts_tablet_manager.cc:1929] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:52.527987 18211 log.cc:1199] T 562422a4dc1a44a7bca3a549839874be P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/562422a4dc1a44a7bca3a549839874be
I20260709 13:08:52.530278 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 562422a4dc1a44a7bca3a549839874be (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:52.610109 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet e6a3cae9c8f5497a965082c096899998 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37656
I20260709 13:08:52.611183 18211 tablet_replica.cc:333] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:08:52.612279 18211 raft_consensus.cc:2243] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.613195 18211 raft_consensus.cc:2272] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.617437 12626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45886 (request call id 157) took 7859 ms. Trace:
I20260709 13:08:52.618592 18211 ts_tablet_manager.cc:1916] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.618467 18198 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.626331 12804 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.652719 13514 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.658377 12629 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.640148 12626 rpcz_store.cc:276] 0709 13:08:44.767566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.774976 (+  7410us) service_pool.cc:224] Handling call
0709 13:08:45.396467 (+621491us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5d090 00007f0f41bfbf3a 00007f0f479b21cc 00007f0f47ab037e 00007f0f45f712a4 00007f0f45f71232 00007f0f45f71161 00007f0f45f710dc 00007f0f45f70392 00007f0f3ff2e48c 00007f0f3ff2d8c6
0709 13:08:52.359055 (+6962588us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.359086 (+    31us) write_op.cc:454] Released schema lock
0709 13:08:52.617360 (+258274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:52.349623 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:52.350118 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:52.350152 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:52.350168 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:52.350517 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:52.350564 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:52.350596 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:52.350758 (+   162us) tablet.cc:701] Row locks acquired
0709 13:08:52.350773 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:08:52.350912 (+   139us) write_op.cc:270] Start()
0709 13:08:52.351019 (+   107us) write_op.cc:276] Timestamp: P: 1783602532350875 usec, L: 0
0709 13:08:52.351042 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:52.351662 (+   620us) log.cc:844] Serialized 535 byte log entry
0709 13:08:52.354377 (+  2715us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.354774 (+   397us) write_op.cc:301] APPLY: starting
0709 13:08:52.354844 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.355643 (+   799us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.355741 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:52.356491 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:52.356650 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:52.356700 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:52.356881 (+   181us) log.cc:844] Serialized 25 byte log entry
0709 13:08:52.357035 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.357117 (+    82us) write_op.cc:454] Released schema lock
0709 13:08:52.357155 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3602,"reported_tablets":55,"spinlock_wait_cycles":397436800,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":2631,"apply.run_wall_time_us":2631,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2337,"prepare.run_wall_time_us":2336,"replication_time_us":3231}]]}
I20260709 13:08:52.696826 18211 ts_tablet_manager.cc:1929] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:08:52.697356 18211 log.cc:1199] T e6a3cae9c8f5497a965082c096899998 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/e6a3cae9c8f5497a965082c096899998
I20260709 13:08:52.699388 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet e6a3cae9c8f5497a965082c096899998 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:52.745932 12730 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.789443 12880 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:52.796846 13514 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:52.797766 12725 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:52.799876 18197 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:52.801198 17847 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:52.819211 13514 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.825950 17847 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.846946 12730 raft_consensus.cc:2955] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.869660 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b39827c8d024243a5a2883bc2c2bd83 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:52.870721 12631 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:52.903970 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b39827c8d024243a5a2883bc2c2bd83 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41706
I20260709 13:08:52.959815 18219 tablet_replica.cc:333] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:08:52.965104 18219 raft_consensus.cc:2243] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.966257 18219 raft_consensus.cc:2272] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.979223 18219 ts_tablet_manager.cc:1916] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.020222 18219 ts_tablet_manager.cc:1929] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:08:53.020658 18219 log.cc:1199] T 2b39827c8d024243a5a2883bc2c2bd83 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/2b39827c8d024243a5a2883bc2c2bd83
I20260709 13:08:53.026979 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 2b39827c8d024243a5a2883bc2c2bd83 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:08:53.081092 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.226308 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:53.227162 12880 raft_consensus.cc:606] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:53.245036 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:53.245678 12875 raft_consensus.cc:606] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:53.278040 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc76143509f64c4faa68973765829aec"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:53.278803 12880 raft_consensus.cc:606] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:53.289791 18033 raft_consensus.cc:993] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.290316 18033 raft_consensus.cc:1081] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.293020 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:53.293735 12880 raft_consensus.cc:606] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:53.295486 12725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:53.296294 12725 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.296698 12725 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.301194 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:53.301949 12875 raft_consensus.cc:606] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:53.317251 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:53.319391 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:53.347734 17902 raft_consensus.cc:993] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.353492 18197 raft_consensus.cc:1081] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.356022 12726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc76143509f64c4faa68973765829aec"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:53.356721 12726 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.357070 12726 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.417462 12726 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.493309 18197 raft_consensus.cc:993] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:53.533416 18197 raft_consensus.cc:1081] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:53.534722 12726 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:53.539064 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:53.539711 12875 raft_consensus.cc:3055] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:53.539996 12875 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:53.541062 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:53.541836 13514 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.550860 13514 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:53.540776 12875 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.566227 12875 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.551724 12725 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.574771 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:53.575469 12880 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:53.575765 12880 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:53.576076 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:53.576691 13517 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.576918 12880 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.578092 12880 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.579478 12725 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:53.586838 13517 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:53.588753 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:53.589720 17943 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.590277 17943 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:53.591224 17943 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.585781 12880 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:53.609061 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:53.610131 17943 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:53.610977 17943 raft_consensus.cc:697] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:53.611783 12626 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.612433 17943 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.642858 12875 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 7.
I20260709 13:08:53.646731 17847 raft_consensus.cc:993] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.677207 17847 raft_consensus.cc:1081] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:53.658425 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:08:53.678565 12801 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.678999 12801 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.687644 12801 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.690368 12725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:53.690954 12725 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.691869 12725 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.699988 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:53.700698 13517 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.712311 13517 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:53.713492 12771 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:08:53.721136 18220 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.721937 18220 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:53.723096 18220 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.726224 12725 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:53.732952 12801 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:53.738006 18221 raft_consensus.cc:993] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:53.740206 18221 raft_consensus.cc:1081] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:53.742939 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:53.743777 12801 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.748339 12725 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:53.751322 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:53.752171 12875 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:53.752499 12875 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:53.753329 12875 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:53.754623 12875 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.757126 12801 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:53.758689 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:53.759454 17943 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:53.759989 17943 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:53.760844 17943 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:53.766590 12875 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:08:53.770061 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:53.805574 12879 raft_consensus.cc:3055] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:53.805967 12879 raft_consensus.cc:740] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:53.806820 12879 consensus_queue.cc:260] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:53.807857 12879 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.770928 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:08:53.808423 12802 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.808816 12802 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.769992 12626 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 6 to 7, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 7 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.817946 12802 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:53.829103 12802 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:53.830224 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:53.830924 12725 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.833627 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:53.834564 12875 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.834970 12875 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:53.838140 12875 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:53.842622 12875 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.859495 12725 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:53.861515 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:53.864619 12875 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:08:53.866580 12879 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:08:53.870750 12804 raft_consensus.cc:1240] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:53.880755 18142 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.883936 18142 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:53.884902 18142 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:53.933105 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 156185us
I20260709 13:08:54.097213 12626 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.184343 12880 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:54.185981 12631 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.217253 18165 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:54.222229 13517 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:54.227517 18239 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:54.249083 13514 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:54.251574 12878 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:54.249115 13516 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:54.253461 12878 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:54.254186 12801 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:54.264930 18240 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:54.283763 12629 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 11 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 12 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.301640 18232 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:54.301658 18238 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:54.320770 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.378623 12878 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:54.395298 18240 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:54.396843 18238 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:54.403520 18231 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:08:54.480952 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 55869.1us
I20260709 13:08:54.570252 12878 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:54.641263 18254 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:54.727126 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 225318us
I20260709 13:08:54.733618 12732 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:54.844254 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 95371.3us
W20260709 13:08:54.936098 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 161811us
I20260709 13:08:54.942561 18255 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:55.048482 12879 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:08:55.135584 12845 consensus_peers.cc:597] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f21936f5afa14460a22306512f82c201. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.149057 12727 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:55.150803 18258 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:55.159916 12801 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:55.167343 18221 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:55.197518 18197 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.201854 12733 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.213704 12801 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.252275 12629 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.268249 12879 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:55.300828 12801 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:08:55.302161 12845 consensus_peers.cc:597] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad96a33cd7224ee8980e6312e22ec951. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.302582 18262 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:55.305135 12727 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:55.308076 18262 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:55.329535 18258 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.334676 12799 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.495553 12626 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.516608 12733 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.575949 12727 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:08:55.643527 12696 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7d64be8779a42e0ad6540bfa7067f2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.638324 12879 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:55.646950 12801 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:55.649358 18214 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:55.653141 18285 ts_tablet_manager.cc:933] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:55.653975 18238 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:55.696424 18232 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.726886 12801 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.744756 18285 tablet_copy_client.cc:323] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:08:55.747287 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet f21936f5afa14460a22306512f82c201 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:08:55.748227 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet f21936f5afa14460a22306512f82c201 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-f21936f5afa14460a22306512f82c201
I20260709 13:08:55.759894 12733 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:55.765530 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.806879 12892 tablet_copy_source_session.cc:215] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:55.803099 12626 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.826807 18290 ts_tablet_manager.cc:933] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:55.830987 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21936f5afa14460a22306512f82c201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:55.876688 12879 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.889043 12804 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:55.890849 18232 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:55.894268 12696 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b483b06f72a4b6e863293d4c6099849. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.912026 12878 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:55.930166 18238 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:55.939527 18290 tablet_copy_client.cc:323] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:08:55.956336 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:55.957131 12879 raft_consensus.cc:606] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:55.957458 18232 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:55.994241 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet ad96a33cd7224ee8980e6312e22ec951 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:08:55.994932 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet ad96a33cd7224ee8980e6312e22ec951 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-ad96a33cd7224ee8980e6312e22ec951
I20260709 13:08:55.994982 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:55.995798 12878 raft_consensus.cc:606] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:56.014897 12892 tablet_copy_source_session.cc:215] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.018239 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390c91265699487c943fe0217424eb34"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:56.018967 12875 raft_consensus.cc:606] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:56.020632 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad96a33cd7224ee8980e6312e22ec951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.025996 12801 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:08:56.028867 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59111us
I20260709 13:08:56.050689 12631 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.056396 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:56.057132 12878 raft_consensus.cc:606] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:56.138219 12732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:08:56.139076 12732 raft_consensus.cc:606] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:56.163491 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:56.173017 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:56.208557 12879 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:08:56.216368 18214 raft_consensus.cc:993] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.217020 18214 raft_consensus.cc:1081] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.220381 12799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:08:56.221112 12799 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.221475 12799 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.222538 18221 raft_consensus.cc:993] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.223830 18221 raft_consensus.cc:1081] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.225821 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:08:56.227138 12801 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.232272 12801 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.237920 12799 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.248852 12801 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.252735 18303 ts_tablet_manager.cc:933] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:56.257799 18290 tablet_copy_client.cc:806] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.258615 18290 tablet_copy_client.cc:670] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.258807 18285 tablet_copy_client.cc:806] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.259644 18285 tablet_copy_client.cc:670] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.267122 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:56.267994 12801 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:56.264430 12799 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:56.268389 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:56.269037 12880 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:56.269354 12880 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:56.270185 12880 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.271279 12880 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.278475 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:56.279064 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:56.279850 12728 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.281044 18285 tablet_copy_client.cc:538] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.267892 12875 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.279110 12733 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:56.285509 12733 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:56.286401 12733 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.287794 12733 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.289178 18258 raft_consensus.cc:993] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:56.289733 18258 raft_consensus.cc:1081] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:56.292493 12727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:56.293121 12727 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.293484 12727 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.294024 18258 raft_consensus.cc:993] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:56.294559 18262 raft_consensus.cc:1081] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:08:56.297928 18290 tablet_copy_client.cc:538] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.299197 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390c91265699487c943fe0217424eb34"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:08:56.299928 12732 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.300366 12732 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.307459 12875 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
I20260709 13:08:56.308274 12727 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.321621 12727 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:56.323338 12873 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:56.325002 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:56.325591 12878 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:56.325960 12878 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:56.327121 12878 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.328430 12878 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.335891 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:56.336439 12880 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:08:56.336956 18255 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:56.337517 18255 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:56.338116 12732 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.340476 12771 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:56.341483 18272 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.342093 18272 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:56.343094 18272 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.338608 18255 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.355424 12733 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
I20260709 13:08:56.322597 12728 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:08:56.368021 12878 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:08:56.368563 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:56.369366 12799 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.386763 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:56.387730 12801 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.386883 12696 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:56.395346 12732 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:56.394184 18290 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:08:56.401997 18238 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.402601 18238 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:56.403517 18238 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.404269 18303 tablet_copy_client.cc:323] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:08:56.457911 12799 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:08:56.480566 12801 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:56.485333 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet c7d64be8779a42e0ad6540bfa7067f2b from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:08:56.486109 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet c7d64be8779a42e0ad6540bfa7067f2b from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-c7d64be8779a42e0ad6540bfa7067f2b
I20260709 13:08:56.491658 18285 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:08:56.544248 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 74304.7us
W20260709 13:08:56.548511 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.568732 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59372.1us
I20260709 13:08:56.568288 18221 raft_consensus.cc:993] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.594157 12629 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 18 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.596802 12626 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 16 to 17, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.600422 12699 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:08:56.602142 18311 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:56.602700 18311 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:56.603596 18311 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:08:56.618891 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 51192.4us
I20260709 13:08:56.631395 18262 raft_consensus.cc:1081] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:56.644759 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:56.645381 12875 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:56.645658 12875 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:56.659379 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:08:56.660377 12802 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.660908 12802 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.663548 12742 tablet_copy_source_session.cc:215] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.665429 12875 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:56.674355 12802 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.677966 12802 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:08:56.696658 18303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d64be8779a42e0ad6540bfa7067f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.716872 12875 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.726016 12875 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:08:56.758440 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:56.759385 12879 raft_consensus.cc:3055] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:56.759850 12879 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:56.760957 12879 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.763203 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:56.772966 12733 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.765972 12728 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:56.776105 12879 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:56.781807 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 114137us
I20260709 13:08:56.783813 18319 ts_tablet_manager.cc:933] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:08:56.785905 12808 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:56.802846 18315 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:56.810276 12629 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 16 to 17, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 17 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.815810 12879 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:56.816874 12771 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:08:56.817669 18315 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:56.818140 18315 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:08:56.826155 12733 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:08:56.819024 18315 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:56.845404 12626 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.851938 12733 raft_consensus.cc:1240] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:56.856894 12846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.871868 18319 tablet_copy_client.cc:323] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:08:56.874455 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 9b483b06f72a4b6e863293d4c6099849 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:08:56.875077 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 9b483b06f72a4b6e863293d4c6099849 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-9b483b06f72a4b6e863293d4c6099849
I20260709 13:08:56.907702 12875 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:56.910168 18314 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:56.927174 12742 tablet_copy_source_session.cc:215] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.948520 18319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b483b06f72a4b6e863293d4c6099849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.989432 12728 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:56.990895 12879 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:56.995278 18308 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:57.005313 12808 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:57.012710 18311 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:57.019837 12879 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:57.015837 18303 tablet_copy_client.cc:806] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:57.031836 18303 tablet_copy_client.cc:670] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.042037 18294 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:57.053370 18303 tablet_copy_client.cc:538] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:57.020861 18314 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:08:57.074754 12771 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.075296 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 56998.1us
I20260709 13:08:57.164974 12808 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:57.181630 12873 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:57.184149 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.164974 12626 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.185485 18232 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:57.242491 18319 tablet_copy_client.cc:806] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
W20260709 13:08:57.295451 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 106985us
I20260709 13:08:57.247049 18231 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:57.309175 18319 tablet_copy_client.cc:670] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.384980 18290 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.386472 18290 tablet_bootstrap.cc:492] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:57.394222 18319 tablet_copy_client.cc:538] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:57.410063 12771 consensus_peers.cc:597] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.413514 18303 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:08:57.473038 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 75355.8us
W20260709 13:08:57.486505 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 94299.7us
I20260709 13:08:57.527801 18319 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:08:57.557425 18290 ts_tablet_manager.cc:1403] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.177s	user 0.030s	sys 0.032s
W20260709 13:08:57.605216 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 284951us
I20260709 13:08:57.617597 12732 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:57.636962 12873 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:57.667445 18338 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:57.644549 18290 raft_consensus.cc:359] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:57.707650 18290 raft_consensus.cc:740] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:57.693820 18338 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:57.720669 18290 consensus_queue.cc:260] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:57.833125 18290 ts_tablet_manager.cc:1434] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.275s	user 0.009s	sys 0.002s
I20260709 13:08:57.939391 13514 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Advancing to term 16
I20260709 13:08:57.964270 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-ad96a33cd7224ee8980e6312e22ec951 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:08:57.964843 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-ad96a33cd7224ee8980e6312e22ec951 on tablet ad96a33cd7224ee8980e6312e22ec951 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:58.099105 18285 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.115132 18285 tablet_bootstrap.cc:492] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:58.153477 18285 ts_tablet_manager.cc:1403] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.662s	user 0.045s	sys 0.032s
I20260709 13:08:58.159507 18285 raft_consensus.cc:359] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.185144 18285 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:58.200377 18285 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.213446 18303 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.216235 18303 tablet_bootstrap.cc:492] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:58.217056 18303 ts_tablet_manager.cc:1403] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.804s	user 0.015s	sys 0.040s
I20260709 13:08:58.236793 18319 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.237914 18319 tablet_bootstrap.cc:492] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:08:58.238754 18319 ts_tablet_manager.cc:1403] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.711s	user 0.041s	sys 0.011s
I20260709 13:08:58.240343 18285 ts_tablet_manager.cc:1434] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.001s
I20260709 13:08:58.244004 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-f21936f5afa14460a22306512f82c201 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:08:58.244557 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-f21936f5afa14460a22306512f82c201 on tablet f21936f5afa14460a22306512f82c201 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:58.270520 18319 raft_consensus.cc:359] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.272866 18319 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:58.273666 18319 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.291615 18303 raft_consensus.cc:359] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.292747 18303 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:08:58.293500 18303 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:08:58.312757 18319 ts_tablet_manager.cc:1434] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 13:08:58.325317 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-9b483b06f72a4b6e863293d4c6099849 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:58.325848 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-9b483b06f72a4b6e863293d4c6099849 on tablet 9b483b06f72a4b6e863293d4c6099849 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:58.333268 18303 ts_tablet_manager.cc:1434] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.116s	user 0.003s	sys 0.006s
I20260709 13:08:58.336898 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-c7d64be8779a42e0ad6540bfa7067f2b received from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:58.337393 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-c7d64be8779a42e0ad6540bfa7067f2b on tablet c7d64be8779a42e0ad6540bfa7067f2b with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:08:58.386591 18338 raft_consensus.cc:1064] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:08:58.389336 18338 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:58.397646 12733 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:58.404577 13514 raft_consensus.cc:1217] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:08:58.417399 12874 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:58.421607 18315 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:58.424417 13514 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:58.431021 18354 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:58.434818 18297 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:58.464927 18315 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 8 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.466996 12727 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 8 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.474565 13516 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 8 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.501559 12629 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 8 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.543627 12874 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 8 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.730979 12799 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:58.758005 13514 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:58.758179 12879 raft_consensus.cc:1275] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:58.764472 13514 raft_consensus.cc:1217] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:08:58.781169 18338 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:58.816236 18316 consensus_queue.cc:1048] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:58.827517 18310 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.834475 12879 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:58.834066 13514 raft_consensus.cc:2955] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:08:58.864792 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52632.9us
I20260709 13:08:58.929023 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad96a33cd7224ee8980e6312e22ec951 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:58.955664 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 65335.3us
W20260709 13:08:58.967865 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57458.9us
I20260709 13:08:58.984349 12628 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.003444 18380 raft_consensus.cc:1064] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:08:59.022217 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55731.7us
I20260709 13:08:59.027626 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet ad96a33cd7224ee8980e6312e22ec951 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41076
W20260709 13:08:59.080564 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 112830us
I20260709 13:08:59.090225 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:59.100932 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 132694us
W20260709 13:08:59.107982 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 142300us
I20260709 13:08:59.119616 18380 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:59.224781 18385 tablet_replica.cc:333] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:08:59.226102 18385 raft_consensus.cc:2243] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.227490 18385 raft_consensus.cc:2272] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.235868 13516 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:59.242446 18347 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:59.251500 12799 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:59.276800 12874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:59.277628 12874 raft_consensus.cc:606] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:08:59.297645 12733 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:59.305605 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:08:59.306242 12733 raft_consensus.cc:606] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:08:59.308084 18338 raft_consensus.cc:1064] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:08:59.311044 18338 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:59.292285 18384 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:59.323182 18376 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:59.328487 18385 ts_tablet_manager.cc:1916] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:59.339586 12801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:08:59.364300 18387 raft_consensus.cc:1064] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:08:59.369035 18387 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:59.403802 13516 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:59.407301 18387 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:59.452808 12804 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:59.464126 18377 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:59.499320 12801 raft_consensus.cc:606] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:59.501502 12882 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:59.510764 13514 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:59.512439 18383 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:59.512794 12882 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:59.516139 18315 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.522677 12727 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:59.541016 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:08:59.541656 18313 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.544659 18373 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:59.530647 18385 ts_tablet_manager.cc:1929] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:08:59.548453 18381 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:59.569353 18385 log.cc:1199] T ad96a33cd7224ee8980e6312e22ec951 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/ad96a33cd7224ee8980e6312e22ec951
I20260709 13:08:59.571830 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet ad96a33cd7224ee8980e6312e22ec951 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:08:59.597734 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 133255us
I20260709 13:08:59.615949 18374 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.626080 12801 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.618983 18316 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 9 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.650704 12875 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 9 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.657485 13516 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.660588 13514 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.656738 12626 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.676199 12727 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.682181 18398 raft_consensus.cc:993] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:59.682765 18398 raft_consensus.cc:1081] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:08:59.682821 18387 raft_consensus.cc:993] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:08:59.683472 18387 raft_consensus.cc:1081] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:08:59.690025 12805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:08:59.690749 12805 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.691146 12805 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.724572 12879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:08:59.725258 12879 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.725634 12879 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.734314 12805 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:59.773095 12727 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 9 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.776394 12805 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:08:59.778975 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:08:59.779421 12879 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:59.780907 12875 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:59.781275 12875 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:08:59.786192 12875 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:08:59.791157 12875 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:59.792945 18397 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.065s	user 0.003s	sys 0.002s
W20260709 13:08:59.793782 18391 log.cc:927] Time spent T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:59.793177 12631 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 9 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.804229 12880 raft_consensus.cc:606] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:08:59.806047 12879 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:08:59.806656 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:59.807982 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:08:59.808641 12726 raft_consensus.cc:3055] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:59.808926 12726 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:08:59.809638 12726 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:08:59.810731 12726 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.830341 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:59.829375 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:08:59.834754 12879 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:08:59.840077 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:08:59.840525 12804 raft_consensus.cc:3060] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.840803 13516 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.841881 12875 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
I20260709 13:08:59.868568 13516 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
W20260709 13:08:59.946637 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 96469.1us
I20260709 13:08:59.948091 12771 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:08:59.933681 18400 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:59.986197 18315 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:00.031782 12801 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.064318 12726 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:00.071956 12847 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:00.031558 18315 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:00.099531 18301 raft_consensus.cc:2804] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:00.114593 12804 raft_consensus.cc:2468] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:00.116899 18315 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.118192 18301 raft_consensus.cc:697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:09:00.129040 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 106413us
I20260709 13:09:00.149350 13516 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 9 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.129675 18301 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:00.174335 18316 raft_consensus.cc:993] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:00.174832 18316 raft_consensus.cc:1081] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:00.213734 18407 raft_consensus.cc:993] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:00.214332 18407 raft_consensus.cc:1081] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:00.245168 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:00.245914 12730 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.246296 12730 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.317869 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:00.318655 12733 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.319069 12733 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.330781 12733 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.332151 12732 raft_consensus.cc:1240] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:00.325695 12730 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.342481 12628 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.343743 12730 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:00.355527 12726 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.371555 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:00.372262 13516 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.374782 18338 consensus_queue.cc:1059] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:00.382383 13516 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:00.386351 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:00.387240 12875 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:00.388052 18411 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:00.388854 18411 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:00.391153 18411 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.394141 18411 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.388221 12875 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:00.400911 12875 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.402621 12875 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.403334 12631 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 17 to 18, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 18 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.412930 12875 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:00.419719 12733 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:09:00.423753 12618 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7d64be8779a42e0ad6540bfa7067f2b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 83d2731c4bc049b3929d6c39670f5fd8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.426776 12629 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:00.431756 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 47594.7us
I20260709 13:09:00.461117 13516 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:00.464903 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:00.465775 12804 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.465716 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:00.466898 12875 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.469694 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:00.470400 13516 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.480019 12800 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:00.485975 12696 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:00.486120 13516 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 19.
I20260709 13:09:00.487833 18378 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:00.488435 18378 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:00.489454 18378 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.491772 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:00.503429 12799 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 19.
I20260709 13:09:00.507592 18416 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:09:00.501308 12875 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 19.
I20260709 13:09:00.528306 18378 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:00.548857 12696 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:00.555341 12799 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:00.561467 18301 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.563170 18416 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:00.563802 18416 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:00.567016 12804 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:00.570963 18378 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.564827 18416 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:00.594331 13516 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.622960 12628 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.622635 12629 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 17 to 18, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.663512 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b483b06f72a4b6e863293d4c6099849 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:00.676326 12804 raft_consensus.cc:2955] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:00.687302 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:00.688485 12733 raft_consensus.cc:606] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:09:00.693322 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:00.693977 12733 raft_consensus.cc:606] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:09:00.722013 12617 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f21936f5afa14460a22306512f82c201 already in progress
I20260709 13:09:00.732949 13516 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:00.740168 18338 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:00.753787 12882 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:00.758878 18338 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:00.762844 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 50529.9us
I20260709 13:09:00.785051 12730 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:00.774334 12617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54279.4us
I20260709 13:09:00.794831 12730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:00.795657 12730 raft_consensus.cc:606] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:09:00.804103 12679 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:00.804114 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): ChangeConfig:REMOVE_PEER RPC failed for tablet f21936f5afa14460a22306512f82c201: Remote error: Service unavailable: leader transfer in progress
W20260709 13:09:00.805009 12679 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f21936f5afa14460a22306512f82c201 already in progress
W20260709 13:09:00.805410 12679 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f21936f5afa14460a22306512f82c201 already in progress
I20260709 13:09:00.859127 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.867131 18379 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:09:00.888350 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b483b06f72a4b6e863293d4c6099849 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:00.964542 12628 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 18 to 19, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 19 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:01.004730 18432 log.cc:927] Time spent T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:01.012713 18436 tablet_replica.cc:333] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:01.020020 18436 raft_consensus.cc:2243] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.021859 18436 raft_consensus.cc:2272] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.063498 18436 ts_tablet_manager.cc:1916] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:01.090370 12800 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:01.095538 18429 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:09:01.167527 13517 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:01.179363 12879 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:01.187656 12882 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:01.196929 18416 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:01.201941 13517 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:01.217705 18342 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:09:01.252099 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 79090.4us
I20260709 13:09:01.271478 12800 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:01.293059 18373 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:01.306573 18435 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:01.332278 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 156445us
I20260709 13:09:01.382421 18436 ts_tablet_manager.cc:1929] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:09:01.383116 18436 log.cc:1199] T 9b483b06f72a4b6e863293d4c6099849 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/9b483b06f72a4b6e863293d4c6099849
I20260709 13:09:01.345082 18378 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:09:01.431159 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58372.2us
I20260709 13:09:01.444916 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 9b483b06f72a4b6e863293d4c6099849 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:09:01.480307 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 50263.9us
I20260709 13:09:01.489441 18434 raft_consensus.cc:993] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:01.490195 18434 raft_consensus.cc:1081] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:01.529492 12799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:01.530226 12799 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.530623 12799 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:01.542505 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 102930us
I20260709 13:09:01.571885 12799 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:01.583575 12801 raft_consensus.cc:1240] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:01.617607 18434 consensus_queue.cc:1059] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:01.635141 12799 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:01.649372 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:01.641499 18416 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:01.659437 18416 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:01.663832 18416 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:01.665786 18416 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.674290 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:01.674981 13517 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.687603 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:01.688392 12880 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.697630 13517 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 19.
W20260709 13:09:01.679970 18462 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:09:01.760545 12728 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 19.
W20260709 13:09:01.764395 12617 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f21936f5afa14460a22306512f82c201 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 72d06460bb5d4ccdbd4edbda8b9a1d63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:01.778419 12880 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 19.
I20260709 13:09:01.783202 12771 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:01.788087 18458 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:01.817239 18458 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:01.818300 18458 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:01.857160 12631 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 18 to 19, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 19 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:01.900249 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 86614.4us
I20260709 13:09:01.977563 12728 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:02.003876 13517 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:02.008903 18434 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:02.046094 18342 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.061755 13517 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.068380 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7d64be8779a42e0ad6540bfa7067f2b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:09:02.084302 12800 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:02.089459 18435 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:02.097357 12800 raft_consensus.cc:2955] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.123804 12629 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 11 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 19 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.143366 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet c7d64be8779a42e0ad6540bfa7067f2b with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:02.182683 18473 tablet_replica.cc:333] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:02.183959 18473 raft_consensus.cc:2243] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.185144 18473 raft_consensus.cc:2272] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.219565 18473 ts_tablet_manager.cc:1916] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:02.221956 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.224978 13517 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:02.226776 18461 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:02.292685 12725 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:02.295401 18338 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:02.310891 12875 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:02.312990 18338 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:02.500240 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49874df91d324eee9febcb540541383f"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:02.500921 12875 raft_consensus.cc:606] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:02.515303 18473 ts_tablet_manager.cc:1929] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:09:02.534112 18473 log.cc:1199] T c7d64be8779a42e0ad6540bfa7067f2b P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/c7d64be8779a42e0ad6540bfa7067f2b
I20260709 13:09:02.518013 12800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:02.535075 12800 raft_consensus.cc:606] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:02.536795 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet c7d64be8779a42e0ad6540bfa7067f2b (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:02.539966 12800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:02.540764 12800 raft_consensus.cc:606] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:02.545946 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:02.546645 12728 raft_consensus.cc:606] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:02.571350 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:02.573045 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:02.637991 18338 raft_consensus.cc:993] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:02.638581 18338 raft_consensus.cc:1081] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:02.641026 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:02.641705 12728 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.642133 12728 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.671948 12728 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.675766 12728 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:02.676286 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:02.676990 12801 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:02.677299 12801 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:02.678179 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:02.678886 12875 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.678086 12801 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.680145 12801 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.687532 12801 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:02.688163 18440 raft_consensus.cc:993] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:02.688849 18440 raft_consensus.cc:1081] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:02.690795 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:02.691370 12733 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.691736 12733 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.699576 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:02.700565 18413 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:02.701167 18413 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:02.702028 18413 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.711831 12875 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:02.713955 12733 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.718866 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:02.719584 12801 raft_consensus.cc:3055] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:02.719935 12801 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:02.720487 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:02.720775 12801 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.721571 12875 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.722115 12801 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.740348 12733 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:02.742868 12801 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:09:02.751660 12699 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:02.752995 18434 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.753521 18434 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:02.754479 18434 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.759307 18342 raft_consensus.cc:993] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:02.759922 18342 raft_consensus.cc:1081] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:02.758138 12875 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 13.
I20260709 13:09:02.762291 12631 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 11 to 12, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.782135 12875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:02.782788 12875 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.783118 12875 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.791272 12875 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.801321 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:02.802578 12728 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:02.802829 12875 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 19 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:02.803864 18384 raft_consensus.cc:993] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:02.804149 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:02.804382 18384 raft_consensus.cc:1081] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:02.804836 12801 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.802881 12728 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:02.807894 12799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49874df91d324eee9febcb540541383f"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:02.808643 12799 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.808955 12799 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.818428 12801 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 19.
I20260709 13:09:02.820982 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:02.816375 12728 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.822350 12728 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.822846 18384 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:02.823388 18384 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:02.824280 18384 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.839454 12799 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.844411 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:02.844521 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:02.845096 12875 raft_consensus.cc:3055] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:02.845345 12733 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.845532 12875 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:02.846486 12875 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.847661 12875 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.850651 12728 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 19.
I20260709 13:09:02.860302 12799 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:02.862203 12875 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:02.863611 12771 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:02.864622 18440 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.865123 18440 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:02.865988 18440 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:02.835539 12801 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:02.868764 12733 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:02.873215 12875 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:02.874864 13517 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:02.874886 18461 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:02.878015 18461 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:02.887133 18338 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 12 to 15, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.890098 13517 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 12 to 15, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.922921 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f21936f5afa14460a22306512f82c201 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 13:09:02.933897 12875 raft_consensus.cc:2955] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 12 to 15, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.933378 12629 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 12 to 15, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 19 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:02.944787 12631 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.961212 12628 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 12 to 13, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.017516 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet f21936f5afa14460a22306512f82c201 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:03.052556 18485 tablet_replica.cc:333] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:03.055765 12626 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 18 to 19, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 19 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.066247 18485 raft_consensus.cc:2243] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.067036 18485 raft_consensus.cc:2272] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.124950 12882 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:03.127449 18468 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:03.144268 18485 ts_tablet_manager.cc:1916] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:03.208956 12804 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.211738 18342 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:03.213510 12804 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:03.216629 18454 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:03.233932 12799 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:03.235708 18413 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:03.254876 18485 ts_tablet_manager.cc:1929] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:09:03.265596 12728 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:03.266870 18485 log.cc:1199] T f21936f5afa14460a22306512f82c201 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/f21936f5afa14460a22306512f82c201
I20260709 13:09:03.268929 12728 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.269117 18384 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:03.270107 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet f21936f5afa14460a22306512f82c201 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:03.279376 18458 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:03.299302 12882 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.300853 18468 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:03.441648 12882 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.447278 18458 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:03.497877 12799 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:03.574362 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:03.613482 12771 consensus_peers.cc:597] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd420c179d854f04989e23d8e19b0505. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.651593 12728 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:03.662546 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 59822us
W20260709 13:09:03.664496 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 113365us
I20260709 13:09:03.661396 12882 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:03.665776 18440 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:03.683846 18505 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:03.768208 18458 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:03.789039 12882 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:03.800419 12725 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:03.826906 12626 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:03.899405 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 88723.6us
I20260709 13:09:03.900923 12799 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.904819 12728 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:03.912923 12880 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:03.910705 18497 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:09:03.925216 12696 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 390c91265699487c943fe0217424eb34. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.950155 18434 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:09:04.006225 18413 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.037993 12875 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.057564 12725 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:04.071877 12880 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:04.074558 18413 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:04.078408 12696 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28ea7c094d994eea9ec8090103d1142e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.087316 18516 ts_tablet_manager.cc:933] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:04.094868 18516 tablet_copy_client.cc:323] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:04.173229 18497 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.306874 12879 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.310062 12629 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:04.425945 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 273942us
I20260709 13:09:04.453457 12804 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:09:04.460457 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.488881 18529 ts_tablet_manager.cc:933] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:09:04.512449 12878 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:04.511935 12629 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.545107 18529 tablet_copy_client.cc:323] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:04.545401 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet cd420c179d854f04989e23d8e19b0505 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:04.546339 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet cd420c179d854f04989e23d8e19b0505 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-cd420c179d854f04989e23d8e19b0505
I20260709 13:09:04.548094 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 390c91265699487c943fe0217424eb34 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:04.548849 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 390c91265699487c943fe0217424eb34 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-390c91265699487c943fe0217424eb34
I20260709 13:09:04.529544 12801 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.569573 18528 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:04.608260 12742 tablet_copy_source_session.cc:215] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:04.583663 12818 tablet_copy_source_session.cc:215] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:04.628602 18529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c91265699487c943fe0217424eb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.629794 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd420c179d854f04989e23d8e19b0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.646004 12799 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:09:04.646804 12845 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e133c6f80354472a921214beecde238. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.648097 18384 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:04.670255 12728 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:04.717482 18534 ts_tablet_manager.cc:933] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:09:04.719044 18502 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:09:04.727331 12804 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.769904 18384 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.777318 12801 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.792551 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:04.840220 18534 tablet_copy_client.cc:323] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:04.871534 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.914006 18529 tablet_copy_client.cc:806] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:04.929297 18516 tablet_copy_client.cc:806] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:04.930651 18516 tablet_copy_client.cc:670] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:04.921694 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 28ea7c094d994eea9ec8090103d1142e from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:04.950150 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 28ea7c094d994eea9ec8090103d1142e from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-28ea7c094d994eea9ec8090103d1142e
I20260709 13:09:04.956159 18516 tablet_copy_client.cc:538] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:04.957358 12726 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:04.947031 18529 tablet_copy_client.cc:670] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:04.996299 18529 tablet_copy_client.cc:538] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:05.008816 12742 tablet_copy_source_session.cc:215] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:05.012535 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ea7c094d994eea9ec8090103d1142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:05.042454 18529 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:05.054664 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 119547us
I20260709 13:09:05.059669 18516 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:05.240819 18543 ts_tablet_manager.cc:933] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:05.263006 18543 tablet_copy_client.cc:323] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:05.266067 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 6e133c6f80354472a921214beecde238 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:05.266772 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 6e133c6f80354472a921214beecde238 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-6e133c6f80354472a921214beecde238
I20260709 13:09:05.290608 12892 tablet_copy_source_session.cc:215] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:05.318452 18543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e133c6f80354472a921214beecde238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:05.320632 18534 tablet_copy_client.cc:806] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:05.334297 18534 tablet_copy_client.cc:670] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:05.339859 18534 tablet_copy_client.cc:538] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:05.359411 18529 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.360809 18529 tablet_bootstrap.cc:492] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:05.361719 18529 ts_tablet_manager.cc:1403] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.320s	user 0.044s	sys 0.017s
I20260709 13:09:05.368834 18534 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:05.373661 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:05.374636 12799 raft_consensus.cc:606] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:05.390556 18543 tablet_copy_client.cc:806] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:05.391456 18543 tablet_copy_client.cc:670] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:05.399262 18543 tablet_copy_client.cc:538] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:05.406606 12726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:05.407346 12726 raft_consensus.cc:606] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:05.408291 18529 raft_consensus.cc:359] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.409461 18529 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:05.410290 18529 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.430239 18529 ts_tablet_manager.cc:1434] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:09:05.454495 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-390c91265699487c943fe0217424eb34 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:05.455142 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-390c91265699487c943fe0217424eb34 on tablet 390c91265699487c943fe0217424eb34 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:05.460779 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:05.461534 12875 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:05.469190 18543 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:05.484109 12805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:05.485046 12805 raft_consensus.cc:606] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:05.505709 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:05.507083 12728 raft_consensus.cc:606] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:05.511510 18483 raft_consensus.cc:993] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:05.512667 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:05.514312 18483 raft_consensus.cc:1081] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:05.514457 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:05.542411 13517 raft_consensus.cc:1217] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:09:05.561281 18516 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.563500 18505 raft_consensus.cc:993] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:05.532668 12875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:05.564020 18516 tablet_bootstrap.cc:492] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:05.565263 18516 ts_tablet_manager.cc:1403] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.506s	user 0.037s	sys 0.022s
I20260709 13:09:05.564159 18505 raft_consensus.cc:1081] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:05.575052 12882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:09:05.575730 12882 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.576131 12882 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.564507 12875 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.578689 12875 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.587666 18516 raft_consensus.cc:359] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.598495 18516 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:05.598927 18505 raft_consensus.cc:993] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:05.599673 18338 raft_consensus.cc:1081] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:05.599548 18516 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.603210 18516 ts_tablet_manager.cc:1434] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:09:05.604760 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:05.605427 12728 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.608919 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-cd420c179d854f04989e23d8e19b0505 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:05.609436 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-cd420c179d854f04989e23d8e19b0505 on tablet cd420c179d854f04989e23d8e19b0505 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:05.605793 12728 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.618525 12882 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.621433 12875 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.626283 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:05.627174 12805 raft_consensus.cc:3055] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:05.627468 12805 raft_consensus.cc:740] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:05.627897 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f97de57a4f4bf7a4ac5fde6b3bc613" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:05.628611 13517 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.628321 12805 consensus_queue.cc:260] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.629557 12805 raft_consensus.cc:3060] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.635100 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:05.635810 12730 raft_consensus.cc:3055] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:05.637964 12730 raft_consensus.cc:740] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:05.638811 12730 consensus_queue.cc:260] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.640467 12875 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:05.641031 12730 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.662221 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:05.663072 13516 raft_consensus.cc:3060] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.664363 12805 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:09:05.667200 12848 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:05.651331 12728 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:05.668535 18500 raft_consensus.cc:2804] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:05.669210 18500 raft_consensus.cc:697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:05.670307 18500 consensus_queue.cc:237] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.674525 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:05.675203 12799 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:05.675529 12799 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:05.676290 12799 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:05.677358 12799 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.697899 12728 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:05.703393 12799 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:05.705454 12882 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:05.704779 12699 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:05.715126 13514 raft_consensus.cc:1217] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:09:05.716969 18543 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.718222 18543 tablet_bootstrap.cc:492] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:05.718906 18523 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:05.719477 18523 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:05.720369 18523 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:05.744107 18543 ts_tablet_manager.cc:1403] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.277s	user 0.034s	sys 0.014s
I20260709 13:09:05.753901 13516 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:09:05.766997 12845 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:05.768010 18500 raft_consensus.cc:2804] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:05.770385 12628 catalog_manager.cc:5697] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.771425 18500 raft_consensus.cc:697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:05.772413 13517 raft_consensus.cc:2468] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:09:05.773123 18500 consensus_queue.cc:237] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.781575 18468 raft_consensus.cc:993] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:05.782200 18468 raft_consensus.cc:1081] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:05.784209 12805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:05.784864 12805 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.785403 12805 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.784904 18543 raft_consensus.cc:359] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.788023 18534 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.785976 18543 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:05.810516 18534 tablet_bootstrap.cc:492] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:05.810281 18543 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.812673 18543 ts_tablet_manager.cc:1434] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:09:05.813243 18534 ts_tablet_manager.cc:1403] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.445s	user 0.038s	sys 0.015s
I20260709 13:09:05.826486 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-6e133c6f80354472a921214beecde238 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:05.827280 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-6e133c6f80354472a921214beecde238 on tablet 6e133c6f80354472a921214beecde238 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:05.828557 18539 raft_consensus.cc:993] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:05.829304 18539 raft_consensus.cc:1081] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:05.831166 12804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:05.831755 12804 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.832145 12804 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:05.841761 18534 raft_consensus.cc:359] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.842751 18534 raft_consensus.cc:740] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:05.843490 18534 consensus_queue.cc:260] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.845501 18534 ts_tablet_manager.cc:1434] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:09:05.846915 12804 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.849170 12804 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:05.847352 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-28ea7c094d994eea9ec8090103d1142e received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:05.849876 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-28ea7c094d994eea9ec8090103d1142e on tablet 28ea7c094d994eea9ec8090103d1142e with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:05.852631 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:05.853526 12875 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:05.853931 12875 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:05.855046 12875 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:05.857452 12875 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:05.886754 13516 raft_consensus.cc:1217] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
W20260709 13:09:05.917052 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 208965us
I20260709 13:09:05.928910 12875 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:05.973778 12730 raft_consensus.cc:2468] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:09:05.982852 12805 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:05.997098 13517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:05.997941 13517 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.000308 12805 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:06.010859 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:06.011139 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:06.011579 12726 raft_consensus.cc:3055] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:06.011837 12728 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:06.012079 12726 raft_consensus.cc:740] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:06.013186 12726 consensus_queue.cc:260] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:06.014509 12726 raft_consensus.cc:3060] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.017076 13516 raft_consensus.cc:1217] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:09:06.028837 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:06.036077 12875 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.035087 12728 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:06.024700 13517 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 20.
I20260709 13:09:06.041939 12726 raft_consensus.cc:2468] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 20.
I20260709 13:09:06.026029 12771 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:06.047276 12875 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:06.070297 12771 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:09:06.076701 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 127124us
I20260709 13:09:06.061843 18505 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:06.092218 18338 raft_consensus.cc:2804] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:06.105795 18505 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:06.109541 18338 raft_consensus.cc:697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:06.110682 18338 consensus_queue.cc:237] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:06.129181 12629 catalog_manager.cc:5697] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 19 to 20, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 20 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.133131 13517 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:06.107228 18505 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:06.157795 18500 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:06.213260 12805 raft_consensus.cc:1275] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:09:06.247288 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 151620us
I20260709 13:09:06.244210 18506 consensus_queue.cc:1048] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 13:09:06.279652 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45487.8us
W20260709 13:09:06.305022 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 176262us
I20260709 13:09:06.316324 12628 catalog_manager.cc:5697] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 14, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.322613 12728 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:09:06.326357 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 111486us
I20260709 13:09:06.319595 12629 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 11 to 12, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.344007 18539 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:09:06.360302 12878 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:06.437062 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 90866.1us
I20260709 13:09:06.452847 13517 raft_consensus.cc:1275] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:06.456584 18574 consensus_queue.cc:1048] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:06.475288 18505 raft_consensus.cc:1064] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:09:06.487099 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 75163.2us
I20260709 13:09:06.489954 12626 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.513193 18570 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:06.516214 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:06.519531 18497 raft_consensus.cc:1064] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:06.541486 12800 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:06.482452 18505 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:06.568483 18552 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:06.569749 18497 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:06.600291 12800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:06.601935 12800 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:09:06.603601 18468 raft_consensus.cc:1064] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:06.608095 12800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:06.609017 12800 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Received request to transfer leadership
W20260709 13:09:06.621995 12618 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 6e133c6f80354472a921214beecde238 already in progress [suppressed 3 similar messages]
I20260709 13:09:06.606745 18468 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:06.712761 12726 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:09:06.716069 12618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 94248us
W20260709 13:09:06.810976 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 128002us
I20260709 13:09:06.846148 13517 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:06.850687 13517 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Advancing to term 13
I20260709 13:09:06.851220 13516 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:09:06.852456 18585 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:09:06.853292 18558 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:06.888492 12728 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:06.902362 18526 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 13:09:06.908741 18587 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.163s	user 0.000s	sys 0.005s
I20260709 13:09:06.928292 13514 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:06.934118 18550 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:06.946682 13517 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:06.965034 12804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:06.965916 12804 raft_consensus.cc:606] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:09:06.989104 12875 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:07.011334 12800 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:07.005230 12882 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:07.012372 18563 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:09:07.013422 12873 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:07.013906 12874 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:07.045637 12805 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:07.064692 18572 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:07.066591 18598 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:07.068846 18571 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:07.073532 18526 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:07.097415 18563 raft_consensus.cc:1064] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:09:07.097924 18563 raft_consensus.cc:1068] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Service unavailable: leader transfer in progress
I20260709 13:09:07.118538 18526 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:07.120885 18564 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:07.123976 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 65154.9us
I20260709 13:09:07.160264 12730 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:07.195114 12679 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:07.195639 12679 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6e133c6f80354472a921214beecde238 already in progress
W20260709 13:09:07.195966 12679 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6e133c6f80354472a921214beecde238 already in progress
I20260709 13:09:07.223295 13517 raft_consensus.cc:1275] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:09:07.213297 18605 log.cc:927] Time spent T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:09:07.334227 18564 raft_consensus.cc:993] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:07.188987 18526 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 13:09:07.203827 18558 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:09:07.197870 18571 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.149s
I20260709 13:09:07.383738 18599 raft_consensus.cc:1081] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
W20260709 13:09:07.397845 18609 log.cc:927] Time spent T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:07.400389 18338 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.415138 18505 consensus_queue.cc:1048] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:07.421522 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e133c6f80354472a921214beecde238"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:07.422171 12732 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.422555 12732 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:07.458113 18611 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:07.450824 18552 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:07.469693 18613 log.cc:927] Time spent T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.092s	user 0.000s	sys 0.006s
I20260709 13:09:07.477510 13517 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.519307 12879 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.520546 12732 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:07.548471 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:07.571373 12732 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:07.557075 12628 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.544006 13514 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.605077 12801 raft_consensus.cc:3055] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:07.605545 12801 raft_consensus.cc:740] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:07.606462 12801 consensus_queue.cc:260] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:07.562233 12874 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:07.596429 18591 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:09:07.615589 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:09:07.652792 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58332us
I20260709 13:09:07.520673 18572 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:07.679076 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 118369us
I20260709 13:09:07.777900 12801 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.809677 12801 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 14.
W20260709 13:09:07.811126 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 115634us
W20260709 13:09:07.837364 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52184.4us
I20260709 13:09:07.859401 12874 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.863045 13514 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:07.884131 12730 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:07.891606 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 73786.9us
I20260709 13:09:07.904639 12699 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:07.926398 18624 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:07.987368 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70435.4us
W20260709 13:09:07.991690 18607 log.cc:927] Time spent T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.168s	user 0.002s	sys 0.001s
I20260709 13:09:08.005512 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:08.035862 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 48048.1us
I20260709 13:09:08.047804 12802 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.113574 12801 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.075367 18624 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
W20260709 13:09:08.171877 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66545.8us
I20260709 13:09:08.147714 18624 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:08.241878 12629 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.298390 12626 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.330295 12801 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:08.342700 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 13 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 14 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.399137 13517 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:08.414894 18338 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:08.422465 12880 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:08.435529 12730 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:08.435307 12728 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:08.442163 13513 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:08.444094 18624 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:08.454134 18560 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.455127 18558 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.462268 13514 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.473062 18604 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:08.474365 13517 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.478776 12875 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:08.480597 13513 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:08.484124 18624 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:08.490350 12874 raft_consensus.cc:2955] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:08.491887 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56264.7us
I20260709 13:09:08.493953 18620 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.498567 18640 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.524516 12802 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:08.501438 13513 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.545308 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd420c179d854f04989e23d8e19b0505 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:08.550132 12629 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.551729 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 390c91265699487c943fe0217424eb34 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:08.561714 12628 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.563469 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28ea7c094d994eea9ec8090103d1142e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:08.571848 12801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:08.572522 12801 raft_consensus.cc:606] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:08.574540 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet cd420c179d854f04989e23d8e19b0505 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:08.578168 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 390c91265699487c943fe0217424eb34 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:08.599794 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:08.610432 12875 raft_consensus.cc:606] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:08.614050 18648 tablet_replica.cc:333] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:08.619016 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:08.632282 12728 raft_consensus.cc:606] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:08.637070 12880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:08.637688 12880 raft_consensus.cc:606] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:08.628587 12874 raft_consensus.cc:2955] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.644642 12801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:08.645342 12801 raft_consensus.cc:606] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:08.655738 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:08.657747 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:08.657923 18502 raft_consensus.cc:993] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:08.658501 18502 raft_consensus.cc:1081] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:08.661664 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:08.662326 12801 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:08.662705 12801 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.674328 18558 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:08.676738 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 45866.7us
I20260709 13:09:08.682127 12801 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:08.678833 18648 raft_consensus.cc:2243] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.693008 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:08.696647 12728 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.699936 12801 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:08.803439 12628 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.808288 12805 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:08.817843 12808 raft_consensus.cc:2955] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:08.828827 12728 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:09:08.836987 18624 raft_consensus.cc:993] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:08.839299 18639 raft_consensus.cc:1081] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:08.852335 12773 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:08.866338 18628 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:09:08.892148 18593 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:08.899422 12808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:08.897432 18648 raft_consensus.cc:2272] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.905078 18593 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:08.923058 18593 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:08.913426 18649 tablet_replica.cc:333] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:08.928714 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ea7c094d994eea9ec8090103d1142e with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:09.015097 18648 ts_tablet_manager.cc:1916] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:09.062088 12808 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.062713 12808 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.098469 18656 tablet_replica.cc:333] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:09.100380 18656 raft_consensus.cc:2243] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.101728 18656 raft_consensus.cc:2272] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.118474 12808 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.116324 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:09.123572 12880 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:09.124051 12880 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:09.182807 12808 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:09.189687 13517 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Advancing to term 14
I20260709 13:09:09.218390 13517 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:09.208324 12880 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:09.231853 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 105613us
I20260709 13:09:09.185956 18502 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
W20260709 13:09:09.250062 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 50612.5us
W20260709 13:09:09.254237 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92922.9us
I20260709 13:09:09.285035 18649 raft_consensus.cc:2243] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.243992 18502 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:09.339293 18502 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:09:09.342290 18660 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:09:09.365476 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 108722us
W20260709 13:09:09.366524 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 103248us
I20260709 13:09:09.378670 18649 raft_consensus.cc:2272] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.415992 12626 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 14, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.421039 12880 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.421543 18672 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:09.423679 18649 ts_tablet_manager.cc:1916] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:09.440903 12732 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:09.427892 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:09.468361 12730 raft_consensus.cc:3055] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:09.468786 12730 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:09.449193 18600 raft_consensus.cc:993] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
W20260709 13:09:09.449916 18665 log.cc:927] Time spent T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 13:09:09.463642 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:09.438823 12874 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.467027 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:09.484601 12880 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:09:09.492879 12730 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.499420 12874 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:09.507370 18666 raft_consensus.cc:993] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:09.483477 18646 raft_consensus.cc:1081] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:09.514197 12730 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.514420 18666 raft_consensus.cc:1081] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:09.515576 18600 raft_consensus.cc:993] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:09.516243 18600 raft_consensus.cc:1081] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:09.524745 12730 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:09:09.547087 18656 ts_tablet_manager.cc:1916] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:09.550060 12733 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:09.555286 18654 raft_consensus.cc:1064] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:09:09.555781 18654 raft_consensus.cc:1068] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Unable to promote non-voter a865487bf1854df8a5619d42465bb36c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:09.571602 18648 ts_tablet_manager.cc:1929] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:09:09.576427 12805 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:09.574631 18648 log.cc:1199] T cd420c179d854f04989e23d8e19b0505 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/cd420c179d854f04989e23d8e19b0505
W20260709 13:09:09.588827 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 86031.8us
W20260709 13:09:09.594066 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 91255.4us
I20260709 13:09:09.603385 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:09.603883 12730 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.604357 12730 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.604230 12848 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:09.608742 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:09.609316 12880 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.606709 18624 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:09:09.609933 18657 raft_consensus.cc:2749] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.616477 12880 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:09:09.621447 12730 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.623518 18649 ts_tablet_manager.cc:1929] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:09:09.624008 18649 log.cc:1199] T 390c91265699487c943fe0217424eb34 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/390c91265699487c943fe0217424eb34
I20260709 13:09:09.644168 12881 raft_consensus.cc:1240] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:09.645635 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:09.655092 12874 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:09.655354 12874 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:09.656019 12874 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.657003 12874 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.659467 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:09.633566 12730 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:09.624200 18648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41076 (request call id 19) took 1050 ms. Trace:
I20260709 13:09:09.636756 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:09.665421 18649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41706 (request call id 19) took 1088 ms. Trace:
I20260709 13:09:09.638451 12882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21936f5afa14460a22306512f82c201"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:09:09.666538 12882 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.666996 12882 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:09.653016 12847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.665889 12732 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.668332 12732 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:09.665035 12874 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:09:09.670529 12801 raft_consensus.cc:1240] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Rejecting Update request from peer c45825bb09c34201b13ddcec07c4b3f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:09.683591 12773 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:09.685060 12732 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.691692 12882 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:09.694687 18670 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:09.695289 18670 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:09.684196 18648 rpcz_store.cc:276] 0709 13:09:08.573953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.574255 (+   302us) service_pool.cc:224] Handling call
0709 13:09:08.613654 (+ 39399us) ts_tablet_manager.cc:1151] Deleting tablet cd420c179d854f04989e23d8e19b0505
0709 13:09:08.613738 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:09.429647 (+815909us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:09.571450 (+141803us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:09.624109 (+ 52659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":38425,"thread_start_us":38877,"threads_started":1}
I20260709 13:09:09.698599 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet cd420c179d854f04989e23d8e19b0505 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:09.700793 12732 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:09.701294 12882 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:09.704186 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:09.704797 13514 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.666045 18649 rpcz_store.cc:276] 0709 13:09:08.577426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.577764 (+   338us) service_pool.cc:224] Handling call
0709 13:09:08.898682 (+320918us) ts_tablet_manager.cc:1151] Deleting tablet 390c91265699487c943fe0217424eb34
0709 13:09:08.902052 (+  3370us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:09.560296 (+658244us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:09.623395 (+ 63099us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:09.665314 (+ 41919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173128,"tablet-delete.queue_time_us":302601,"thread_start_us":205649,"threads_started":1}
I20260709 13:09:09.722100 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21936f5afa14460a22306512f82c201" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:09.723290 12802 raft_consensus.cc:3055] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:09.723717 12802 raft_consensus.cc:740] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:09.719079 18670 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.730197 18675 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:09.732932 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 390c91265699487c943fe0217424eb34 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:09.742519 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:09.743388 12808 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.743295 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:09.745764 18672 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:09.746287 18672 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:09.726624 12802 consensus_queue.cc:260] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:09.747143 18672 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.751420 18656 ts_tablet_manager.cc:1929] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:09:09.753482 13514 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 20.
I20260709 13:09:09.754752 12845 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:09.752020 18656 log.cc:1199] T 28ea7c094d994eea9ec8090103d1142e P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/28ea7c094d994eea9ec8090103d1142e
I20260709 13:09:09.761229 18683 raft_consensus.cc:2804] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:09.762130 18683 raft_consensus.cc:697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:09.762142 12730 raft_consensus.cc:1240] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:09.763955 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:09.764592 12805 raft_consensus.cc:3055] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:09.764883 12805 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:09.766607 12802 raft_consensus.cc:3060] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.774399 12808 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 10.
I20260709 13:09:09.780880 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:09.781592 12874 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:09.782572 12882 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:09.799036 12805 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:09.800370 12805 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:09.802515 18563 consensus_queue.cc:1175] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" responder_term: 18 status { last_received { term: 17 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:09.803514 18594 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:09.805985 18683 consensus_queue.cc:237] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:09.809517 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43624us
I20260709 13:09:09.822269 12802 raft_consensus.cc:2468] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 20.
I20260709 13:09:09.840106 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 28ea7c094d994eea9ec8090103d1142e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:09.848316 12874 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
W20260709 13:09:09.905606 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 46797.6us
I20260709 13:09:09.915684 12805 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:09.913018 12628 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 14 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:09.991333 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 138994us
I20260709 13:09:09.992223 12696 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:10.025393 18641 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:10.069841 12626 catalog_manager.cc:5697] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 19 to 20, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 20 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:10.077133 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 131762us
I20260709 13:09:10.074620 18641 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:10.081637 18641 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:10.163968 12629 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 9 to 10, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 10 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:10.172591 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 63084.5us
I20260709 13:09:10.243146 12733 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:10.255226 18628 raft_consensus.cc:1064] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:10.273155 18338 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:10.282665 18628 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:10.300735 12873 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:10.312346 18705 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:10.345677 13514 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:10.348487 12882 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:10.354321 18683 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:10.360244 18338 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:09:10.360287 12805 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:10.364396 18703 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:10.414177 12802 raft_consensus.cc:1275] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:10.415326 12808 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:10.416989 18658 consensus_queue.cc:1048] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:10.423393 13514 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:10.425124 12881 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:10.428450 18654 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:10.429685 18705 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:10.431855 18624 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:10.440011 12802 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:10.466786 12628 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 17 to 18, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:10.503624 12771 consensus_peers.cc:597] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49874df91d324eee9febcb540541383f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.505707 12875 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:10.507375 12727 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:10.510960 12802 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:10.509613 18675 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:10.521654 12873 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:10.536917 18526 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:09:10.513424 18628 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 9 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:10.587392 12881 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:10.594813 18705 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:10.641330 12802 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:10.653517 18624 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:10.657598 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 9 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:10.684525 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44224.9us
I20260709 13:09:10.774276 13513 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:10.813431 18338 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:10.836310 12733 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:10.848201 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:10.849802 12679 auto_rebalancer.cc:629] Failed to schedule move for tablet 6e133c6f80354472a921214beecde238: Invalid argument: must modify a field when calling MODIFY_PEER
I20260709 13:09:10.858928 12727 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:10.859429 12730 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:10.873318 13513 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:10.880563 12880 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:10.875003 12631 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.890625 18701 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:10.900663 18701 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:10.917850 12880 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:10.925410 12802 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:10.928292 18701 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:10.965729 18628 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:10.976413 12880 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:09:10.989295 12696 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 140b233442844af3b88e29b40d4f25ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.990532 18695 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:10.992749 18654 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:10.995700 13514 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:11.004212 12802 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.006227 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e133c6f80354472a921214beecde238 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:11.017740 12629 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 14 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.033126 12631 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 7, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.043392 12802 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:11.072194 12727 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:11.073967 18526 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:11.092355 12881 raft_consensus.cc:2955] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:11.105676 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 127508us
I20260709 13:09:11.115484 18646 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.128434 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:11.129305 12733 raft_consensus.cc:606] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:11.137617 12873 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.165169 12733 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.184665 12726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:11.185360 12726 raft_consensus.cc:606] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:11.197556 12881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:11.198165 12881 raft_consensus.cc:606] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:11.220484 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "844a3ff085274442b304f06473e07511"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:11.221325 12802 raft_consensus.cc:606] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:09:11.247370 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 57629.2us
I20260709 13:09:11.259173 12873 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:11.272785 12727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc76143509f64c4faa68973765829aec"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:11.273541 12727 raft_consensus.cc:606] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:11.297030 12730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:11.297799 12730 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:11.306342 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:11.308543 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:11.320701 12631 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:11.329744 18724 ts_tablet_manager.cc:933] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:11.340763 18539 raft_consensus.cc:993] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:11.341424 18539 raft_consensus.cc:1081] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:11.350536 12727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:11.351397 12727 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.351842 12727 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.353322 18640 raft_consensus.cc:993] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:11.355669 18640 raft_consensus.cc:1081] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:11.362016 12873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:11.362664 12873 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.363049 12873 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:11.383025 18675 raft_consensus.cc:993] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:11.383662 18675 raft_consensus.cc:1081] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:11.410756 12873 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.428761 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:11.429484 12733 raft_consensus.cc:3055] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:11.429811 12733 raft_consensus.cc:740] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:11.435822 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "844a3ff085274442b304f06473e07511"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:11.436404 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e133c6f80354472a921214beecde238 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41706
W20260709 13:09:11.436359 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 68800.8us
I20260709 13:09:11.438669 12873 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:11.437551 12733 consensus_queue.cc:260] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.442695 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:11.443295 12802 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:11.436524 12730 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.452807 12730 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:11.453184 12727 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.466706 12733 raft_consensus.cc:3060] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:11.480927 18675 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:11.487852 12727 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:11.489589 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:11.490316 12873 raft_consensus.cc:3055] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:11.490653 12873 raft_consensus.cc:740] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:11.492630 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:11.493369 12808 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.499277 12802 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:11.499431 12733 raft_consensus.cc:2468] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:11.510146 12847 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:11.503926 12873 consensus_queue.cc:260] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.525066 12808 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:09:11.526994 12699 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:11.528682 12730 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.542712 18659 raft_consensus.cc:2804] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:11.543637 18659 raft_consensus.cc:697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:11.544917 18659 consensus_queue.cc:237] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.568900 12730 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:11.570384 18726 raft_consensus.cc:993] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:11.571031 18726 raft_consensus.cc:1081] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:11.516600 18724 tablet_copy_client.cc:323] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
W20260709 13:09:11.590878 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 63987.1us
I20260709 13:09:11.600389 18726 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:11.603606 18726 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:11.609221 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:11.609977 12802 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:11.610285 12802 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:11.613293 12808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:11.616601 12802 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.618419 12802 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:11.629874 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 169812us
I20260709 13:09:11.633080 12808 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.634084 12808 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:11.635329 12873 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.643762 12808 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.668207 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 49874df91d324eee9febcb540541383f from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:11.656385 18729 tablet_replica.cc:333] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:11.669098 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 49874df91d324eee9febcb540541383f from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-49874df91d324eee9febcb540541383f
I20260709 13:09:11.694216 18729 raft_consensus.cc:2243] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:11.701937 12802 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:11.717069 12873 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:09:11.718325 12808 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:11.635823 18726 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:11.735204 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70644.6us
I20260709 13:09:11.722604 18734 ts_tablet_manager.cc:933] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:09:11.740869 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55663us
W20260709 13:09:11.749173 12771 consensus_peers.cc:597] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b16b34b3b4a04edca05d5f0f4a3ce868. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.741830 18729 raft_consensus.cc:2272] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:11.766861 18729 ts_tablet_manager.cc:1916] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:11.782202 18700 raft_consensus.cc:993] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:11.782812 18700 raft_consensus.cc:1081] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:11.784830 12818 tablet_copy_source_session.cc:215] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:11.813257 18724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49874df91d324eee9febcb540541383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.750072 12699 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
W20260709 13:09:11.816383 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 150819us
I20260709 13:09:11.818547 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:09:11.819131 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 309101us
I20260709 13:09:11.819237 12875 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:11.834419 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 87183.8us
I20260709 13:09:11.839303 18726 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:11.941157 18726 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:11.942291 18726 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:11.921489 18734 tablet_copy_client.cc:323] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:11.986620 12631 catalog_manager.cc:5697] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.006274 12629 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.007216 12875 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
I20260709 13:09:12.008138 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:12.008944 12726 raft_consensus.cc:3055] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:12.009342 12726 raft_consensus.cc:740] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:12.010305 12726 consensus_queue.cc:260] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:12.011469 12726 raft_consensus.cc:3060] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:12.024855 13514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc76143509f64c4faa68973765829aec"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:38668
I20260709 13:09:12.025740 13514 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.026242 13514 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:12.027212 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 43914.6us
I20260709 13:09:12.028883 12771 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:12.008319 18740 raft_consensus.cc:993] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:12.037477 12873 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:12.067304 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 227183us
W20260709 13:09:12.088783 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59996.7us
I20260709 13:09:12.079566 13514 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:12.165831 18338 raft_consensus.cc:2804] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:12.168569 13517 raft_consensus.cc:1240] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:12.169462 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 96793.9us
I20260709 13:09:12.177443 12726 raft_consensus.cc:2468] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 11.
W20260709 13:09:12.210345 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 176987us
I20260709 13:09:12.210156 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:12.212255 12874 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:12.218132 12879 raft_consensus.cc:1240] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:12.242816 12874 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:12.187180 18654 raft_consensus.cc:1081] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
W20260709 13:09:12.269220 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 201636us
W20260709 13:09:12.280005 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 216385us
W20260709 13:09:12.283346 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 50130.6us
I20260709 13:09:12.283666 18338 raft_consensus.cc:697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:12.285284 13514 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:12.284783 18338 consensus_queue.cc:237] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:12.326850 18746 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:09:12.284116 18705 consensus_queue.cc:1059] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:12.384647 18729 ts_tablet_manager.cc:1929] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:09:12.388525 12800 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:12.389170 12800 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.389523 12800 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:12.393908 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:12.395458 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 45852.7us
I20260709 13:09:12.385440 18729 log.cc:1199] T 6e133c6f80354472a921214beecde238 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/6e133c6f80354472a921214beecde238
W20260709 13:09:12.425596 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.449021 18729 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41706 (request call id 20) took 1031 ms. Trace:
I20260709 13:09:12.449712 18729 rpcz_store.cc:276] 0709 13:09:11.417540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.417702 (+   162us) service_pool.cc:224] Handling call
0709 13:09:11.611608 (+193906us) ts_tablet_manager.cc:1151] Deleting tablet 6e133c6f80354472a921214beecde238
0709 13:09:11.615246 (+  3638us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:11.942214 (+326968us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.384485 (+442271us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.448881 (+ 64396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7923,"tablet-delete.queue_time_us":153709,"thread_start_us":71047,"threads_started":1}
I20260709 13:09:12.477656 18738 raft_consensus.cc:3055] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:12.478410 18738 raft_consensus.cc:740] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:12.518898 12808 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:12.532974 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 473633us
W20260709 13:09:12.538429 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 445361us
I20260709 13:09:12.541868 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 6e133c6f80354472a921214beecde238 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:12.541834 12800 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:12.557889 12800 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:12.564465 18765 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:12.568208 12805 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:12.572067 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:12.572767 18724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38680 (request call id 720) took 1343 ms. Trace:
I20260709 13:09:12.573280 18724 rpcz_store.cc:276] 0709 13:09:11.229575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.229763 (+   188us) service_pool.cc:224] Handling call
0709 13:09:11.330156 (+100393us) ts_tablet_manager.cc:934] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
0709 13:09:11.793119 (+462963us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:12.338477 (+545358us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.338610 (+   133us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.559642 (+221032us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.559947 (+   305us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.572530 (+ 12583us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.572591 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":80961,"tablet-copy.queue_time_us":99369,"thread_start_us":161311,"threads_started":2}
I20260709 13:09:12.574887 18724 tablet_copy_client.cc:806] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:12.575455 18724 tablet_copy_client.cc:670] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:12.572845 12733 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:12.577696 12733 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:12.578522 12733 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:12.579496 12733 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:12.479600 18738 consensus_queue.cc:260] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:12.597126 18659 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:12.616086 18738 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.616426 12628 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.618184 12733 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:09:12.602839 12629 catalog_manager.cc:5697] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 10 to 11, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 11 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:12.623052 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 72395.9us
I20260709 13:09:12.626963 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 140b233442844af3b88e29b40d4f25ad from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:12.627650 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 140b233442844af3b88e29b40d4f25ad from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-140b233442844af3b88e29b40d4f25ad
I20260709 13:09:12.639894 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:12.649994 12728 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:09:12.654821 12732 raft_consensus.cc:1275] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:12.658875 13486 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:12.659971 12742 tablet_copy_source_session.cc:215] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:12.660955 18736 raft_consensus.cc:2804] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:12.661590 18736 raft_consensus.cc:697] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:12.662511 18736 consensus_queue.cc:237] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:12.670238 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:12.670915 12873 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:12.681826 12802 raft_consensus.cc:1240] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:12.704820 12801 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:09:12.708344 12880 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:12.712740 18734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140b233442844af3b88e29b40d4f25ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.730612 18738 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:12.739028 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:12.739408 12773 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:12.739741 12880 raft_consensus.cc:3060] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.745893 18769 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:12.746485 18769 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:12.747324 18769 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:12.748610 12880 raft_consensus.cc:2468] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 8.
I20260709 13:09:12.763248 12873 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:09:12.763499 12629 catalog_manager.cc:5697] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 7 to 8, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 8 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.803089 18724 tablet_copy_client.cc:538] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:12.821857 12873 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:12.786928 18767 consensus_queue.cc:1048] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:12.834559 18731 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:09:12.837921 18772 ts_tablet_manager.cc:933] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:12.815668 18766 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:12.915343 18734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38668 (request call id 518) took 1377 ms. Trace:
I20260709 13:09:12.916637 18734 rpcz_store.cc:276] 0709 13:09:11.538470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.538645 (+   175us) service_pool.cc:224] Handling call
0709 13:09:11.742012 (+203367us) ts_tablet_manager.cc:934] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
0709 13:09:12.711256 (+969244us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:12.727269 (+ 16013us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.727399 (+   130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.914621 (+187222us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.914898 (+   277us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.915215 (+   317us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.915275 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":61273,"tablet-copy.queue_time_us":137275,"thread_start_us":173694,"threads_started":2}
I20260709 13:09:12.925437 12880 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:09:12.927066 12726 raft_consensus.cc:1275] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:12.933641 18734 tablet_copy_client.cc:806] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:12.940166 18725 consensus_queue.cc:1048] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:09:12.953526 18772 tablet_copy_client.cc:323] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:12.971745 18734 tablet_copy_client.cc:670] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:12.989485 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet b16b34b3b4a04edca05d5f0f4a3ce868 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:13.011112 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet b16b34b3b4a04edca05d5f0f4a3ce868 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-b16b34b3b4a04edca05d5f0f4a3ce868
I20260709 13:09:13.000541 18724 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:13.006762 18735 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:13.062951 18781 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:09:13.068095 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 47932.5us
I20260709 13:09:13.095933 18734 tablet_copy_client.cc:538] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:13.113708 12629 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 16 to 17, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 17 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:13.125488 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 103983us
I20260709 13:09:13.171412 12726 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:13.147601 12818 tablet_copy_source_session.cc:215] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:13.189284 12873 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:13.197425 18725 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:13.201375 18734 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:13.192638 18751 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:09:13.226361 18772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16b34b3b4a04edca05d5f0f4a3ce868. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:13.256045 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55796us
I20260709 13:09:13.256095 12873 raft_consensus.cc:1275] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:13.282054 18751 consensus_queue.cc:1048] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:09:13.346771 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 143402us
I20260709 13:09:13.434096 12732 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:13.452699 18769 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:13.472237 18772 tablet_copy_client.cc:806] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:13.473027 18772 tablet_copy_client.cc:670] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:13.544389 18724 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:13.575434 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53624.5us
I20260709 13:09:13.576392 18724 tablet_bootstrap.cc:492] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:13.577334 18724 ts_tablet_manager.cc:1403] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.577s	user 0.024s	sys 0.031s
I20260709 13:09:13.599843 18772 tablet_copy_client.cc:538] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:13.614667 18724 raft_consensus.cc:359] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:13.653594 18724 raft_consensus.cc:740] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:13.661289 18724 consensus_queue.cc:260] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:13.664522 18724 ts_tablet_manager.cc:1434] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.001s
W20260709 13:09:13.713109 18734 log.cc:927] Time spent T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:13.770838 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-49874df91d324eee9febcb540541383f received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:13.773617 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-49874df91d324eee9febcb540541383f on tablet 49874df91d324eee9febcb540541383f with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:13.855542 18772 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:13.886091 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.917130 18734 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:13.918341 18734 tablet_bootstrap.cc:492] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:13.941782 18734 ts_tablet_manager.cc:1403] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.775s	user 0.039s	sys 0.031s
I20260709 13:09:13.951124 18734 raft_consensus.cc:359] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:13.956209 18734 raft_consensus.cc:740] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:13.960495 18734 consensus_queue.cc:260] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:13.981920 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:13.982781 12728 raft_consensus.cc:606] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:13.989647 12874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:13.990237 12874 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:13.993891 18734 ts_tablet_manager.cc:1434] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:09:13.994081 12808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:13.994805 12808 raft_consensus.cc:606] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:14.002202 18658 raft_consensus.cc:993] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:14.002756 18658 raft_consensus.cc:1081] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:14.005780 12805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:14.006428 12805 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.006770 12805 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.008240 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:14.010138 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:14.015054 12805 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.030575 12726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:14.032589 12805 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:14.035547 12726 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.036231 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:14.060890 12874 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:14.061255 12874 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:14.072855 13514 raft_consensus.cc:1217] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:09:14.074646 12726 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:14.076363 12773 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:14.076395 12874 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.087422 12874 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.085448 18759 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:14.094079 18759 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:14.095237 18759 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.103623 18758 raft_consensus.cc:993] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:14.106024 12874 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:14.107698 18758 raft_consensus.cc:1081] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:14.154560 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:14.155416 12728 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.116173 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-140b233442844af3b88e29b40d4f25ad received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:14.155923 12728 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:14.156129 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-140b233442844af3b88e29b40d4f25ad on tablet 140b233442844af3b88e29b40d4f25ad with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:14.181741 12728 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.201586 12728 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:14.202592 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:14.203294 12881 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:14.203673 12629 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.206135 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:14.206719 12805 raft_consensus.cc:3055] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:14.207024 12805 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:14.207803 12805 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.207978 18772 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:14.217178 18772 tablet_bootstrap.cc:492] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:14.217973 18772 ts_tablet_manager.cc:1403] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.363s	user 0.041s	sys 0.008s
I20260709 13:09:14.209132 12805 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:14.213979 12881 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:14.233075 12696 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:14.234110 18705 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:14.235458 18705 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:14.236434 18705 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:14.279398 12805 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 18.
I20260709 13:09:14.292701 12631 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 17 to 18, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.297396 18772 raft_consensus.cc:359] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:14.347427 18772 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:14.373762 18772 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:14.379472 18772 ts_tablet_manager.cc:1434] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.161s	user 0.011s	sys 0.003s
W20260709 13:09:14.426999 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 102308us
I20260709 13:09:14.582516 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-b16b34b3b4a04edca05d5f0f4a3ce868 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:14.583468 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-b16b34b3b4a04edca05d5f0f4a3ce868 on tablet b16b34b3b4a04edca05d5f0f4a3ce868 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:14.629886 12726 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:14.665058 13517 raft_consensus.cc:1217] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 13:09:14.689124 18758 raft_consensus.cc:1064] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:14.699040 18815 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:14.695945 18758 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:14.770646 13514 raft_consensus.cc:1217] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:09:14.806473 18807 raft_consensus.cc:993] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:14.807190 18807 raft_consensus.cc:1081] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
W20260709 13:09:14.808247 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 192213us
I20260709 13:09:14.817329 12873 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:14.874244 12879 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:14.874873 12808 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:14.941962 18810 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:14.967703 18810 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:15.022003 12874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:15.022781 12874 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.023182 12874 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.036181 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.044720 18749 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:15.059244 13514 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:15.061043 12732 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:15.064136 18769 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:09:15.120910 12876 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:15.185401 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 77728.5us
I20260709 13:09:15.135056 18758 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:09:15.262178 12874 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:15.280349 12873 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:15.297683 12874 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:15.325174 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:15.326151 12800 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.545893 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:15.546977 12730 raft_consensus.cc:3055] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:15.547374 12730 raft_consensus.cc:740] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:15.549232 12730 consensus_queue.cc:260] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:15.550603 12800 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:15.550658 12730 raft_consensus.cc:3060] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.576294 18731 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:09:15.587144 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 146557us
I20260709 13:09:15.644011 12730 raft_consensus.cc:2468] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:15.686463 12805 raft_consensus.cc:1240] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:15.711148 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 260979us
W20260709 13:09:15.712145 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 250460us
W20260709 13:09:15.775182 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 63191.6us
I20260709 13:09:15.834255 18809 raft_consensus.cc:1064] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:09:15.875778 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 136459us
W20260709 13:09:15.878715 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60305.3us
W20260709 13:09:15.878080 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 144959us
W20260709 13:09:15.895013 12696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.959933 18809 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 5, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:15.935125 12848 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:16.065068 18658 raft_consensus.cc:2804] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:16.065719 18658 raft_consensus.cc:697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:16.066684 18658 consensus_queue.cc:237] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:16.056506 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 104692us
I20260709 13:09:16.070657 18749 raft_consensus.cc:1064] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:16.073650 18749 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:16.075382 18835 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:16.075973 18835 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:16.078616 12697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.078842 18835 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:16.080461 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
W20260709 13:09:16.080878 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 145913us
W20260709 13:09:16.089766 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 108247us
I20260709 13:09:16.137547 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:16.161602 13514 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:16.169184 12730 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:16.171983 18749 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:16.184686 12805 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:16.190757 18815 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:16.199010 13512 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:16.200695 13514 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.209409 12874 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:16.211334 12771 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:16.216199 18797 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.292315 18834 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:09:16.312239 18839 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:16.313194 18839 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:16.316262 18731 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.289551 18835 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:09:16.390411 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94603.6us
I20260709 13:09:16.299542 18809 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:09:16.404002 18846 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:16.408879 18839 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:16.409461 12881 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:16.413369 18842 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:16.440409 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:16.440644 18843 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:16.441715 18843 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:16.446569 18843 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:16.449986 18862 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:16.468341 18846 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:16.470651 18846 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:16.432304 18842 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:16.485613 18842 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:16.554636 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56791.1us
I20260709 13:09:16.555033 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:16.576021 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:16.608707 12730 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:16.610750 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:09:16.627861 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 176819us
I20260709 13:09:16.626205 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:16.619611 18839 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:09:16.632787 18725 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.633314 12725 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.622138 12629 catalog_manager.cc:5697] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.654434 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff29d178e6c42cd8abcbd3d7747b77a" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:16.663182 12699 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:16.667500 18831 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:16.669404 12626 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.761870 13512 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.772526 12732 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.786629 18769 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:16.787325 18769 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:16.804909 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:16.808399 12881 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.818408 18769 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:16.823376 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:16.824478 12799 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:09:16.847801 13487 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:16.856381 18848 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:16.865590 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:16.868134 12805 raft_consensus.cc:1275] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:16.868476 12771 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:16.887120 18758 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:16.892023 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:16.935761 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:16.955698 18839 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:16.956305 18839 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:16.956702 18839 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.958179 18810 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 7 to 8, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.991362 13516 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.997814 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:16.999495 18835 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.014375 12879 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:16.994340 18860 consensus_queue.cc:1048] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:17.036381 12880 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.044605 12799 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.108870 18839 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:17.137055 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:17.141817 18839 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:17.143051 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:17.150319 12848 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:17.148617 12879 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:17.151731 18806 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:17.152834 18810 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:09:17.205044 12631 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.220259 18820 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:17.220758 18820 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:17.230005 18820 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:17.232419 18820 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.246238 12628 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 7 to 8, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.372957 12805 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:17.377414 12725 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:17.405292 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 48575.7us
I20260709 13:09:17.431229 12808 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:17.432358 13516 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:17.435176 18831 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:17.439484 18831 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:17.448627 18820 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.467921 12875 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:17.468849 13512 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.474411 13516 raft_consensus.cc:1275] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:17.473676 12808 raft_consensus.cc:2955] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.487709 12626 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 8 to 9, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.497786 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 140b233442844af3b88e29b40d4f25ad with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:17.507328 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 140b233442844af3b88e29b40d4f25ad with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:17.517067 18833 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:17.550732 18725 consensus_queue.cc:1048] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:09:17.584200 18893 tablet_replica.cc:333] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:17.599283 18893 raft_consensus.cc:2243] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.601759 18893 raft_consensus.cc:2272] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.593545 12808 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:17.591182 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 55173.2us
I20260709 13:09:17.601876 18749 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.605783 13512 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.608429 18893 ts_tablet_manager.cc:1916] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:17.649824 12626 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:17.652616 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49890.5us
I20260709 13:09:17.665117 18893 ts_tablet_manager.cc:1929] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:09:17.666962 13516 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:17.669281 18893 log.cc:1199] T 140b233442844af3b88e29b40d4f25ad P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/140b233442844af3b88e29b40d4f25ad
I20260709 13:09:17.671029 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 49874df91d324eee9febcb540541383f with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:17.671950 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 140b233442844af3b88e29b40d4f25ad (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:17.672850 12875 raft_consensus.cc:2955] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.676529 18817 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:17.678915 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49874df91d324eee9febcb540541383f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:17.681612 12881 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:17.694624 18725 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.708662 18749 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:17.710811 18896 tablet_replica.cc:333] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:17.724921 18896 raft_consensus.cc:2243] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.729044 13512 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.731992 18896 raft_consensus.cc:2272] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.755651 18896 ts_tablet_manager.cc:1916] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:17.762862 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b16b34b3b4a04edca05d5f0f4a3ce868 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:17.750432 12875 raft_consensus.cc:2955] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:17.789987 12629 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 10 to 11, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.811980 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet b16b34b3b4a04edca05d5f0f4a3ce868 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:17.882643 18896 ts_tablet_manager.cc:1929] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:09:17.883370 18896 log.cc:1199] T 49874df91d324eee9febcb540541383f P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/49874df91d324eee9febcb540541383f
I20260709 13:09:17.885656 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 49874df91d324eee9febcb540541383f (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:17.885861 18896 tablet_replica.cc:333] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:17.887290 18896 raft_consensus.cc:2243] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.888603 18896 raft_consensus.cc:2272] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.898506 18896 ts_tablet_manager.cc:1916] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:17.952595 18896 ts_tablet_manager.cc:1929] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:09:17.960281 18896 log.cc:1199] T b16b34b3b4a04edca05d5f0f4a3ce868 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/b16b34b3b4a04edca05d5f0f4a3ce868
I20260709 13:09:17.966776 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet b16b34b3b4a04edca05d5f0f4a3ce868 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:18.035871 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:18.196524 12732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:18.197420 12732 raft_consensus.cc:606] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:18.213714 12725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:18.214628 12725 raft_consensus.cc:606] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:18.221266 12805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:18.221971 12805 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:18.225736 12875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:18.226629 12875 raft_consensus.cc:606] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:18.229079 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:18.230935 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:18.335330 18749 raft_consensus.cc:993] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:18.336068 18749 raft_consensus.cc:1081] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:18.339596 12732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:18.340896 12732 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.341378 12732 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.368992 12732 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.389035 18840 raft_consensus.cc:993] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:18.389622 12732 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:18.390851 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:18.391448 12875 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.394063 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:18.394824 12805 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:18.395125 12805 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:18.396104 12805 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.397289 12805 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.389643 18840 raft_consensus.cc:1081] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:18.405159 13512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:38668
I20260709 13:09:18.405772 13512 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.406162 13512 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.407053 12875 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:18.408824 18809 raft_consensus.cc:993] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:18.408929 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:18.409576 18809 raft_consensus.cc:1081] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:18.412513 18831 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:18.415503 12805 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:18.424391 13512 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:18.438874 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:18.439854 13512 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:18.440445 12732 raft_consensus.cc:3055] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:18.440716 18831 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:18.441632 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:18.442165 12732 raft_consensus.cc:740] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:18.447729 12805 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.457466 12805 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:09:18.448223 12732 consensus_queue.cc:260] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:18.459426 13487 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:18.460409 12732 raft_consensus.cc:3060] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.460755 18850 raft_consensus.cc:2804] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.461336 18850 raft_consensus.cc:697] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:18.462293 18850 consensus_queue.cc:237] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:18.441910 18831 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.472601 12880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:18.473320 12880 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.473701 12880 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.479615 12732 raft_consensus.cc:2468] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
I20260709 13:09:18.486801 12880 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.499198 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:18.500396 12805 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.500530 12880 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:18.499292 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:18.502110 12732 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:18.502441 12732 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:18.503381 12732 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.509011 12629 catalog_manager.cc:5697] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 13 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.514240 18817 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:18.514902 18817 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.510156 18839 raft_consensus.cc:993] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:18.516084 12732 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.516582 18839 raft_consensus.cc:1081] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:18.518653 12808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:18.519289 12808 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.519649 12808 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.521066 18817 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:18.522461 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:18.523357 12880 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 17: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:09:18.524847 12732 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:18.524905 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:18.525959 12728 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:09:18.526996 12847 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:18.528460 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:18.530064 18839 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.531709 18839 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:18.532850 12805 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:18.530546 18817 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.539047 18817 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:18.539525 18817 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.532711 18839 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.552335 12808 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.561851 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:18.562496 12732 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.567955 12732 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:18.564821 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:18.568846 12808 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:18.568863 12880 raft_consensus.cc:3055] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:18.569429 12880 raft_consensus.cc:740] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:18.570251 12880 consensus_queue.cc:260] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.571509 12880 raft_consensus.cc:3060] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.583572 12880 raft_consensus.cc:2468] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:18.591933 12771 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:18.592875 18725 raft_consensus.cc:2804] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:18.593393 18725 raft_consensus.cc:697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:18.594287 18725 consensus_queue.cc:237] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.626461 12626 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.635339 12628 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.612687 18817 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.664471 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:18.674072 12631 catalog_manager.cc:5697] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.685583 18817 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:18.690943 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:18.691759 12873 raft_consensus.cc:2393] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 17: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
I20260709 13:09:18.698202 12732 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
I20260709 13:09:18.703567 12773 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:18.710358 18749 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:18.710950 18749 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:18.711922 18749 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.819804 12631 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 16 to 17, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 17 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.924124 18839 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.924697 18839 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.927011 18839 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:18.928841 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:18.931746 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:18.932765 12728 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:09:18.934173 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:18.935063 18897 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:18.935499 18897 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.935843 18897 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.952432 12808 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:18.976480 18897 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:18.960747 18850 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:09:19.014829 12808 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:19.017277 18897 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:19.017181 18809 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:19.060071 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:19.067795 12732 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:19.070859 12725 raft_consensus.cc:1275] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:19.076956 12881 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:19.079223 12800 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:19.082999 12725 raft_consensus.cc:1275] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:19.084347 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:19.084985 12728 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.096823 12728 raft_consensus.cc:2468] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:19.098634 12847 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:19.097995 18917 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:19.101140 18912 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:19.101189 18839 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:19.103314 18919 consensus_queue.cc:1048] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:19.103652 18897 raft_consensus.cc:2804] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:19.104364 18897 raft_consensus.cc:697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:19.105239 18897 consensus_queue.cc:237] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:19.123204 12873 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:19.127956 18912 consensus_queue.cc:1048] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:19.163475 12873 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:19.190632 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 60112.4us
I20260709 13:09:19.192097 18902 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:19.210006 12881 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:19.222720 18926 log.cc:927] Time spent T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:09:19.230489 18925 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:19.239377 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:19.249128 12728 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:19.258466 12631 catalog_manager.cc:5697] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 17 to 18, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.256726 18912 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:19.322220 18749 consensus_queue.cc:1059] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:09:19.361904 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 86947.5us
I20260709 13:09:19.367502 18749 consensus_queue.cc:1243] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Peer c45825bb09c34201b13ddcec07c4b3f1 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:09:19.717046 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 309139us
I20260709 13:09:19.845347 18912 raft_consensus.cc:3055] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:19.845774 18912 raft_consensus.cc:740] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:19.846539 18912 consensus_queue.cc:260] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:19.847666 18912 raft_consensus.cc:3060] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.848980 12733 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:09:19.852969 12773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.011s
W20260709 13:09:19.853304 12773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.003s	sys 0.011s
W20260709 13:09:19.881209 12845 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7402969d1144da9a4a218d0c90ba138. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.901410 12772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.009s
W20260709 13:09:19.901885 12772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.013s	sys 0.009s
I20260709 13:09:19.871933 12731 raft_consensus.cc:1240] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:09:19.925128 12805 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:19.975404 18918 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:09:19.991420 18959 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:20.019685 18917 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.028605 12733 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:09:20.033432 12800 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.039109 12873 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:20.069484 12804 raft_consensus.cc:1275] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:09:20.069937 12804 pending_rounds.cc:85] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting all ops after (but not including) 8
I20260709 13:09:20.077481 18897 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:20.070163 12804 pending_rounds.cc:107] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:09:20.082274 12804 raft_consensus.cc:2889] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.079197 12626 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.079259 12800 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:20.079313 12845 consensus_peers.cc:597] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 226beb8cd35a475d90c160b1834a29b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.086560 18897 consensus_queue.cc:1048] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:20.090642 18897 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:20.108292 12728 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:20.113487 18897 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:20.138958 18957 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.142174 12725 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.148020 12804 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.165266 12733 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.178651 12873 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:20.212891 12804 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:20.221122 12725 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:20.241580 18897 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:20.248119 12845 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8631a18d7be543f29c587dad80ba4297. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.251869 18897 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:09:20.333437 18976 ts_tablet_manager.cc:933] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:20.369675 18976 tablet_copy_client.cc:323] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:20.381548 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet f7402969d1144da9a4a218d0c90ba138 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:20.382252 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet f7402969d1144da9a4a218d0c90ba138 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-f7402969d1144da9a4a218d0c90ba138
I20260709 13:09:20.394198 18922 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.395807 12804 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.427157 12628 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.437234 12892 tablet_copy_source_session.cc:215] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:20.451942 12731 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.461053 18976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7402969d1144da9a4a218d0c90ba138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.500653 12629 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.518100 12804 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:20.520807 18980 ts_tablet_manager.cc:933] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:20.523799 18976 tablet_copy_client.cc:806] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:20.536800 18976 tablet_copy_client.cc:670] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:20.542498 18980 tablet_copy_client.cc:323] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:20.547376 12874 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:09:20.549254 12771 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb04297576e2483ca596edd2dd418b52. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.549921 12733 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:20.552541 18940 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:20.555111 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 226beb8cd35a475d90c160b1834a29b4 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:20.555840 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 226beb8cd35a475d90c160b1834a29b4 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-226beb8cd35a475d90c160b1834a29b4
I20260709 13:09:20.555883 18940 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:20.562819 18976 tablet_copy_client.cc:538] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:20.566434 12892 tablet_copy_source_session.cc:215] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:20.578125 18940 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.580411 18980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226beb8cd35a475d90c160b1834a29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.582230 12881 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.604758 12629 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.608095 18976 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:20.621162 12733 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:20.659183 18980 tablet_copy_client.cc:806] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:20.676532 18980 tablet_copy_client.cc:670] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:20.701298 18980 tablet_copy_client.cc:538] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:20.753212 18986 ts_tablet_manager.cc:933] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:20.757603 18980 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:20.828423 18986 tablet_copy_client.cc:323] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:20.832329 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 8631a18d7be543f29c587dad80ba4297 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:20.832930 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 8631a18d7be543f29c587dad80ba4297 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-8631a18d7be543f29c587dad80ba4297
W20260709 13:09:20.864866 13542 debug-util.cc:398] Leaking SignalData structure 0x7b0800099440 after lost signal to thread 11579
W20260709 13:09:20.866192 13542 debug-util.cc:398] Leaking SignalData structure 0x7b08002f68c0 after lost signal to thread 12665
W20260709 13:09:20.867463 13542 debug-util.cc:398] Leaking SignalData structure 0x7b08001ff140 after lost signal to thread 12757
W20260709 13:09:20.868742 13542 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6120 after lost signal to thread 12832
W20260709 13:09:20.869901 13542 debug-util.cc:398] Leaking SignalData structure 0x7b080027dae0 after lost signal to thread 12906
W20260709 13:09:20.873199 13542 debug-util.cc:398] Leaking SignalData structure 0x7b0800335aa0 after lost signal to thread 13545
I20260709 13:09:20.871850 12892 tablet_copy_source_session.cc:215] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:20.883092 18986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8631a18d7be543f29c587dad80ba4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.894124 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:20.916862 18976 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.918201 18976 tablet_bootstrap.cc:492] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:20.958859 18976 ts_tablet_manager.cc:1403] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.351s	user 0.046s	sys 0.013s
I20260709 13:09:20.995115 18976 raft_consensus.cc:359] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:20.996342 18976 raft_consensus.cc:740] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:20.997184 18976 consensus_queue.cc:260] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.000828 18976 ts_tablet_manager.cc:1434] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:09:21.004554 18986 tablet_copy_client.cc:806] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:21.005188 18986 tablet_copy_client.cc:670] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:21.010844 18986 tablet_copy_client.cc:538] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:21.012601 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-f7402969d1144da9a4a218d0c90ba138 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:21.013191 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-f7402969d1144da9a4a218d0c90ba138 on tablet f7402969d1144da9a4a218d0c90ba138 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:21.049451 12800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:21.050231 12800 raft_consensus.cc:606] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:21.055095 12873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:21.055751 12873 raft_consensus.cc:606] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:21.064220 12873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:21.064811 12873 raft_consensus.cc:606] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:21.068881 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:21.070871 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:21.085048 18986 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:21.099030 18980 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.107769 13512 raft_consensus.cc:1217] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:09:21.124358 18980 tablet_bootstrap.cc:492] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:21.136395 18980 ts_tablet_manager.cc:1403] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.379s	user 0.048s	sys 0.019s
I20260709 13:09:21.150094 18980 raft_consensus.cc:359] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.151032 18980 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:21.154587 18976 ts_tablet_manager.cc:933] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:21.151721 18980 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.194677 18839 raft_consensus.cc:993] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:21.196201 18839 raft_consensus.cc:1081] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:21.198590 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:21.199239 12733 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.199617 12733 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.210608 12733 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.215477 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:21.216246 12808 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.217986 12733 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:21.219220 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:21.219841 12881 raft_consensus.cc:3055] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:21.220127 12881 raft_consensus.cc:740] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:21.224090 12881 consensus_queue.cc:260] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.225179 12881 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.232229 18976 tablet_copy_client.cc:323] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:21.234753 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet fb04297576e2483ca596edd2dd418b52 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:21.235430 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet fb04297576e2483ca596edd2dd418b52 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-fb04297576e2483ca596edd2dd418b52
I20260709 13:09:21.245429 18980 ts_tablet_manager.cc:1434] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.002s
I20260709 13:09:21.246683 12881 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:21.248099 12808 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 12.
I20260709 13:09:21.248777 12696 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:21.251821 12818 tablet_copy_source_session.cc:215] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:21.256251 18976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04297576e2483ca596edd2dd418b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.256943 18831 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:21.257491 18831 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:21.258356 18831 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.270874 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-226beb8cd35a475d90c160b1834a29b4 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:21.271611 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-226beb8cd35a475d90c160b1834a29b4 on tablet 226beb8cd35a475d90c160b1834a29b4 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:21.358330 12628 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 11 to 12, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 12 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.366460 18940 raft_consensus.cc:993] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:21.367190 18940 raft_consensus.cc:1081] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:21.369452 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:21.371881 12733 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.372399 12733 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.375902 18976 tablet_copy_client.cc:806] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:21.377310 18976 tablet_copy_client.cc:670] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:21.397712 12733 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.402575 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:21.403319 12804 raft_consensus.cc:3055] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:21.403620 12804 raft_consensus.cc:740] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:21.404491 12804 consensus_queue.cc:260] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.405787 12804 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.406327 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:21.407007 12873 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.413717 18976 tablet_copy_client.cc:538] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:21.419317 12873 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:21.421380 12696 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:21.422385 18902 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:21.425509 18902 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:21.426599 18902 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.442514 12804 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:21.399935 12733 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:21.477473 18976 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:21.483103 18986 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.488246 18986 tablet_bootstrap.cc:492] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:21.489111 18986 ts_tablet_manager.cc:1403] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.404s	user 0.041s	sys 0.014s
I20260709 13:09:21.537464 18986 raft_consensus.cc:359] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.538475 18986 raft_consensus.cc:740] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:21.541728 18957 raft_consensus.cc:993] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:21.542588 18960 raft_consensus.cc:1081] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:21.559139 12804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:21.560120 12804 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.560612 12804 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.576066 18986 consensus_queue.cc:260] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.586014 18986 ts_tablet_manager.cc:1434] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.096s	user 0.002s	sys 0.004s
I20260709 13:09:21.580540 12804 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.587915 12804 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:21.590035 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:21.590646 12733 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.596100 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:21.596926 12873 raft_consensus.cc:3055] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:21.597244 12873 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:21.598042 12873 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.599220 12873 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.600154 12733 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:09:21.601706 12773 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:21.602617 18940 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:21.603132 18940 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:21.609689 18940 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:21.614935 12873 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:09:21.626332 13512 raft_consensus.cc:1217] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:09:21.640226 18922 raft_consensus.cc:1064] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:21.646648 18922 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:21.658051 12629 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.677057 13512 raft_consensus.cc:1217] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:09:21.678486 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-8631a18d7be543f29c587dad80ba4297 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:21.679244 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-8631a18d7be543f29c587dad80ba4297 on tablet 8631a18d7be543f29c587dad80ba4297 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:21.711735 12629 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 14, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:21.756379 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 84050.5us
I20260709 13:09:21.768797 12873 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:21.783293 12804 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:21.783494 13514 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:21.784184 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88129.4us
I20260709 13:09:21.785795 18897 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:21.786734 18960 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:21.802616 12733 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:21.811270 12804 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:21.812649 18957 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:09:21.824002 18998 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:21.836093 18976 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.837245 18976 tablet_bootstrap.cc:492] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:21.843106 18976 ts_tablet_manager.cc:1403] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.382s	user 0.043s	sys 0.019s
I20260709 13:09:21.853546 18998 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:21.862159 18976 raft_consensus.cc:359] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.863916 18976 raft_consensus.cc:740] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:21.864872 18976 consensus_queue.cc:260] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:21.879978 18976 ts_tablet_manager.cc:1434] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.006s
I20260709 13:09:21.938719 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-fb04297576e2483ca596edd2dd418b52 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:21.990578 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-fb04297576e2483ca596edd2dd418b52 on tablet fb04297576e2483ca596edd2dd418b52 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:22.017050 12881 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:09:22.072769 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:22.075978 12808 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:09:22.089823 12733 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:22.092819 19002 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:22.040601 18960 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:22.053840 18923 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:22.108615 18923 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:22.134624 12800 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:22.144969 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43872.9us
I20260709 13:09:22.185114 12875 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:22.273927 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 106934us
I20260709 13:09:22.289616 18940 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:22.296732 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 136709us
W20260709 13:09:22.331269 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 136442us
W20260709 13:09:22.380414 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 185463us
W20260709 13:09:22.417166 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 58357.5us
W20260709 13:09:22.516888 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 97528us
I20260709 13:09:22.518110 13514 raft_consensus.cc:1217] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:09:22.524410 12629 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:22.573033 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 154961us
I20260709 13:09:22.636407 13518 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:22.642611 19027 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:09:22.705391 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 286014us
W20260709 13:09:22.712584 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 194709us
W20260709 13:09:22.718407 19051 log.cc:927] Time spent T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:09:22.742264 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 167896us
W20260709 13:09:22.827153 19003 log.cc:927] Time spent T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:09:22.900211 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 169852us
W20260709 13:09:22.919061 19010 log.cc:927] Time spent T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.398s	user 0.000s	sys 0.006s
W20260709 13:09:22.924132 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 95256.3us
I20260709 13:09:22.929574 12725 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:22.952333 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 51166.2us
I20260709 13:09:22.957700 19030 raft_consensus.cc:1064] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:22.968302 19058 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:22.971380 19030 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:22.976219 12875 consensus_queue.cc:237] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:22.986677 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44840.9us
I20260709 13:09:22.951828 19029 raft_consensus.cc:1064] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:22.994236 19029 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:23.005815 12848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.045974 12733 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:23.049064 13512 raft_consensus.cc:1275] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:23.090592 19030 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:23.116673 13514 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:23.120513 19052 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:23.128607 12808 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:23.130040 12733 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:23.196939 19052 consensus_queue.cc:1048] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:23.198364 18897 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:23.207485 13512 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:23.211751 19040 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:23.219311 12808 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:09:23.256542 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 69805.1us
I20260709 13:09:23.273736 12733 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:23.310922 13514 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.259327 18897 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:23.255338 19030 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.268806 19001 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:09:23.380390 19069 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:23.395911 19040 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:09:23.418092 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:23.420274 19064 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.451951 12631 catalog_manager.cc:5697] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.465040 13518 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:23.549685 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 79233us
W20260709 13:09:23.550444 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 60181.7us
I20260709 13:09:23.562253 12808 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.601555 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7402969d1144da9a4a218d0c90ba138 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:23.630134 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "844a3ff085274442b304f06473e07511"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:23.630908 12733 raft_consensus.cc:606] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:23.667440 12725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:23.668346 12725 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:23.762786 19028 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:23.807686 13518 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:23.972343 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 368157us
W20260709 13:09:23.974954 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 350478us
I20260709 13:09:23.999791 12808 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.003754 12725 raft_consensus.cc:2955] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.029649 19084 raft_consensus.cc:1064] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:24.032508 19084 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.060098 12631 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.062083 12631 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.069909 12808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:24.070698 12808 raft_consensus.cc:606] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:24.079385 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:24.081208 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.110586 19016 raft_consensus.cc:993] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:24.111169 19016 raft_consensus.cc:1081] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:24.115749 12725 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.106540 12728 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.131835 19007 raft_consensus.cc:993] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:24.132489 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:24.133139 12730 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.133586 12730 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.131908 19032 raft_consensus.cc:993] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:24.145813 19007 raft_consensus.cc:1081] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:24.147292 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet f7402969d1144da9a4a218d0c90ba138 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41706
W20260709 13:09:24.158648 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51205.8us
I20260709 13:09:24.162313 12730 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.155788 19032 raft_consensus.cc:1081] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:24.176846 13518 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:24.178992 12730 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:24.182423 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:24.183115 12800 raft_consensus.cc:3055] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:24.183411 12800 raft_consensus.cc:740] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:24.184206 13518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:24.184834 13518 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.186967 12800 consensus_queue.cc:260] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.190538 12880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:24.191195 12880 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.191545 12880 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.203055 12800 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.206863 19092 tablet_replica.cc:333] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:24.211831 12800 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:24.212636 13518 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 17.
I20260709 13:09:24.226136 12879 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:24.213725 12699 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:24.231122 12878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "844a3ff085274442b304f06473e07511"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:24.242739 12880 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.201659 19087 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:24.246366 12878 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.219008 19092 raft_consensus.cc:2243] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.246830 12878 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.248543 19084 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:24.248916 19092 raft_consensus.cc:2272] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.249936 12880 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:24.250119 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:24.250982 12800 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.261360 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:24.261997 12728 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:24.262249 12728 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:24.262913 12728 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.264472 12728 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.274449 19092 ts_tablet_manager.cc:1916] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.279050 12878 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.259534 19005 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:24.286419 19005 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:24.287436 19005 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.290177 12878 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:24.295430 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:24.296113 12804 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.310230 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844a3ff085274442b304f06473e07511" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:24.310923 12725 raft_consensus.cc:3055] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:24.311239 12725 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:24.311998 12725 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.313318 12725 raft_consensus.cc:3060] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.317498 12732 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:24.318269 12800 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:24.319012 19050 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:24.325954 12725 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:24.327198 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:24.327924 19040 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:24.328508 19040 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:24.329381 19040 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.325891 12728 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:24.319759 12804 raft_consensus.cc:2468] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
I20260709 13:09:24.332945 12847 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:24.334100 19085 raft_consensus.cc:2804] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:24.334589 19085 raft_consensus.cc:697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:24.335438 19085 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:24.358619 12875 consensus_queue.cc:237] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.361500 12880 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:24.427805 12728 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:24.481473 12802 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:24.485440 18922 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:24.455670 19028 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:24.501699 19012 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.516603 12802 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.545272 13512 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:24.499893 19092 ts_tablet_manager.cc:1929] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:09:24.561177 13514 raft_consensus.cc:1275] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:24.567217 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 137649us
I20260709 13:09:24.559448 19092 log.cc:1199] T f7402969d1144da9a4a218d0c90ba138 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/f7402969d1144da9a4a218d0c90ba138
I20260709 13:09:24.604101 19040 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:24.605104 19030 consensus_queue.cc:1048] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:24.611127 13518 raft_consensus.cc:2955] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.643424 19045 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.647548 13514 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.670939 13512 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.667431 19030 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.758211 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet f7402969d1144da9a4a218d0c90ba138 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:24.771682 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 226beb8cd35a475d90c160b1834a29b4 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.782511 12725 raft_consensus.cc:2955] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:24.797749 12629 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 17 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.834334 12626 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 9 to 10, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 12 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:24.868521 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 183566us
I20260709 13:09:24.878446 12808 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:09:24.830036 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 51017.2us
I20260709 13:09:24.890558 12800 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:24.907143 12631 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.910195 12631 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.933528 12728 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:24.943619 13514 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:24.991242 12728 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.018603 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8631a18d7be543f29c587dad80ba4297 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:25.031567 12808 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:25.033850 12878 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.038836 19105 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:25.063341 19045 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:25.064476 19045 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:25.073853 19045 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:25.079716 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:25.082046 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:25.114270 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.115232 19025 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:09:25.081480 19085 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:09:25.125532 19028 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:25.125604 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" is_pre_election: true
I20260709 13:09:25.154358 19085 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:25.164708 12771 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:25.173789 19045 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:25.195509 12725 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:09:25.245985 19012 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:25.283589 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 55157.4us
I20260709 13:09:25.301752 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 226beb8cd35a475d90c160b1834a29b4 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:25.301106 12628 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:25.389312 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 142619us
I20260709 13:09:25.411672 19127 tablet_replica.cc:333] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:25.470793 19127 raft_consensus.cc:2243] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.474751 19127 raft_consensus.cc:2272] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.504400 12629 catalog_manager.cc:5697] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 9 to 10, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.513563 19127 ts_tablet_manager.cc:1916] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:25.544304 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 8631a18d7be543f29c587dad80ba4297 with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:25.573206 12802 consensus_queue.cc:237] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:25.605837 13512 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:25.620680 19130 tablet_replica.cc:333] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:25.671312 19045 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:25.722698 19130 raft_consensus.cc:2243] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.724368 19130 raft_consensus.cc:2272] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.758247 12728 raft_consensus.cc:1275] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:25.764642 19130 ts_tablet_manager.cc:1916] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:25.770334 19083 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.793689 13512 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.801188 19127 ts_tablet_manager.cc:1929] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:09:25.846244 19127 log.cc:1199] T 226beb8cd35a475d90c160b1834a29b4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/226beb8cd35a475d90c160b1834a29b4
I20260709 13:09:25.849054 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 226beb8cd35a475d90c160b1834a29b4 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:25.895597 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb04297576e2483ca596edd2dd418b52 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:25.902508 12631 catalog_manager.cc:5697] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 10 to 11, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:25.918907 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet fb04297576e2483ca596edd2dd418b52 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:25.919956 19130 ts_tablet_manager.cc:1929] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:09:25.927541 19130 log.cc:1199] T 8631a18d7be543f29c587dad80ba4297 P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/8631a18d7be543f29c587dad80ba4297
I20260709 13:09:25.930011 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 8631a18d7be543f29c587dad80ba4297 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:25.946916 19133 tablet_replica.cc:333] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:25.948467 19133 raft_consensus.cc:2243] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.953836 19063 consensus_queue.cc:1048] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:25.977244 19133 raft_consensus.cc:2272] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.998422 19133 ts_tablet_manager.cc:1916] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:26.006677 12728 raft_consensus.cc:2955] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:26.051290 19133 ts_tablet_manager.cc:1929] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:09:26.064512 19133 log.cc:1199] T fb04297576e2483ca596edd2dd418b52 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/fb04297576e2483ca596edd2dd418b52
I20260709 13:09:26.067216 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet fb04297576e2483ca596edd2dd418b52 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:26.685881 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.810364 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:26.811365 12802 raft_consensus.cc:606] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:26.815878 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a839b697aea46da87cb69b00515389e"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:26.816603 12879 raft_consensus.cc:606] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:26.820677 12732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:26.821272 12732 raft_consensus.cc:606] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:26.827661 12879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:26.828325 12879 raft_consensus.cc:606] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:26.829931 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:26.832195 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:26.857865 19030 raft_consensus.cc:993] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:26.858497 19030 raft_consensus.cc:1081] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:26.861616 12730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:26.862365 12730 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.862730 12730 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.875882 12730 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:26.877279 19131 raft_consensus.cc:993] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:26.896832 19025 raft_consensus.cc:1081] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:26.907866 12730 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:26.909760 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:26.910517 12878 raft_consensus.cc:3055] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:26.910843 12878 raft_consensus.cc:740] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:26.911780 12878 consensus_queue.cc:260] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:26.913420 12878 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.917416 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:09:26.918064 12802 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.918470 12802 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.931962 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:26.932719 12805 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.946260 12802 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:26.947340 12805 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 19.
I20260709 13:09:26.956420 12878 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 19.
I20260709 13:09:26.968341 12802 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:26.968868 12696 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:26.970325 19135 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:26.970383 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:26.971043 19135 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:26.971300 12732 raft_consensus.cc:3055] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:26.971753 12732 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:26.972652 12732 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:26.973920 12732 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.973793 19135 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:26.969152 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:26.978228 12878 raft_consensus.cc:3060] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.994108 12878 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:27.005092 12771 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:27.006103 19083 raft_consensus.cc:2804] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:27.006793 19083 raft_consensus.cc:697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:27.007928 19083 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:27.018970 12631 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 18 to 19, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 19 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.037403 12629 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.042989 12732 raft_consensus.cc:2468] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:27.246419 19084 raft_consensus.cc:993] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:27.246973 19084 raft_consensus.cc:1081] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:27.249115 13512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:38680
I20260709 13:09:27.249676 13512 raft_consensus.cc:493] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.250006 13512 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.258258 13512 raft_consensus.cc:515] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.265806 13512 leader_election.cc:290] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:27.266686 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:27.269057 12802 raft_consensus.cc:3055] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:27.269418 12802 raft_consensus.cc:740] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:27.268823 12732 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:27.270174 12802 consensus_queue.cc:260] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.271200 18922 raft_consensus.cc:993] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:27.271314 12802 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.271685 18922 raft_consensus.cc:1081] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:27.267393 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098bf8b9f16c41adb5871161f995c638" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:27.272385 12878 raft_consensus.cc:3060] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.273774 13513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a839b697aea46da87cb69b00515389e"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:59886
I20260709 13:09:27.274290 13513 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.274597 13513 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.283594 13513 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.295689 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:27.296197 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:27.296679 12728 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.296955 12879 raft_consensus.cc:3055] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.303110 12879 raft_consensus.cc:740] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:27.303974 12879 consensus_queue.cc:260] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.306888 12879 raft_consensus.cc:3060] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.296782 13513 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:27.317842 12878 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 19.
I20260709 13:09:27.319694 13484 leader_election.cc:304] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:27.321077 19106 raft_consensus.cc:2804] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:27.331261 12728 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:27.346496 13486 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:27.347625 19134 raft_consensus.cc:2804] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:27.359499 19134 raft_consensus.cc:697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:27.361027 19134 consensus_queue.cc:237] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.334236 12802 raft_consensus.cc:2468] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 19.
I20260709 13:09:27.335956 19106 raft_consensus.cc:697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:27.373900 19106 consensus_queue.cc:237] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:27.375566 12878 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:27.377537 12878 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:27.378885 19131 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:27.382694 19131 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:27.388342 12801 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:27.396173 12879 raft_consensus.cc:2468] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:27.394093 19023 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:09:27.419798 12696 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96245329d8054ce88bb8c218f5069ede. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:27.480726 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 54686.6us
I20260709 13:09:27.488708 12629 catalog_manager.cc:5697] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 18 to 19, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 19 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:27.504823 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 58935.6us
I20260709 13:09:27.512741 19131 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:27.521725 12878 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:27.540475 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 73579.3us
I20260709 13:09:27.543144 12802 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:27.547518 12629 catalog_manager.cc:5697] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 14 to 15, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 15 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.602911 12875 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:27.604846 19154 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:27.625247 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56848.2us
I20260709 13:09:27.647423 12631 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:27.668123 19156 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:27.671815 12802 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:27.713061 19163 log.cc:927] Time spent T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:27.735826 12732 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:27.746093 19084 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:27.767073 12802 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:27.877784 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:27.876281 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 95204.7us
I20260709 13:09:27.983593 19144 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.201s
W20260709 13:09:28.001199 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 69797.6us
W20260709 13:09:28.048946 19153 log.cc:927] Time spent T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:09:28.049700 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 94001.3us
I20260709 13:09:28.053403 12878 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:09:28.054433 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 128764us
W20260709 13:09:28.059613 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 79138.8us
I20260709 13:09:28.104527 19175 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:09:28.196630 12879 raft_consensus.cc:1275] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:28.222708 19187 consensus_queue.cc:1048] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:09:28.249774 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 189179us
I20260709 13:09:28.252419 12732 raft_consensus.cc:1275] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:09:28.257925 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 47830.9us
I20260709 13:09:28.266037 12804 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:28.292773 19106 consensus_queue.cc:1048] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:28.352615 19199 ts_tablet_manager.cc:933] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:09:28.488309 12771 consensus_peers.cc:597] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b86cb4a548944109bfb911e2b3a2591. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.501255 12879 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:28.507972 19199 tablet_copy_client.cc:323] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:28.509234 12733 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:28.510367 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 96245329d8054ce88bb8c218f5069ede from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:28.511026 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 96245329d8054ce88bb8c218f5069ede from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-96245329d8054ce88bb8c218f5069ede
I20260709 13:09:28.511819 19152 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:28.534484 12742 tablet_copy_source_session.cc:215] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:28.535761 19152 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:28.539149 19199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96245329d8054ce88bb8c218f5069ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.584643 19152 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.586735 12879 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.709686 19199 tablet_copy_client.cc:806] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:28.769955 19199 tablet_copy_client.cc:670] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:28.746013 12631 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:28.763408 19208 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.009s
W20260709 13:09:28.744261 19209 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.065s	user 0.001s	sys 0.002s
I20260709 13:09:28.775738 19199 tablet_copy_client.cc:538] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:09:28.781431 19203 log.cc:927] Time spent T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.091s	user 0.001s	sys 0.008s
I20260709 13:09:28.804700 12808 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:28.835258 12873 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:28.854626 12771 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c36078b972bc46fe827c12e1015e239d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.855949 19199 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:28.856156 19063 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:28.846397 12733 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.886896 19063 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.889976 12873 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.902657 12733 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:28.920578 19151 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:28.934828 12733 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:28.974256 19212 ts_tablet_manager.cc:933] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:28.982463 12733 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:28.988283 19212 tablet_copy_client.cc:323] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:29.003616 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 2b86cb4a548944109bfb911e2b3a2591 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:29.004252 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 2b86cb4a548944109bfb911e2b3a2591 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-2b86cb4a548944109bfb911e2b3a2591
I20260709 13:09:29.007459 12631 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.023485 12818 tablet_copy_source_session.cc:215] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.025308 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.030314 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b86cb4a548944109bfb911e2b3a2591. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:29.061215 12696 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0229d1c0cac14ba68f265bbecd5bf81b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.061200 12804 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:29.064399 12873 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:29.080116 19191 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:29.090168 19158 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:29.133082 12804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:29.133904 12804 raft_consensus.cc:606] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:29.139739 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:29.140498 12733 raft_consensus.cc:606] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:29.144212 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:29.146399 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:29.157222 19212 tablet_copy_client.cc:806] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.158095 19212 tablet_copy_client.cc:670] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.170796 19199 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.174376 19212 tablet_copy_client.cc:538] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.179416 19199 tablet_bootstrap.cc:492] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:29.191192 19199 ts_tablet_manager.cc:1403] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.335s	user 0.044s	sys 0.008s
I20260709 13:09:29.193269 19160 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:29.198323 12802 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:29.231606 19199 raft_consensus.cc:359] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:29.236409 19199 raft_consensus.cc:740] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:29.237145 19199 consensus_queue.cc:260] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:29.239212 12629 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 12, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:29.256959 19199 ts_tablet_manager.cc:1434] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 13:09:29.259109 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-96245329d8054ce88bb8c218f5069ede received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:29.259374 19212 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:29.259743 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-96245329d8054ce88bb8c218f5069ede on tablet 96245329d8054ce88bb8c218f5069ede with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:29.303203 12879 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:29.406141 19199 ts_tablet_manager.cc:933] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:29.422072 19199 tablet_copy_client.cc:323] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:29.427277 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet c36078b972bc46fe827c12e1015e239d from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:29.427886 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet c36078b972bc46fe827c12e1015e239d from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-c36078b972bc46fe827c12e1015e239d
I20260709 13:09:29.437219 12818 tablet_copy_source_session.cc:215] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.458213 19199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36078b972bc46fe827c12e1015e239d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.461073 19192 raft_consensus.cc:993] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:29.461684 19192 raft_consensus.cc:1081] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:29.464339 12873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:29.464919 12873 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.465255 12873 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.492650 12873 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:09:29.496711 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:29.497444 12724 raft_consensus.cc:3055] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:29.497716 12724 raft_consensus.cc:740] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:29.498529 12724 consensus_queue.cc:260] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:09:29.499684 12724 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.511497 19063 raft_consensus.cc:993] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:29.512476 19063 raft_consensus.cc:1081] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:29.516263 12724 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:09:29.517843 12847 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:29.519164 12873 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:29.521306 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:29.521998 12804 raft_consensus.cc:3060] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.524701 12879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:09:29.525296 12879 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.525686 12879 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.534510 12879 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:29.534031 19173 raft_consensus.cc:2804] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:29.535869 19173 raft_consensus.cc:697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:29.536823 19173 consensus_queue.cc:237] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:09:29.543169 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:29.543859 12802 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:29.544366 12802 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:29.545353 12802 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:29.550235 12804 raft_consensus.cc:2468] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:09:29.550777 12802 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.552649 19224 ts_tablet_manager.cc:933] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:09:29.554888 12879 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:29.559913 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:29.560580 13513 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.572856 13513 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:09:29.577986 12845 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:29.584314 19028 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:29.585139 19028 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:29.587646 12802 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:09:29.602845 19028 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:29.636688 19224 tablet_copy_client.cc:323] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:29.656224 19199 tablet_copy_client.cc:806] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.677093 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 0229d1c0cac14ba68f265bbecd5bf81b from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:29.677733 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 0229d1c0cac14ba68f265bbecd5bf81b from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-0229d1c0cac14ba68f265bbecd5bf81b
W20260709 13:09:29.718152 19227 log.cc:927] Time spent T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:09:29.720342 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68128.7us
I20260709 13:09:29.717052 13514 raft_consensus.cc:1217] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:09:29.729307 12742 tablet_copy_source_session.cc:215] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.667676 19199 tablet_copy_client.cc:670] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.736544 19199 tablet_copy_client.cc:538] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.729478 12626 catalog_manager.cc:5697] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 14 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.741631 19212 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.784526 12626 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 14 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.799510 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0229d1c0cac14ba68f265bbecd5bf81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.800297 19212 tablet_bootstrap.cc:492] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:29.801168 19212 ts_tablet_manager.cc:1403] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.542s	user 0.037s	sys 0.036s
I20260709 13:09:29.808916 19199 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:29.812721 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 50080.6us
I20260709 13:09:29.820501 19212 raft_consensus.cc:359] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:29.821965 19212 raft_consensus.cc:740] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:29.822849 19212 consensus_queue.cc:260] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:29.865370 19212 ts_tablet_manager.cc:1434] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 13:09:29.912704 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-2b86cb4a548944109bfb911e2b3a2591 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:29.913229 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-2b86cb4a548944109bfb911e2b3a2591 on tablet 2b86cb4a548944109bfb911e2b3a2591 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:29.935096 19224 tablet_copy_client.cc:806] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.935933 19224 tablet_copy_client.cc:670] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.951511 19224 tablet_copy_client.cc:538] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.973140 19224 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:30.009603 12802 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:30.014850 19230 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:30.101853 19199 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:30.109130 19199 tablet_bootstrap.cc:492] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:30.112747 12725 raft_consensus.cc:1275] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:30.120915 19199 ts_tablet_manager.cc:1403] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.303s	user 0.048s	sys 0.014s
I20260709 13:09:30.128062 19228 consensus_queue.cc:1048] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:30.147737 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.148070 19199 raft_consensus.cc:359] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:30.190383 13512 raft_consensus.cc:1217] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:09:30.195144 19199 raft_consensus.cc:740] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:30.207471 19199 consensus_queue.cc:260] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:30.266611 19199 ts_tablet_manager.cc:1434] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.004s
W20260709 13:09:30.279922 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 44355.7us
I20260709 13:09:30.274509 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-c36078b972bc46fe827c12e1015e239d received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:30.308741 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-c36078b972bc46fe827c12e1015e239d on tablet c36078b972bc46fe827c12e1015e239d with peer a865487bf1854df8a5619d42465bb36c
W20260709 13:09:30.452147 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 74486.9us
W20260709 13:09:30.526814 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 292470us
I20260709 13:09:30.527264 13514 raft_consensus.cc:1217] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:09:30.489837 19239 raft_consensus.cc:1064] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:30.530813 19239 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:30.550172 19224 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:30.551250 19224 tablet_bootstrap.cc:492] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:30.553776 12802 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:30.574791 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 56352us
I20260709 13:09:30.566453 13512 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:30.552016 19224 ts_tablet_manager.cc:1403] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.579s	user 0.041s	sys 0.011s
I20260709 13:09:30.600376 19248 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:30.579452 19224 raft_consensus.cc:359] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:30.609578 19224 raft_consensus.cc:740] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:30.624576 19224 consensus_queue.cc:260] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:30.632215 19224 ts_tablet_manager.cc:1434] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.003s
I20260709 13:09:30.651463 13513 raft_consensus.cc:1217] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:09:30.656239 19245 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:30.663072 19247 raft_consensus.cc:1064] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:30.668583 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-0229d1c0cac14ba68f265bbecd5bf81b received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:30.669103 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-0229d1c0cac14ba68f265bbecd5bf81b on tablet 0229d1c0cac14ba68f265bbecd5bf81b with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:30.698122 19247 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:30.756943 13512 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:30.761844 19160 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:30.776696 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 87256.4us
I20260709 13:09:30.784476 12802 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:30.797091 19160 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:30.813302 12880 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:30.879426 13513 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:30.880098 12874 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:30.883489 19179 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:30.889081 19151 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:30.909497 19243 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:30.917013 12724 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:30.921662 19247 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:31.141292 19179 raft_consensus.cc:1064] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
W20260709 13:09:31.183182 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 66003.6us
I20260709 13:09:31.186550 13513 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.144011 19179 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.196820 12808 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.145700 19151 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.260339 12879 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:31.271306 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 82696.6us
I20260709 13:09:31.224767 19238 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.284446 13513 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:31.293059 12725 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:31.296353 19063 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:31.300621 12881 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:31.307119 19063 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:31.318548 12629 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.324930 12725 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.324980 19179 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:31.342403 12881 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.412072 13512 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.495522 19268 raft_consensus.cc:1064] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:31.515473 19231 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.516310 13513 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.511777 19268 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.533695 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.582162 12881 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.601286 12725 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.632746 12874 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:31.636255 12802 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:31.638365 13514 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:31.642287 19158 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:31.645176 19158 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:31.648188 19239 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:31.728088 12802 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.740542 19158 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.745398 13512 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:31.744771 13513 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.746665 12874 raft_consensus.cc:1275] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:31.747311 19152 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:31.748400 19271 consensus_queue.cc:1048] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:31.764436 19231 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.770092 12874 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.772066 13512 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.776630 12628 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.778245 12628 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.812659 12808 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.836267 12733 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.842417 13513 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:31.842530 12881 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:31.845140 19239 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:31.846088 19243 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:31.848325 12804 consensus_queue.cc:237] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.856003 12874 raft_consensus.cc:2955] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.867129 19269 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.869897 13513 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.873625 12733 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:31.876225 19271 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:31.876936 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b86cb4a548944109bfb911e2b3a2591 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:31.878134 13514 raft_consensus.cc:1275] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:31.881016 19231 consensus_queue.cc:1048] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:31.852715 12625 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 12 to 13, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.881107 12881 raft_consensus.cc:2955] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.897887 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96245329d8054ce88bb8c218f5069ede with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:31.901883 19271 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.955540 12628 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.919274 13514 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:31.984598 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c36078b972bc46fe827c12e1015e239d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:31.989971 12724 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:31.994813 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b86cb4a548944109bfb911e2b3a2591 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41076
I20260709 13:09:31.915273 12733 raft_consensus.cc:2955] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:32.056660 12628 catalog_manager.cc:5697] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 11 to 12, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.067463 19282 tablet_replica.cc:333] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:32.068774 19282 raft_consensus.cc:2243] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:32.069687 19282 raft_consensus.cc:2272] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:32.089497 19282 ts_tablet_manager.cc:1916] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:32.039813 12625 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 11 to 12, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.116550 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet c36078b972bc46fe827c12e1015e239d with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:32.118721 19282 ts_tablet_manager.cc:1929] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:09:32.119316 19282 log.cc:1199] T 2b86cb4a548944109bfb911e2b3a2591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/2b86cb4a548944109bfb911e2b3a2591
W20260709 13:09:32.120534 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 74867.2us
I20260709 13:09:32.125708 12881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:32.126590 12881 raft_consensus.cc:606] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:32.134305 13513 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:32.140615 12881 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:32.142823 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 2b86cb4a548944109bfb911e2b3a2591 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:32.148168 19242 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:32.157114 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 96245329d8054ce88bb8c218f5069ede with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:32.171604 19284 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:32.183966 19285 tablet_replica.cc:333] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:32.185118 19286 tablet_replica.cc:333] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:32.186331 19286 raft_consensus.cc:2243] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:32.187412 19286 raft_consensus.cc:2272] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:32.187811 12881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:32.188527 12881 raft_consensus.cc:606] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:32.190805 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:32.192523 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:32.200249 19285 raft_consensus.cc:2243] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:32.203176 19285 raft_consensus.cc:2272] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:32.207149 19242 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:32.210167 13514 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:32.241659 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0229d1c0cac14ba68f265bbecd5bf81b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:32.241416 19286 ts_tablet_manager.cc:1916] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:32.243695 19285 ts_tablet_manager.cc:1916] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:32.265477 12881 raft_consensus.cc:2955] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:32.271353 12630 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 13 to 14, VOTER 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) evicted. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.288944 12798 tablet_service.cc:1558] Processing DeleteTablet for tablet 0229d1c0cac14ba68f265bbecd5bf81b with delete_type TABLET_DATA_TOMBSTONED (TS 83d2731c4bc049b3929d6c39670f5fd8 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:41706
I20260709 13:09:32.332677 19286 ts_tablet_manager.cc:1929] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:09:32.333281 19286 log.cc:1199] T 96245329d8054ce88bb8c218f5069ede P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/96245329d8054ce88bb8c218f5069ede
I20260709 13:09:32.335124 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 96245329d8054ce88bb8c218f5069ede (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:32.335415 19286 tablet_replica.cc:333] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:09:32.336798 19286 raft_consensus.cc:2243] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:32.341635 19286 raft_consensus.cc:2272] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:32.357036 19286 ts_tablet_manager.cc:1916] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:32.468981 19286 ts_tablet_manager.cc:1929] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:09:32.469583 19286 log.cc:1199] T 0229d1c0cac14ba68f265bbecd5bf81b P 83d2731c4bc049b3929d6c39670f5fd8: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/wals/0229d1c0cac14ba68f265bbecd5bf81b
I20260709 13:09:32.472883 12618 catalog_manager.cc:5028] TS 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): tablet 0229d1c0cac14ba68f265bbecd5bf81b (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:32.475694 19285 ts_tablet_manager.cc:1929] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:09:32.498512 19285 log.cc:1199] T c36078b972bc46fe827c12e1015e239d P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/c36078b972bc46fe827c12e1015e239d
I20260709 13:09:32.503038 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet c36078b972bc46fe827c12e1015e239d (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:32.519315 19248 raft_consensus.cc:993] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:32.519961 19248 raft_consensus.cc:1081] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:32.522118 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:09:32.522687 12724 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.523026 12724 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:32.534497 12724 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:32.540383 19229 raft_consensus.cc:993] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:32.541406 19229 raft_consensus.cc:1081] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:32.542148 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:32.542834 12802 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:32.543375 12804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:32.543897 12804 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.544253 12804 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.550073 12802 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 20.
I20260709 13:09:32.550900 12804 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:32.557919 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:32.558660 12881 raft_consensus.cc:3055] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:32.558802 12804 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:32.559013 12881 raft_consensus.cc:740] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:32.559870 12881 consensus_queue.cc:260] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:32.561082 12881 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:32.561851 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:32.562563 13514 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.557971 12699 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8; no voters: 
I20260709 13:09:32.565064 19284 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:32.565565 19284 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:32.566428 19284 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:32.573207 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:32.573957 12874 raft_consensus.cc:3055] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:32.574223 12881 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 20.
I20260709 13:09:32.574290 12874 raft_consensus.cc:740] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:32.556740 12724 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 20 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:32.577042 12874 consensus_queue.cc:260] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:32.593915 13514 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:32.595496 12771 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:32.596489 19231 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:32.597033 19231 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:32.597082 12874 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.597966 19231 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:32.600088 12630 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 19 to 20, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 20 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.625514 12874 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:32.676848 12630 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.994189 13518 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:32.996820 12804 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:32.997212 19152 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:33.003804 19243 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:33.060117 12881 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:33.062548 19284 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:33.088215 12874 raft_consensus.cc:1275] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:33.089875 19152 consensus_queue.cc:1048] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:33.193464 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.589110 12881 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:33.617524 12733 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:33.621057 12804 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:09:33.623430 12845 consensus_peers.cc:597] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 844a3ff085274442b304f06473e07511. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.625870 19229 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:33.647343 19283 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:33.784555 19283 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.786046 12733 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.821527 12733 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:33.797492 12805 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.850412 12630 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.854592 12802 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:33.856405 19303 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:33.865626 12696 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e81eeec454b94074a55f46a651353f9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.867976 12874 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:33.869503 19303 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:33.894143 19303 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.897493 12881 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.908938 12802 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:33.930438 12808 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:34.015276 12771 consensus_peers.cc:597] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0e30b9fd61a41b294bf248bd704492b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.020933 12733 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:34.023923 19152 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:34.049700 12881 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:34.058071 19304 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:34.093570 19152 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.094521 12725 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:34.109424 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 43935.2us
I20260709 13:09:34.136399 19316 ts_tablet_manager.cc:933] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:34.174147 12725 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:34.166218 12625 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 14, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
W20260709 13:09:34.242868 12696 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 433127d30b7c4bdf91cac2059c29a3f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.230455 19316 tablet_copy_client.cc:323] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
W20260709 13:09:34.263990 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 43537.5us
W20260709 13:09:34.263921 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 44400.7us
I20260709 13:09:34.267884 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.361686 12808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:34.362391 12808 raft_consensus.cc:606] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Received request to transfer leadership to TS 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:34.397469 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:34.398274 12733 raft_consensus.cc:606] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Received request to transfer leadership to TS c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:34.400255 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:34.402206 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:34.433169 12881 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.434798 12628 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 11, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.457547 12881 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:34.482090 12805 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:34.487320 19284 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:34.498898 19326 ts_tablet_manager.cc:933] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:09:34.499568 19327 ts_tablet_manager.cc:933] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:34.516559 19326 tablet_copy_client.cc:323] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:34.520390 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet e81eeec454b94074a55f46a651353f9e from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:34.521155 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet e81eeec454b94074a55f46a651353f9e from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-e81eeec454b94074a55f46a651353f9e
I20260709 13:09:34.539978 19325 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.545249 12742 tablet_copy_source_session.cc:215] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:34.550997 19326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81eeec454b94074a55f46a651353f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.561609 19284 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:34.584823 19327 tablet_copy_client.cc:323] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:34.596750 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet b0e30b9fd61a41b294bf248bd704492b from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:34.597607 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet b0e30b9fd61a41b294bf248bd704492b from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-b0e30b9fd61a41b294bf248bd704492b
I20260709 13:09:34.606233 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 844a3ff085274442b304f06473e07511 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:34.606868 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 844a3ff085274442b304f06473e07511 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-844a3ff085274442b304f06473e07511
I20260709 13:09:34.631914 12628 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.635322 12818 tablet_copy_source_session.cc:215] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:34.638281 19326 tablet_copy_client.cc:806] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:34.638967 19326 tablet_copy_client.cc:670] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:34.589250 12808 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.640739 12892 tablet_copy_source_session.cc:215] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:34.654390 19326 tablet_copy_client.cc:538] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:34.658648 19327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e30b9fd61a41b294bf248bd704492b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:34.697475 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 58662.1us
I20260709 13:09:34.707249 19316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844a3ff085274442b304f06473e07511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.711932 19326 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:34.714919 19325 raft_consensus.cc:993] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:34.720386 19298 raft_consensus.cc:1081] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Signalling peer c45825bb09c34201b13ddcec07c4b3f1 to start an election
I20260709 13:09:34.730051 12879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:09:34.730655 12879 raft_consensus.cc:493] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.730999 12879 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.723073 12874 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:34.750943 12879 raft_consensus.cc:515] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:34.765303 19333 ts_tablet_manager.cc:933] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
I20260709 13:09:34.780164 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:34.780846 12724 raft_consensus.cc:3055] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:34.781247 12724 raft_consensus.cc:740] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:34.782040 12724 consensus_queue.cc:260] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:34.783994 12724 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.794364 12724 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:09:34.797394 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c9d890e514419a9265ab93f02ad09" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:34.798090 12805 raft_consensus.cc:3060] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.799222 12879 leader_election.cc:290] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:34.800105 12847 leader_election.cc:304] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:34.803576 19320 raft_consensus.cc:2804] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:34.805104 19320 raft_consensus.cc:697] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:34.806250 19320 consensus_queue.cc:237] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:34.810668 12805 raft_consensus.cc:2468] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:09:34.836128 19333 tablet_copy_client.cc:323] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
I20260709 13:09:34.837734 19304 raft_consensus.cc:993] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:34.838192 12742 tablet_copy_service.cc:140] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Received BeginTabletCopySession request for tablet 433127d30b7c4bdf91cac2059c29a3f5 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:52082)
I20260709 13:09:34.838960 19179 raft_consensus.cc:1081] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Signalling peer 72d06460bb5d4ccdbd4edbda8b9a1d63 to start an election
I20260709 13:09:34.839123 12742 tablet_copy_service.cc:161] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Beginning new tablet copy session on tablet 433127d30b7c4bdf91cac2059c29a3f5 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:52082: session id = a865487bf1854df8a5619d42465bb36c-433127d30b7c4bdf91cac2059c29a3f5
I20260709 13:09:34.892372 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
 from {username='slave'} at 127.0.0.1:52120
I20260709 13:09:34.913002 12742 tablet_copy_source_session.cc:215] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:09:34.915542 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 85414.2us
I20260709 13:09:34.899461 12724 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.919654 12724 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.918269 19333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433127d30b7c4bdf91cac2059c29a3f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:34.915896 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 84301.2us
W20260709 13:09:35.075729 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 111054us
I20260709 13:09:35.159041 19316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59886 (request call id 1084) took 1082 ms. Trace:
I20260709 13:09:35.202453 19327 tablet_copy_client.cc:806] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:35.204126 19327 tablet_copy_client.cc:670] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:35.205315 12724 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:35.246654 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 134100us
I20260709 13:09:35.159889 19316 rpcz_store.cc:276] 0709 13:09:34.076154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.076957 (+   803us) service_pool.cc:224] Handling call
0709 13:09:34.136871 (+ 59914us) ts_tablet_manager.cc:934] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
0709 13:09:34.705938 (+569067us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:34.750092 (+ 44154us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:34.750210 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:35.156719 (+406509us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:35.157825 (+  1106us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:35.158509 (+   684us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:35.158697 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":20931,"tablet-copy.queue_time_us":58810,"thread_start_us":127562,"threads_started":2}
I20260709 13:09:35.243242 12628 catalog_manager.cc:5697] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 14, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.266511 19316 tablet_copy_client.cc:806] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:35.267413 19316 tablet_copy_client.cc:670] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:35.268188 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 144044us
I20260709 13:09:35.288578 19316 tablet_copy_client.cc:538] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:35.289265 19327 tablet_copy_client.cc:538] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:09:35.341274 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 409874us
W20260709 13:09:35.356436 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 56382.4us
I20260709 13:09:35.403704 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:35.414080 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:35.415372 12875 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.422698 19326 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.424239 19326 tablet_bootstrap.cc:492] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:35.435703 19316 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:35.436419 19326 ts_tablet_manager.cc:1403] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.725s	user 0.051s	sys 0.028s
I20260709 13:09:35.323450 12724 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:35.469065 12808 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:35.475673 19350 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:35.476567 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49239.7us
I20260709 13:09:35.480233 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:35.480949 12808 raft_consensus.cc:3055] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:35.481238 12808 raft_consensus.cc:740] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:35.482255 12808 consensus_queue.cc:260] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:35.483850 12808 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.514230 19333 tablet_copy_client.cc:806] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:35.514984 19333 tablet_copy_client.cc:670] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:35.528436 12732 raft_consensus.cc:1275] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:35.585527 19333 tablet_copy_client.cc:538] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:35.586071 19326 raft_consensus.cc:359] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:35.587476 19326 raft_consensus.cc:740] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:35.549631 12875 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:09:35.592027 12808 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d06460bb5d4ccdbd4edbda8b9a1d63 in term 16.
I20260709 13:09:35.609097 12881 raft_consensus.cc:1240] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Rejecting Update request from peer 83d2731c4bc049b3929d6c39670f5fd8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:35.616369 19350 consensus_queue.cc:1048] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:35.645139 12696 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:35.604676 19326 consensus_queue.cc:260] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:35.687013 13517 raft_consensus.cc:1217] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Deduplicated request from leader. Original: 18.13->[18.14-18.14]   Dedup: 18.14->[]
I20260709 13:09:35.688759 19341 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:35.689502 19341 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Becoming Leader. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:35.690800 19341 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:35.694411 19326 ts_tablet_manager.cc:1434] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.236s	user 0.010s	sys 0.000s
I20260709 13:09:35.711247 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-e81eeec454b94074a55f46a651353f9e received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:35.712001 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-e81eeec454b94074a55f46a651353f9e on tablet e81eeec454b94074a55f46a651353f9e with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:35.712780 19333 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
I20260709 13:09:35.747457 19327 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:35.853994 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 195532us
W20260709 13:09:36.002576 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 67760.5us
W20260709 13:09:36.071391 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 59573.2us
I20260709 13:09:36.201661 19303 raft_consensus.cc:1064] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:36.204810 19303 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:36.210604 12628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45904 (request call id 305) took 1111 ms. Trace:
I20260709 13:09:36.216591 19316 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:36.211108 12628 rpcz_store.cc:276] 0709 13:09:35.099903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.100349 (+   446us) service_pool.cc:224] Handling call
0709 13:09:36.210475 (+1110126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:35.668544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:35.669234 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:35.669305 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:09:35.671189 (+  1884us) tablet.cc:662] Decoding operations
0709 13:09:35.675956 (+  4767us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:35.677632 (+  1676us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:35.677679 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:35.678004 (+   325us) tablet.cc:701] Row locks acquired
0709 13:09:35.678039 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:09:35.678213 (+   174us) write_op.cc:270] Start()
0709 13:09:35.678382 (+   169us) write_op.cc:276] Timestamp: P: 1783602575678144 usec, L: 0
0709 13:09:35.678426 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:09:35.685024 (+  6598us) log.cc:844] Serialized 535 byte log entry
0709 13:09:35.828414 (+143390us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41beee28 00007f0f45629581 00007f0f45628d58 00007f0f4562d9f1 00007f0f4562d9a9 00007f0f4562d939 00007f0f4562d901 00007f0f4562cb2d 000000000038f354 000000000038f199
0709 13:09:36.086397 (+257983us) op_driver.cc:464] REPLICATION: finished
0709 13:09:36.182539 (+ 96142us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400355f54. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f41b5c571 00007f0f41bf032a 00007f0f41b75f14 00007f0f41b75ec3 00007f0f41b75e38 00007f0f41b75df3 00007f0f41b750dc 00007f0f41b9ee16 00007f0f41b86cbb 00007f0f41b7139d 00007f0f41b74d75
0709 13:09:36.183319 (+   780us) write_op.cc:301] APPLY: starting
0709 13:09:36.183408 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:36.185493 (+  2085us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:36.185526 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:36.187098 (+  1572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:36.187379 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:09:36.187439 (+    60us) write_op.cc:312] APPLY: finished
0709 13:09:36.187730 (+   291us) log.cc:844] Serialized 25 byte log entry
0709 13:09:36.187959 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.188069 (+   110us) write_op.cc:454] Released schema lock
0709 13:09:36.199206 (+ 11137us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:36.206984 (+  7778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.207017 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":96567,"apply.run_cpu_time_us":4563,"apply.run_wall_time_us":23633,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":371843,"prepare.run_cpu_time_us":63473,"prepare.run_wall_time_us":160137,"raft.queue_time_us":138696,"raft.run_cpu_time_us":35773,"raft.run_wall_time_us":128722,"replication_time_us":394575,"spinlock_wait_cycles":43824896,"thread_start_us":392220,"threads_started":4,"wal-append.queue_time_us":227587}]]}
I20260709 13:09:36.225031 19316 tablet_bootstrap.cc:492] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:36.216892 12627 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: term changed from 15 to 16, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1). New cstate: current_term: 16 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.298827 12802 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:36.300488 12808 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:36.301626 12881 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:36.303040 13517 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:36.307835 19364 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:36.311146 19367 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:36.312326 19340 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:36.252338 19316 ts_tablet_manager.cc:1403] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.817s	user 0.043s	sys 0.019s
I20260709 13:09:36.284992 19333 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:36.319371 19366 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:36.325248 19316 raft_consensus.cc:359] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.342325 19333 tablet_bootstrap.cc:492] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:36.364533 19333 ts_tablet_manager.cc:1403] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.652s	user 0.041s	sys 0.004s
I20260709 13:09:36.391217 12881 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:36.359151 19316 raft_consensus.cc:740] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:36.422045 19333 raft_consensus.cc:359] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.430405 19333 raft_consensus.cc:740] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:36.431422 19333 consensus_queue.cc:260] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.436905 19367 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:36.460107 19316 consensus_queue.cc:260] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.481647 19316 ts_tablet_manager.cc:1434] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.168s	user 0.009s	sys 0.000s
I20260709 13:09:36.484742 19333 ts_tablet_manager.cc:1434] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.002s
I20260709 13:09:36.484745 19340 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:36.493432 19375 log.cc:927] Time spent T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:09:36.506691 13517 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.520622 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-844a3ff085274442b304f06473e07511 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:36.521145 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-844a3ff085274442b304f06473e07511 on tablet 844a3ff085274442b304f06473e07511 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:36.517473 12742 tablet_copy_service.cc:342] P 72d06460bb5d4ccdbd4edbda8b9a1d63: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-433127d30b7c4bdf91cac2059c29a3f5 received from {username='slave'} at 127.0.0.1:52082
I20260709 13:09:36.527540 12742 tablet_copy_service.cc:434] P 72d06460bb5d4ccdbd4edbda8b9a1d63: ending tablet copy session a865487bf1854df8a5619d42465bb36c-433127d30b7c4bdf91cac2059c29a3f5 on tablet 433127d30b7c4bdf91cac2059c29a3f5 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:36.540448 12808 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:36.552942 19327 log.cc:927] Time spent T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:09:36.574673 12627 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 14 to 15, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.599584 12724 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:36.624258 19327 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:36.625348 19327 tablet_bootstrap.cc:492] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:36.626089 19327 ts_tablet_manager.cc:1403] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.956s	user 0.054s	sys 0.008s
I20260709 13:09:36.637379 12808 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:36.639425 19364 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:09:36.671635 13517 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:36.666817 12881 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.680307 13517 raft_consensus.cc:1217] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:09:36.680181 12808 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.679873 19366 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:09:36.686064 19367 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.715894 13517 raft_consensus.cc:2955] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.668385 19327 raft_consensus.cc:359] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.729229 19327 raft_consensus.cc:740] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:36.730116 19327 consensus_queue.cc:260] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:36.749203 12625 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 15 to 16, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 18 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:36.761373 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e81eeec454b94074a55f46a651353f9e with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:36.768980 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet e81eeec454b94074a55f46a651353f9e with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:36.788568 19327 ts_tablet_manager.cc:1434] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.162s	user 0.005s	sys 0.005s
I20260709 13:09:36.792178 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-b0e30b9fd61a41b294bf248bd704492b received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:36.792706 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-b0e30b9fd61a41b294bf248bd704492b on tablet b0e30b9fd61a41b294bf248bd704492b with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:36.811564 19378 tablet_replica.cc:333] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:36.813028 19378 raft_consensus.cc:2243] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.813925 19378 raft_consensus.cc:2272] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.849737 13512 raft_consensus.cc:1217] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Deduplicated request from leader. Original: 18.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:09:36.874996 19378 ts_tablet_manager.cc:1916] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:36.958603 19378 ts_tablet_manager.cc:1929] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.15
I20260709 13:09:36.960209 19378 log.cc:1199] T e81eeec454b94074a55f46a651353f9e P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/e81eeec454b94074a55f46a651353f9e
I20260709 13:09:36.967172 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet e81eeec454b94074a55f46a651353f9e (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:37.151942 13517 raft_consensus.cc:1217] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:09:37.305797 19335 raft_consensus.cc:1064] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:37.309119 19298 raft_consensus.cc:1064] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:37.314445 19335 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 8, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:37.360648 19298 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:37.400188 13517 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:37.404907 19379 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:37.407707 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.409759 12724 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:37.412123 12808 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:37.411968 19335 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:37.418716 19339 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:37.432250 12881 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:37.435320 13517 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:37.438658 19364 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:37.449280 19298 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:09:37.554183 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390c91265699487c943fe0217424eb34"
dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:40668
I20260709 13:09:37.554901 12724 raft_consensus.cc:606] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:37.585418 12808 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:09:37.631844 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 89338.5us
W20260709 13:09:37.718025 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 79454.3us
W20260709 13:09:37.718415 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 75355.9us
I20260709 13:09:37.665678 19364 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:09:37.755795 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 103716us
I20260709 13:09:37.569731 19339 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:37.826571 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 195993us
W20260709 13:09:37.888319 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59956us
W20260709 13:09:37.912861 19397 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:09:37.916817 19406 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:37.919026 12881 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:37.957194 12725 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.001484 19393 raft_consensus.cc:993] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:38.002254 19393 raft_consensus.cc:1081] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:38.026402 13521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390c91265699487c943fe0217424eb34"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:38668
I20260709 13:09:38.027165 13521 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.027539 13521 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.010797 13512 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.038614 13521 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.043659 13521 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:38.128932 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:09:38.131570 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 98842.7us
I20260709 13:09:38.133630 12875 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.130988 12808 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.151562 12875 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
W20260709 13:09:38.154572 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 52114.8us
I20260709 13:09:38.164516 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63"
I20260709 13:09:38.175709 12725 raft_consensus.cc:3055] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:38.176107 12725 raft_consensus.cc:740] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72d06460bb5d4ccdbd4edbda8b9a1d63, State: Running, Role: LEADER
I20260709 13:09:38.176851 12725 consensus_queue.cc:260] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.179169 12725 raft_consensus.cc:3060] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:38.168799 19383 log.cc:927] Time spent T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.054s	user 0.002s	sys 0.002s
W20260709 13:09:38.197317 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 53819.8us
I20260709 13:09:38.201665 12725 raft_consensus.cc:2468] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
I20260709 13:09:38.204711 13486 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:38.205809 19424 raft_consensus.cc:2804] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:38.206419 19424 raft_consensus.cc:697] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:38.207451 19424 consensus_queue.cc:237] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.222002 12881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
mode: GRACEFUL
new_leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:57450
I20260709 13:09:38.222731 12881 raft_consensus.cc:606] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Received request to transfer leadership to TS 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:38.233819 12881 raft_consensus.cc:1240] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Rejecting Update request from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:38.225373 12808 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.253016 13514 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.255764 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:38.258044 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.261961 12627 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:38.272200 19385 log.cc:927] Time spent T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Append to log took a long time: real 0.127s	user 0.000s	sys 0.008s
W20260709 13:09:38.318039 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 60629.6us
W20260709 13:09:38.323259 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 124948us
I20260709 13:09:38.328049 19418 raft_consensus.cc:1064] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:38.331995 12629 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 8 to 9, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.349768 19339 raft_consensus.cc:993] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: : Instructing follower 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:38.356753 19339 raft_consensus.cc:1081] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Signalling peer 83d2731c4bc049b3929d6c39670f5fd8 to start an election
I20260709 13:09:38.376421 12799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
 from {username='slave'} at 127.0.0.1:45512
I20260709 13:09:38.377139 12799 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.377668 12799 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:38.384271 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 45473.2us
I20260709 13:09:38.388191 12799 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.393528 12799 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Requested vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:38.408754 19418 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.411715 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:38.412660 12881 raft_consensus.cc:3055] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:38.413136 12881 raft_consensus.cc:740] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:38.418394 12881 consensus_queue.cc:260] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.419924 12881 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.416754 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:38.420799 13514 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.456317 13514 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:38.458539 12771 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:38.462110 19381 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:38.462749 19381 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:38.463713 19381 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:38.470470 12881 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 16.
I20260709 13:09:38.489349 12724 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:38.493191 19407 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.493753 12873 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:38.496215 13514 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:38.496129 19407 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.512152 19407 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:09:38.601182 13517 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.599113 19407 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.645735 12881 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.690482 12724 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:38.756109 12724 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:38.758147 19425 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.762033 12875 raft_consensus.cc:1275] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:38.773710 19424 consensus_queue.cc:1048] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.838289 12628 catalog_manager.cc:5697] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 13 to 14, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 14 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.842867 12628 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 11 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.038986 12630 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 15 to 16, leader changed from c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 16 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.046128 13517 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:39.051764 12881 raft_consensus.cc:1275] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:39.079221 19444 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.086953 19441 consensus_queue.cc:1048] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.099686 12725 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:39.120850 12799 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:39.160916 13519 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:39.166548 12874 raft_consensus.cc:1275] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:39.171785 19444 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.174716 12875 consensus_queue.cc:237] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:39.186723 13514 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:39.175489 19441 consensus_queue.cc:1048] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:09:39.193533 19410 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.221167 19390 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:39.231684 13514 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:39.233052 12629 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 14 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.234268 12808 raft_consensus.cc:1275] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:39.237131 19339 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:39.252239 19420 consensus_queue.cc:1048] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:39.255134 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e30b9fd61a41b294bf248bd704492b with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41076
W20260709 13:09:39.269068 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 76221.2us
I20260709 13:09:39.270015 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.285974 12618 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0e30b9fd61a41b294bf248bd704492b with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:39.289006 19453 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.293892 13517 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.263942 12875 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.298966 12808 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:39.312525 13514 raft_consensus.cc:2955] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.321589 19460 tablet_replica.cc:333] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:39.322896 19460 raft_consensus.cc:2243] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.323735 19460 raft_consensus.cc:2272] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.318637 19414 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.416762 13519 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:39.434015 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 121671us
I20260709 13:09:39.450884 19460 ts_tablet_manager.cc:1916] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:39.459383 12617 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 433127d30b7c4bdf91cac2059c29a3f5 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:09:39.466126 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 157582us
I20260709 13:09:39.472569 19443 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:39.477432 12629 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 reported cstate change: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New cstate: current_term: 15 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.489498 12866 tablet_service.cc:1558] Processing DeleteTablet for tablet 433127d30b7c4bdf91cac2059c29a3f5 with delete_type TABLET_DATA_TOMBSTONED (TS c45825bb09c34201b13ddcec07c4b3f1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37656
I20260709 13:09:39.506886 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 844a3ff085274442b304f06473e07511 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:39.514248 12805 raft_consensus.cc:2955] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:39.524626 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 56729.1us
I20260709 13:09:39.585875 19466 tablet_replica.cc:333] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:09:39.587276 19466 raft_consensus.cc:2243] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.617427 19466 raft_consensus.cc:2272] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.621580 12630 catalog_manager.cc:5697] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.635694 12799 raft_consensus.cc:2955] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:39.659965 19466 ts_tablet_manager.cc:1916] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:39.725739 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 92491.8us
I20260709 13:09:39.722198 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 844a3ff085274442b304f06473e07511 with delete_type TABLET_DATA_TOMBSTONED (TS 72d06460bb5d4ccdbd4edbda8b9a1d63 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41076
W20260709 13:09:39.744103 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 80787.9us
I20260709 13:09:39.744998 19466 ts_tablet_manager.cc:1929] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:09:39.750305 19466 log.cc:1199] T 433127d30b7c4bdf91cac2059c29a3f5 P c45825bb09c34201b13ddcec07c4b3f1: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/wals/433127d30b7c4bdf91cac2059c29a3f5
W20260709 13:09:39.752476 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 89334.4us
I20260709 13:09:39.786376 19460 ts_tablet_manager.cc:1929] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:09:39.786866 19460 log.cc:1199] T b0e30b9fd61a41b294bf248bd704492b P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/b0e30b9fd61a41b294bf248bd704492b
I20260709 13:09:39.756484 12615 catalog_manager.cc:5028] TS c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): tablet 433127d30b7c4bdf91cac2059c29a3f5 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:39.802289 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet b0e30b9fd61a41b294bf248bd704492b (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
W20260709 13:09:39.803272 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 162729us
I20260709 13:09:39.810889 19460 tablet_replica.cc:333] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:39.816490 19460 raft_consensus.cc:2243] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.827692 19460 raft_consensus.cc:2272] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.831625 19460 ts_tablet_manager.cc:1916] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:39.908875 19460 ts_tablet_manager.cc:1929] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:09:39.909390 19460 log.cc:1199] T 844a3ff085274442b304f06473e07511 P 72d06460bb5d4ccdbd4edbda8b9a1d63: Deleting WAL directory at /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/wals/844a3ff085274442b304f06473e07511
I20260709 13:09:39.911743 12617 catalog_manager.cc:5028] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): tablet 844a3ff085274442b304f06473e07511 (table test-workload [id=eaab1123a6484a5e9b6031128df7dd5a]) successfully deleted
I20260709 13:09:40.738854 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:40.834801 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 269460us
W20260709 13:09:40.986776 12699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 90867.1us
I20260709 13:09:41.032914 12808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505"
dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
mode: GRACEFUL
new_leader_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:36280
I20260709 13:09:41.033782 12808 raft_consensus.cc:606] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Received request to transfer leadership to TS a865487bf1854df8a5619d42465bb36c
I20260709 13:09:41.067816 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:41.069813 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:41.173668 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 51865.1us
W20260709 13:09:41.181598 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 95178.1us
W20260709 13:09:41.188509 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 61465.5us
I20260709 13:09:41.218561 19492 raft_consensus.cc:993] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: : Instructing follower a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:41.219187 19492 raft_consensus.cc:1081] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Signalling peer a865487bf1854df8a5619d42465bb36c to start an election
I20260709 13:09:41.222084 13514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505"
dest_uuid: "a865487bf1854df8a5619d42465bb36c"
 from {username='slave'} at 127.0.0.1:38680
I20260709 13:09:41.222707 13514 raft_consensus.cc:493] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.223069 13514 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.236609 13514 raft_consensus.cc:515] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:41.247252 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 46578us
I20260709 13:09:41.255867 13514 leader_election.cc:290] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:41.256604 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:41.259452 12800 raft_consensus.cc:3055] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:41.259590 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd420c179d854f04989e23d8e19b0505" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:41.259936 12800 raft_consensus.cc:740] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:41.260913 12881 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.262801 12800 consensus_queue.cc:260] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:41.264948 12800 raft_consensus.cc:3060] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.278980 12800 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:41.280743 13487 leader_election.cc:304] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:41.283020 19490 raft_consensus.cc:2804] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:41.284677 19490 raft_consensus.cc:697] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:41.287951 19490 consensus_queue.cc:237] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:41.289654 12881 raft_consensus.cc:2468] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:41.365355 12629 catalog_manager.cc:5697] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 14 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 15 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.467010 12881 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:41.502949 12800 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:41.506651 19479 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:41.520967 12845 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 682296e424dc4d959d7dbe0c329fc149. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.535887 12732 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:41.576187 19482 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:41.591428 19479 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.619289 12733 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.645138 12630 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.647125 12873 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:41.716935 12845 consensus_peers.cc:597] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2226e1c2db5f441197fe25690778db23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.742123 12724 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:41.742434 12808 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:41.745297 19500 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:41.752005 19500 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:41.781350 12800 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.817310 19482 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.821822 12808 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.839491 12732 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:41.859982 12724 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:41.898430 12873 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:41.900146 19484 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:41.902340 12627 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.922942 12800 raft_consensus.cc:1275] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:41.928331 12881 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:41.930383 19470 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:41.939821 12696 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ba3f64a0226433382c2dc48213c8070. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.942381 12805 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer 72d06460bb5d4ccdbd4edbda8b9a1d63: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:41.947665 19470 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:09:41.952539 19485 consensus_queue.cc:1048] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:41.955523 19527 ts_tablet_manager.cc:933] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:42.026329 19527 tablet_copy_client.cc:323] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:42.030396 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 682296e424dc4d959d7dbe0c329fc149 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:42.031004 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 682296e424dc4d959d7dbe0c329fc149 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-682296e424dc4d959d7dbe0c329fc149
I20260709 13:09:42.036286 19480 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:42.039604 12800 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:42.065964 12892 tablet_copy_source_session.cc:215] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:42.071017 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.097108 12879 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:42.104790 12630 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index -1 to 10, NON_VOTER a865487bf1854df8a5619d42465bb36c (127.11.78.4) added. New cstate: current_term: 13 leader_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } } }
I20260709 13:09:42.144771 19527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682296e424dc4d959d7dbe0c329fc149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.174510 19536 ts_tablet_manager.cc:933] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:42.262022 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:09:42.263886 19536 tablet_copy_client.cc:323] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.3:36899
I20260709 13:09:42.274156 19527 tablet_copy_client.cc:806] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:42.279332 12892 tablet_copy_service.cc:140] P c45825bb09c34201b13ddcec07c4b3f1: Received BeginTabletCopySession request for tablet 2226e1c2db5f441197fe25690778db23 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60686)
I20260709 13:09:42.279662 19527 tablet_copy_client.cc:670] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:42.280020 12892 tablet_copy_service.cc:161] P c45825bb09c34201b13ddcec07c4b3f1: Beginning new tablet copy session on tablet 2226e1c2db5f441197fe25690778db23 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60686: session id = a865487bf1854df8a5619d42465bb36c-2226e1c2db5f441197fe25690778db23
W20260709 13:09:42.282881 12847 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:42.315912 12892 tablet_copy_source_session.cc:215] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:42.317971 19527 tablet_copy_client.cc:538] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:42.322887 19536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2226e1c2db5f441197fe25690778db23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:42.332186 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.365379 19527 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:42.385901 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.393458 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48287us
W20260709 13:09:42.393337 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.403234 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.403322 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.404531 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.410713 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.424259 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.488075 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.508569 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.507764 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.517813 12847 consensus_peers.cc:597] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.509088 19536 tablet_copy_client.cc:806] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
W20260709 13:09:42.524022 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.518965 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.542430 19536 tablet_copy_client.cc:670] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:42.610060 19542 ts_tablet_manager.cc:933] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
W20260709 13:09:42.627802 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.655500 19542 tablet_copy_client.cc:323] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.1:36161
W20260709 13:09:42.669107 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.679899 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.714994 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44001.1us
I20260709 13:09:42.735074 19536 tablet_copy_client.cc:538] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:09:42.738066 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.783325 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.786234 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.799435 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.806471 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.821137 19536 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:42.816151 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.838678 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.814493 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.861289 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.868757 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.888700 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.898602 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.904502 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.988507 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:42.998466 11576 tablet_replica.cc:333] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.001596 11576 raft_consensus.cc:2243] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.008984 11576 raft_consensus.cc:2272] T 140b233442844af3b88e29b40d4f25ad P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.017087 11576 tablet_replica.cc:333] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.018051 11576 raft_consensus.cc:2243] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.018841 11576 raft_consensus.cc:2272] T fb04297576e2483ca596edd2dd418b52 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.033465 11576 tablet_replica.cc:333] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.048087 11576 raft_consensus.cc:2243] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.049526 11576 raft_consensus.cc:2272] T 0229d1c0cac14ba68f265bbecd5bf81b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.053014 11576 tablet_replica.cc:333] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.082732 11576 raft_consensus.cc:2243] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.210165 11576 raft_consensus.cc:2272] T 58d92b468aaa43eb88852feb36a41c17 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.209971 19527 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.244006 19443 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.244728 19443 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:43.254372 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 89223.7us
I20260709 13:09:43.287132 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:09:43.303265 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 77587.6us
I20260709 13:09:43.299078 19527 tablet_bootstrap.cc:492] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:43.341974 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.351562 11576 tablet_replica.cc:333] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.356702 11576 raft_consensus.cc:2243] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.310909 19443 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.373232 11576 raft_consensus.cc:2272] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.373472 19527 ts_tablet_manager.cc:1403] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.010s	user 0.069s	sys 0.022s
W20260709 13:09:43.387954 12696 raft_consensus.cc:687] T e22c9d890e514419a9265ab93f02ad09 P 72d06460bb5d4ccdbd4edbda8b9a1d63: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:09:43.389676 19489 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
W20260709 13:09:43.437112 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 127497us
W20260709 13:09:43.479072 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 95528us
I20260709 13:09:43.471421 19550 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.481019 19550 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.483798 19550 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.486032 19481 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.486845 19481 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.488675 19580 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.465229 19489 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.495321 19489 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:09:43.538436 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 58488.3us
I20260709 13:09:43.540760 11576 tablet_replica.cc:333] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.549650 11576 raft_consensus.cc:2243] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.504621 19550 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.585845 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.589869 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.489482 19580 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:43.608125 11576 raft_consensus.cc:2272] T 3f17b4815ff84374bc9e1b330d886c34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.580564 19550 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
I20260709 13:09:43.613765 19584 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.614477 19550 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:43.614420 19584 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.615163 19550 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.616382 19572 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.616977 19572 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.619421 19572 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.621414 19578 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.621488 19527 raft_consensus.cc:359] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:43.622124 19578 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.622644 19527 raft_consensus.cc:740] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:43.619966 19572 raft_consensus.cc:493] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.615705 19550 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.623374 19527 consensus_queue.cc:260] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:43.660276 19578 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.653067 19572 raft_consensus.cc:515] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.663358 19572 leader_election.cc:290] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.665333 19550 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.646759 19580 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.668335 19586 raft_consensus.cc:493] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.669100 19586 raft_consensus.cc:515] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.671597 19586 leader_election.cc:290] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.686990 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.676951 19481 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.697181 11576 tablet_replica.cc:333] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.710582 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.680482 19578 raft_consensus.cc:493] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.684962 19550 raft_consensus.cc:493] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.715399 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.685016 19586 raft_consensus.cc:493] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.725986 11576 raft_consensus.cc:2243] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.736112 19595 raft_consensus.cc:493] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.736747 19595 raft_consensus.cc:515] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.738445 19595 leader_election.cc:290] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.746467 11576 raft_consensus.cc:2272] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.750801 19489 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.751401 19489 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.753785 19489 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.753891 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.754323 19489 raft_consensus.cc:493] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.754827 19489 raft_consensus.cc:515] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.756409 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.759160 11576 tablet_replica.cc:333] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.724972 19550 raft_consensus.cc:515] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.760629 19489 leader_election.cc:290] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.762017 19550 leader_election.cc:290] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.728078 19578 raft_consensus.cc:515] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.763734 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.764410 19578 leader_election.cc:290] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.764515 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.765244 11576 raft_consensus.cc:2243] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.765988 11576 raft_consensus.cc:2272] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.766229 19527 ts_tablet_manager.cc:1434] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.380s	user 0.009s	sys 0.004s
I20260709 13:09:43.764447 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.772197 11576 tablet_replica.cc:333] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.728756 19583 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.774281 11576 raft_consensus.cc:2243] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.789872 13513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:43.790367 11576 raft_consensus.cc:2272] T 433127d30b7c4bdf91cac2059c29a3f5 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.789510 19572 raft_consensus.cc:493] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:43.739410 19584 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.730849 19586 raft_consensus.cc:515] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.804832 11576 tablet_replica.cc:333] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:43.808849 19572 raft_consensus.cc:515] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.795223 19583 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.825274 11576 raft_consensus.cc:2243] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.834422 19586 leader_election.cc:290] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.837121 19572 leader_election.cc:290] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.838734 19583 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.840807 13513 raft_consensus.cc:1217] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:09:43.879686 19595 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.880596 19578 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.880452 19595 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:43.881283 19578 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.882875 19595 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.883634 19578 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.886292 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-682296e424dc4d959d7dbe0c329fc149 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:43.886857 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-682296e424dc4d959d7dbe0c329fc149 on tablet 682296e424dc4d959d7dbe0c329fc149 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:43.888140 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b39827c8d024243a5a2883bc2c2bd83" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.889119 19595 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:43.892751 19595 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.891542 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8631a18d7be543f29c587dad80ba4297" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.893158 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.894016 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.890245 11576 raft_consensus.cc:2272] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.900251 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 100266us
I20260709 13:09:43.903594 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.904733 19600 raft_consensus.cc:493] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.905176 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36078b972bc46fe827c12e1015e239d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.905475 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.009665 19600 raft_consensus.cc:515] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:43.906211 19585 raft_consensus.cc:493] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:44.013144 19585 raft_consensus.cc:515] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.015388 19585 leader_election.cc:290] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.907181 19599 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:44.016364 19599 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.018574 19599 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:43.907786 19578 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:43.908318 12880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.909334 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6c7d6191794b6790622bf51bb289ee" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.019263 19578 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:44.021458 19578 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:44.022017 19600 leader_election.cc:290] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:44.022917 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d64be8779a42e0ad6540bfa7067f2b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.911037 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.911966 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.912696 12873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbc2136a4b642ca94a5ef49ef811508" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.914527 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc74d6c2504bad83ab3be06d6255c9" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.915525 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.917431 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc137392724a42a1a95e4a0543808c28" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:09:43.981216 19546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.004s	sys 0.009s
W20260709 13:09:44.028291 19546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.006s	sys 0.009s
I20260709 13:09:44.046034 19595 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:43.962989 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5e3e97cfa425f9fb7a66612ed959b" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.964736 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c91265699487c943fe0217424eb34" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:43.992975 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562422a4dc1a44a7bca3a549839874be" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:43.972309 19536 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.964596 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a839b697aea46da87cb69b00515389e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.048831 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.026391 12696 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:43.980441 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc76143509f64c4faa68973765829aec" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:09:44.021644 12699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.053125 19536 tablet_bootstrap.cc:492] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:44.053432 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.055507 12696 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.064348 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b1e83629843e7991a12a0e6370ca7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.065392 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:09:44.070546 12696 raft_consensus.cc:2686] T 2b39827c8d024243a5a2883bc2c2bd83 P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:44.071465 12696 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.074988 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.079860 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.084546 19536 ts_tablet_manager.cc:1403] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 1.264s	user 0.054s	sys 0.019s
I20260709 13:09:44.065621 19600 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.077339 19578 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:44.095163 19536 raft_consensus.cc:359] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:44.108843 19536 raft_consensus.cc:740] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:44.109906 19536 consensus_queue.cc:260] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:44.114636 11576 tablet_replica.cc:333] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.133327 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.134821 12808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.134969 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.135952 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.138309 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.139668 11576 raft_consensus.cc:2243] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:44.140236 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 106367us
I20260709 13:09:44.090097 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.151595 19595 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:44.152624 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 62608us
I20260709 13:09:44.146570 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.160929 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd615dc3bb34a41801dd1dd2d6aa16e" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.166000 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b483b06f72a4b6e863293d4c6099849" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.167932 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.171651 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c62986a26c4716a060e64c82e8f5a7" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.170794 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.170218 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7402969d1144da9a4a218d0c90ba138" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.172847 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e6770457a4cb087d4ea1e4af49b0d" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.171077 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682296e424dc4d959d7dbe0c329fc149" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.187645 19536 ts_tablet_manager.cc:1434] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.004s
I20260709 13:09:44.189208 12696 leader_election.cc:304] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.190392 19595 raft_consensus.cc:2749] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:44.191726 12696 leader_election.cc:304] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:09:44.192438 12696 raft_consensus.cc:2686] T cc76143509f64c4faa68973765829aec P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:44.193668 11576 raft_consensus.cc:2272] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.194473 12696 leader_election.cc:304] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.196120 19595 raft_consensus.cc:2749] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.196895 12699 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.197628 19578 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.198964 12699 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.199015 12696 leader_election.cc:304] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.199980 19578 raft_consensus.cc:2749] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.200930 19585 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:44.201467 12699 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.204771 12892 tablet_copy_service.cc:342] P c45825bb09c34201b13ddcec07c4b3f1: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-2226e1c2db5f441197fe25690778db23 received from {username='slave'} at 127.0.0.1:60686
I20260709 13:09:44.205307 12892 tablet_copy_service.cc:434] P c45825bb09c34201b13ddcec07c4b3f1: ending tablet copy session a865487bf1854df8a5619d42465bb36c-2226e1c2db5f441197fe25690778db23 on tablet 2226e1c2db5f441197fe25690778db23 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.209662 19585 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.211185 12699 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.212046 19585 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.213129 11576 tablet_replica.cc:333] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.213272 12699 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.223750 13512 raft_consensus.cc:1217] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:09:44.226002 19585 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:44.215340 11576 raft_consensus.cc:2243] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:44.244946 11576 raft_consensus.cc:2272] T 9ba3f64a0226433382c2dc48213c8070 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.243746 12699 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.252774 19585 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:44.254113 12699 leader_election.cc:304] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:09:44.254761 12699 raft_consensus.cc:2686] T 1dbc2136a4b642ca94a5ef49ef811508 P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:44.255574 12699 leader_election.cc:304] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:09:44.256222 12699 raft_consensus.cc:2686] T f4dc74d6c2504bad83ab3be06d6255c9 P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:44.260480 11576 tablet_replica.cc:333] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.264984 11576 raft_consensus.cc:2243] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.268182 11576 raft_consensus.cc:2272] T 390c91265699487c943fe0217424eb34 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:44.269449 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 70502.4us
I20260709 13:09:44.280274 12696 leader_election.cc:304] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.283656 11576 tablet_replica.cc:333] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.284528 19599 raft_consensus.cc:2749] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.287899 12696 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.288810 12699 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.300101 19600 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.303177 19595 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.303730 12699 leader_election.cc:304] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.311486 12699 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.318547 19564 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.319159 19578 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.319408 19564 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.322456 11576 raft_consensus.cc:2243] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.326728 12699 leader_election.cc:304] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.332486 19569 raft_consensus.cc:1064] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:44.315948 19599 raft_consensus.cc:2749] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.334836 11576 raft_consensus.cc:2272] T 8631a18d7be543f29c587dad80ba4297 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.338521 12699 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.342254 12699 leader_election.cc:304] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.349395 12699 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.354198 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.341010 19578 raft_consensus.cc:2749] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.355506 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.342504 19600 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.351897 19585 raft_consensus.cc:2749] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.357028 19443 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.360574 19595 raft_consensus.cc:2749] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.370913 19600 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.382364 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.381024 19564 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:09:44.395429 13486 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.404767 13487 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:44.335197 19569 consensus_queue.cc:237] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.407281 19484 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.419669 11576 tablet_replica.cc:333] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.411541 19549 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.412858 19568 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.421937 19484 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.426429 11576 raft_consensus.cc:2243] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.434520 11576 raft_consensus.cc:2272] T bdd615dc3bb34a41801dd1dd2d6aa16e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.428417 19568 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.444345 19494 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.450457 19494 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.452621 19494 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:44.462415 19484 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:44.463323 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:44.464259 12882 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 18.
W20260709 13:09:44.467690 13486 leader_election.cc:336] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.483668 11576 tablet_replica.cc:333] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.492785 19568 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:44.494179 13484 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:44.508618 19564 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:44.509042 19564 raft_consensus.cc:493] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.509423 19564 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:44.498991 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:09:44.513149 12773 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:44.518639 12847 leader_election.cc:336] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.520361 11576 raft_consensus.cc:2243] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.526800 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:44.527973 13521 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:09:44.530231 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:44.548180 19568 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:44.549053 11576 raft_consensus.cc:2272] T c7d64be8779a42e0ad6540bfa7067f2b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.548719 19568 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.560747 19568 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.574379 19535 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.575111 19535 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:44.577431 19535 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:44.569934 11576 tablet_replica.cc:333] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.578658 11576 raft_consensus.cc:2243] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.578800 13512 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:44.579569 11576 raft_consensus.cc:2272] T 2e6c7d6191794b6790622bf51bb289ee P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.580569 19414 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:44.581521 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:09:44.589361 12773 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.590006 12773 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:44.591604 19535 raft_consensus.cc:2749] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:44.593649 12804 raft_consensus.cc:1275] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:44.609688 11576 tablet_replica.cc:333] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.597251 19494 consensus_queue.cc:1048] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:09:44.612696 19564 raft_consensus.cc:515] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.614122 13514 raft_consensus.cc:2393] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 19: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:09:44.617633 19564 leader_election.cc:290] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:44.618887 12845 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:44.625622 19494 raft_consensus.cc:3060] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:44.629022 11576 raft_consensus.cc:2243] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.629819 11576 raft_consensus.cc:2272] T 682296e424dc4d959d7dbe0c329fc149 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.632766 11576 tablet_replica.cc:333] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.633831 11576 raft_consensus.cc:2243] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.634588 11576 raft_consensus.cc:2272] T 562422a4dc1a44a7bca3a549839874be P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.636051 19603 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.636765 19603 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:44.637123 19568 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.640425 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:44.641178 12805 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:09:44.643206 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:44.645391 19414 raft_consensus.cc:1064] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:44.645825 19581 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:44.646368 19581 raft_consensus.cc:493] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:44.646756 19581 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:44.649461 13486 leader_election.cc:336] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.652770 19414 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:44.653968 12773 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.655206 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140b233442844af3b88e29b40d4f25ad" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:44.656343 13514 raft_consensus.cc:3060] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.640478 19568 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:44.660194 19603 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:09:44.671729 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.662621 19581 raft_consensus.cc:515] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:44.673385 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0229d1c0cac14ba68f265bbecd5bf81b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:44.678160 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d92b468aaa43eb88852feb36a41c17" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:44.679876 12805 raft_consensus.cc:3060] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:44.680490 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:44.695081 13514 raft_consensus.cc:2468] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:44.696147 12805 raft_consensus.cc:2468] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
W20260709 13:09:44.696228 12847 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.696811 12771 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:44.697585 12848 leader_election.cc:304] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:44.693799 19581 leader_election.cc:290] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:44.702946 19568 raft_consensus.cc:2804] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:44.702539 19603 raft_consensus.cc:2804] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:44.705433 19603 raft_consensus.cc:697] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:44.706365 19603 consensus_queue.cc:237] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:44.708781 19568 raft_consensus.cc:697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
W20260709 13:09:44.709812 12847 leader_election.cc:336] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:44.709736 19568 consensus_queue.cc:237] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.772670 19494 raft_consensus.cc:2749] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.774977 13519 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:44.755698 19593 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:44.852355 11576 tablet_replica.cc:333] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.878334 12882 raft_consensus.cc:2468] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 19.
I20260709 13:09:44.893639 11576 raft_consensus.cc:2243] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:09:44.916510 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 204307us
I20260709 13:09:44.921550 11576 raft_consensus.cc:2272] T e6a3cae9c8f5497a965082c096899998 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.931140 13484 leader_election.cc:304] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:44.962265 19484 raft_consensus.cc:2804] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:44.962785 19484 raft_consensus.cc:697] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:44.974300 13514 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:44.980887 11576 tablet_replica.cc:333] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:44.985071 11576 raft_consensus.cc:2243] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.995404 11576 raft_consensus.cc:2272] T c36078b972bc46fe827c12e1015e239d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.963709 19484 consensus_queue.cc:237] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:44.980382 19569 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:09:45.015743 11576 tablet_replica.cc:333] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.033469 11576 raft_consensus.cc:2243] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.034245 11576 raft_consensus.cc:2272] T a18b1e83629843e7991a12a0e6370ca7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.037351 11576 tablet_replica.cc:333] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.038192 11576 raft_consensus.cc:2243] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.039122 11576 raft_consensus.cc:2272] T 96245329d8054ce88bb8c218f5069ede P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.045147 12630 catalog_manager.cc:5697] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.051064 11576 tablet_replica.cc:333] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.057999 11576 raft_consensus.cc:2243] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.053941 12627 catalog_manager.cc:5697] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 16 to 17, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.070586 12627 catalog_manager.cc:5697] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:45.058064 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.086974 12847 consensus_peers.cc:597] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.099126 11576 raft_consensus.cc:2272] T 28ea7c094d994eea9ec8090103d1142e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.102105 11576 tablet_replica.cc:333] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.148499 12804 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:45.151369 12805 raft_consensus.cc:2955] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:45.170724 11576 raft_consensus.cc:2243] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.180012 11576 raft_consensus.cc:2272] T c3d9f69b18784243b7b412c0ea27e1f4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.191668 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.193199 19616 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:45.196686 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.197624 11576 tablet_replica.cc:333] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.200594 11576 raft_consensus.cc:2243] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:09:45.217757 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.220306 11576 raft_consensus.cc:2272] T 6e133c6f80354472a921214beecde238 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.245434 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.298856 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 53199.8us
W20260709 13:09:45.303007 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 46287.4us
W20260709 13:09:45.234154 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.330292 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 96033.4us
I20260709 13:09:45.387617 19614 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.388979 19614 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:45.397550 19614 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:45.396171 11576 tablet_replica.cc:333] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.413969 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:45.415426 12805 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:45.427753 12804 raft_consensus.cc:1275] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:45.435878 13487 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:45.437076 19617 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.437583 19617 raft_consensus.cc:493] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.437994 19617 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:45.443819 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48547.7us
W20260709 13:09:45.454015 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.454896 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.472556 12874 raft_consensus.cc:1275] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:45.439517 12805 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:45.486467 19614 consensus_queue.cc:1048] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:45.487012 19570 consensus_queue.cc:1048] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:09:45.455646 11576 raft_consensus.cc:2243] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.496747 11576 raft_consensus.cc:2272] T 88a5e3e97cfa425f9fb7a66612ed959b P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.500034 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.377818 19566 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:45.505589 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.520970 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 64905.7us
I20260709 13:09:45.538997 19573 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.540096 19573 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:45.541379 11576 tablet_replica.cc:333] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.543206 11576 raft_consensus.cc:2243] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.561956 19573 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:45.566123 12773 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:45.603996 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.614840 11576 raft_consensus.cc:2272] T cc137392724a42a1a95e4a0543808c28 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.618115 12629 catalog_manager.cc:5697] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 18 to 19, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 19 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.619607 11576 tablet_replica.cc:333] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.652223 11576 raft_consensus.cc:2243] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:09:45.634765 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.653885 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.654233 11576 raft_consensus.cc:2272] T e81eeec454b94074a55f46a651353f9e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.641005 13514 raft_consensus.cc:1275] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:09:45.655140 13486 leader_election.cc:336] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:45.649582 19617 raft_consensus.cc:515] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:45.670419 19616 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.671463 19616 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:45.674567 19616 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:45.678642 19617 leader_election.cc:290] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:45.680461 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:45.681206 12874 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:45.685210 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:45.686074 12804 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:09:45.688380 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433127d30b7c4bdf91cac2059c29a3f5" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:45.689085 12804 raft_consensus.cc:3060] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.686385 13514 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:45.730661 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.663859 11576 tablet_replica.cc:333] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.743858 19619 consensus_queue.cc:1048] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:45.744773 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.776793 12630 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 10 to 11, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:45.745494 11576 raft_consensus.cc:2243] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.782361 11576 raft_consensus.cc:2272] T 250e6770457a4cb087d4ea1e4af49b0d P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.801384 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:45.804406 12804 raft_consensus.cc:2468] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
I20260709 13:09:45.811947 13487 leader_election.cc:304] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
I20260709 13:09:45.813027 19614 raft_consensus.cc:2804] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:45.813639 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:45.813689 19614 raft_consensus.cc:697] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:45.815557 19551 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:45.815447 19614 consensus_queue.cc:237] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:45.816305 19551 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.816787 19551 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:45.821378 11576 tablet_replica.cc:333] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:45.822155 19569 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:45.822589 19569 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:45.823012 19569 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:45.838665 19629 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:45.822593 11576 raft_consensus.cc:2243] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.839593 19629 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:45.846298 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.846979 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.847426 19629 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:45.847566 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.848364 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:09:45.848690 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.841856 12874 consensus_queue.cc:237] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:45.854501 11576 raft_consensus.cc:2272] T 4a839b697aea46da87cb69b00515389e P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.863833 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.865859 13486 leader_election.cc:336] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:45.870662 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.879048 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.880105 12847 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:45.886677 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.886996 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2226e1c2db5f441197fe25690778db23" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:09:45.885838 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.904196 13519 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:45.906733 19569 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:45.892604 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.908226 19570 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:45.911052 11576 tablet_replica.cc:333] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
W20260709 13:09:45.913492 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.929565 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.929850 19566 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:45.885207 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:45.939505 19629 raft_consensus.cc:493] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:45.934226 13519 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:45.940536 19629 raft_consensus.cc:515] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } }
W20260709 13:09:45.933820 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 48767.6us
I20260709 13:09:45.952734 12696 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:45.954365 19481 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:45.955363 12805 raft_consensus.cc:1275] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:45.961709 19629 leader_election.cc:290] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:45.962610 19481 raft_consensus.cc:493] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:45.963578 19481 raft_consensus.cc:515] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:45.831001 19551 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:45.965915 19551 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:45.946388 11576 raft_consensus.cc:2243] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.967240 11576 raft_consensus.cc:2272] T d4c62986a26c4716a060e64c82e8f5a7 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.967700 19481 leader_election.cc:290] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:45.976001 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:45.984149 19494 consensus_queue.cc:1048] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:09:45.985603 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:45.989353 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea332acd0f07405e95b83103a4876e08" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.005028 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d23a1e845884d5e9ad733d5579dcf30" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.009387 11576 tablet_replica.cc:333] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.044658 11576 raft_consensus.cc:2243] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.045981 11576 raft_consensus.cc:2272] T 9b483b06f72a4b6e863293d4c6099849 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.049108 12805 raft_consensus.cc:2955] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:46.054513 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:46.055380 12875 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 83d2731c4bc049b3929d6c39670f5fd8 in current term 14: Already voted for candidate c45825bb09c34201b13ddcec07c4b3f1 in this term.
W20260709 13:09:46.084616 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.092656 12696 leader_election.cc:304] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:46.096275 12696 leader_election.cc:304] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:46.100353 19637 raft_consensus.cc:2749] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.101797 19637 raft_consensus.cc:2749] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:46.106132 19549 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.106873 19549 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.120697 19549 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.128269 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:09:46.129598 12847 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.158082 11576 tablet_replica.cc:333] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.161259 11576 raft_consensus.cc:2243] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.105020 19569 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:09:46.168272 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:46.181110 12630 catalog_manager.cc:5697] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c reported cstate change: config changed from index 11 to 12, VOTER 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) evicted. New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:46.153873 13486 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:46.184479 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 51553.4us
I20260709 13:09:46.183998 12630 catalog_manager.cc:5697] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 15 to 16, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 16 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:46.188843 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:46.189026 11576 raft_consensus.cc:2272] T f7402969d1144da9a4a218d0c90ba138 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.191471 13487 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:46.213163 19564 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.221549 11576 tablet_replica.cc:333] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.221740 19568 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.222848 11576 raft_consensus.cc:2243] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.222611 19568 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:46.227383 19636 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:09:46.228190 19636 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:46.228730 19568 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:46.230304 12773 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.230513 19636 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:46.191107 19548 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.230796 12773 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:46.231331 19548 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.233781 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.233487 11576 raft_consensus.cc:2272] T b6e93451194c4f75b90838546e466fe0 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.233793 19548 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.244626 19535 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.248543 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281969f368e74705b0bebd5eaacc1e39" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.251344 12699 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:46.252413 19636 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:46.255342 13486 leader_election.cc:336] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:46.261593 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 166865us
I20260709 13:09:46.267364 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:46.269248 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.271555 12804 raft_consensus.cc:2393] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
W20260709 13:09:46.273692 12773 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.278796 12615 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2226e1c2db5f441197fe25690778db23 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:46.284581 12805 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 18.
I20260709 13:09:46.299754 11576 tablet_replica.cc:333] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.301450 11576 raft_consensus.cc:2243] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.303002 11576 raft_consensus.cc:2272] T d8dc6ee27c224540914eb4905a44b4f1 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.313290 13487 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:46.320914 11576 tablet_replica.cc:333] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.333227 19564 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:46.334872 19564 raft_consensus.cc:493] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.335273 19564 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:46.336421 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.351876 11576 raft_consensus.cc:2243] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.374194 11576 raft_consensus.cc:2272] T 2d23a1e845884d5e9ad733d5579dcf30 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.376498 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:46.378088 19636 raft_consensus.cc:493] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:46.378846 11576 tablet_replica.cc:333] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.379604 19570 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.379914 11576 raft_consensus.cc:2243] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.381351 12771 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:09:46.380705 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:46.379416 19636 raft_consensus.cc:515] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:46.411630 13487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 98460.5us
I20260709 13:09:46.380867 19619 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.431125 19647 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.431834 19647 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.435125 19647 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:46.442466 12805 raft_consensus.cc:1275] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:46.422518 19551 raft_consensus.cc:2749] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.426532 19566 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.424809 19619 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.491436 19637 raft_consensus.cc:493] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a865487bf1854df8a5619d42465bb36c)
I20260709 13:09:46.492218 19637 raft_consensus.cc:515] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.471880 19617 consensus_queue.cc:1048] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:09:46.495994 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.498765 19637 leader_election.cc:290] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.500355 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:09:46.506716 12617 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 90727.9us
I20260709 13:09:46.489873 19636 leader_election.cc:290] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.509413 19619 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.507404 11576 raft_consensus.cc:2272] T 2226e1c2db5f441197fe25690778db23 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.519763 11576 tablet_replica.cc:333] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.520910 11576 raft_consensus.cc:2243] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.482764 19566 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.521850 11576 raft_consensus.cc:2272] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.523388 19566 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.524431 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.526592 13514 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 17.
W20260709 13:09:46.530261 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:09:46.511541 19564 raft_consensus.cc:515] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.538443 19564 leader_election.cc:290] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.540493 19637 raft_consensus.cc:493] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:09:46.546240 19637 raft_consensus.cc:515] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:46.549501 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.556496 19637 leader_election.cc:290] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:46.572744 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.573459 12874 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
W20260709 13:09:46.578172 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.584939 11576 tablet_replica.cc:333] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.585923 11576 raft_consensus.cc:2243] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.587357 11576 raft_consensus.cc:2272] T 5df6c334df7c492f88316fe7c569e7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.591101 11576 tablet_replica.cc:333] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
W20260709 13:09:46.591539 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 61983.5us
I20260709 13:09:46.595969 19639 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.598853 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9ae3e4f0c340f180826fd03f63f7e4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.599896 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.601349 13484 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:46.625083 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:09:46.623963 13486 leader_election.cc:336] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.628593 19564 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.629192 19564 raft_consensus.cc:493] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.629575 19564 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:46.631567 13486 leader_election.cc:336] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.624893 19639 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.636438 19619 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:46.636965 19619 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.637355 19619 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.635947 19639 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.654946 11576 raft_consensus.cc:2243] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.667639 12696 leader_election.cc:304] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:46.671778 19637 raft_consensus.cc:2749] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:46.677140 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.678395 12847 leader_election.cc:336] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.680788 19564 raft_consensus.cc:515] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.682183 19649 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.682849 19649 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.684247 19564 leader_election.cc:290] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:46.685045 19649 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:46.693048 13486 leader_election.cc:336] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:46.695421 13486 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.695813 11576 raft_consensus.cc:2272] T e76bdc6d77354bafb6cab7951596cb2a P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.694569 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:46.696614 12875 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
W20260709 13:09:46.697377 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 175279us
I20260709 13:09:46.698915 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.699712 13519 raft_consensus.cc:2393] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 17: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:09:46.700690 11576 tablet_replica.cc:333] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.701673 11576 raft_consensus.cc:2243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.702550 11576 raft_consensus.cc:2272] T 8d9ae3e4f0c340f180826fd03f63f7e4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.711714 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.712494 13519 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
W20260709 13:09:46.694765 12847 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.694350 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96245329d8054ce88bb8c218f5069ede" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:46.714452 12874 raft_consensus.cc:3060] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.713924 13484 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:46.720443 19617 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:46.720899 19617 raft_consensus.cc:493] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.721361 19617 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.727155 12805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ea7c094d994eea9ec8090103d1142e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:46.727985 12805 raft_consensus.cc:3060] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:46.717913 11576 tablet_replica.cc:333] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.738778 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d985ce4f59254503949afda97665ffd4" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.741117 11576 raft_consensus.cc:2243] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.743848 19617 raft_consensus.cc:515] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.744552 11576 raft_consensus.cc:2272] T 281969f368e74705b0bebd5eaacc1e39 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.745765 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c227f9d3821443ccaf06901b122c4591" candidate_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.746790 19657 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.752864 19657 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:46.755043 19657 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.762887 12699 leader_election.cc:304] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:46.764708 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:46.766309 12805 raft_consensus.cc:2468] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 19.
W20260709 13:09:46.767607 12699 raft_consensus.cc:2686] T d985ce4f59254503949afda97665ffd4 P 72d06460bb5d4ccdbd4edbda8b9a1d63: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:46.765339 12845 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, a865487bf1854df8a5619d42465bb36c
I20260709 13:09:46.765498 12803 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 19.
I20260709 13:09:46.752496 19619 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:46.772650 13486 leader_election.cc:336] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.776816 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:46.784694 19639 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:46.785109 19639 raft_consensus.cc:493] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.785499 19639 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.776144 12699 leader_election.cc:304] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d06460bb5d4ccdbd4edbda8b9a1d63; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:46.780323 13487 leader_election.cc:304] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:09:46.788199 12847 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.793155 19637 raft_consensus.cc:2749] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.793308 19649 raft_consensus.cc:2804] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:46.796222 19649 raft_consensus.cc:697] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
W20260709 13:09:46.802296 12773 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.807173 19619 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.810444 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a3cae9c8f5497a965082c096899998" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:46.811117 13519 raft_consensus.cc:3060] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.800513 19649 consensus_queue.cc:237] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.826838 12874 raft_consensus.cc:2468] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 17.
I20260709 13:09:46.831753 13519 raft_consensus.cc:2468] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
I20260709 13:09:46.804653 12845 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:46.834205 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e133c6f80354472a921214beecde238" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:46.834895 12875 raft_consensus.cc:3060] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.837213 12771 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:09:46.833287 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:46.842840 19535 raft_consensus.cc:2804] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:46.836310 19657 raft_consensus.cc:2749] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:46.844249 19535 raft_consensus.cc:697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:46.845223 19535 consensus_queue.cc:237] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.832307 19617 leader_election.cc:290] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:46.864630 13484 leader_election.cc:304] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:46.865653 19617 raft_consensus.cc:2804] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:46.866374 19617 raft_consensus.cc:697] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:46.871852 12627 catalog_manager.cc:5697] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 18 to 19, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 19 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.876389 19639 raft_consensus.cc:515] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:46.857180 12875 raft_consensus.cc:2468] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:09:46.903631 19570 raft_consensus.cc:2764] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:46.905092 11576 tablet_replica.cc:333] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.905987 11576 raft_consensus.cc:2243] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.906626 11576 raft_consensus.cc:2272] T c227f9d3821443ccaf06901b122c4591 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.907415 19656 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.908289 19617 consensus_queue.cc:237] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.909561 19656 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.912926 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:09:46.913394 19564 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.914161 19564 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:46.916289 13514 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 18.
I20260709 13:09:46.920936 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 
W20260709 13:09:46.923297 13486 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.925026 13484 leader_election.cc:304] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:46.926255 19573 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:46.926846 19573 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:46.927229 19573 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:46.930112 11576 tablet_replica.cc:333] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63: stopping tablet replica
I20260709 13:09:46.931080 11576 raft_consensus.cc:2243] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.931792 11576 raft_consensus.cc:2272] T ea332acd0f07405e95b83103a4876e08 P 72d06460bb5d4ccdbd4edbda8b9a1d63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.926330 19614 raft_consensus.cc:2804] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:46.942728 19639 leader_election.cc:290] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.944361 19614 raft_consensus.cc:697] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:09:46.944480 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d9f69b18784243b7b412c0ea27e1f4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:46.945432 12804 raft_consensus.cc:3060] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.945976 19614 consensus_queue.cc:237] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:46.951362 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.913663 19656 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:46.960951 19564 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:46.964455 12629 catalog_manager.cc:5697] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 18 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.966948 12804 raft_consensus.cc:2468] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 20.
I20260709 13:09:46.975631 12848 leader_election.cc:304] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:09:46.976966 12773 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.977607 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
W20260709 13:09:46.986249 12773 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:46.984253 19657 raft_consensus.cc:2804] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:47.017795 19657 raft_consensus.cc:697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
W20260709 13:09:47.058808 12847 leader_election.cc:336] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.060622 19657 consensus_queue.cc:237] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.069561 19573 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:47.075662 12803 raft_consensus.cc:2393] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a865487bf1854df8a5619d42465bb36c in current term 19: Already voted for candidate 83d2731c4bc049b3929d6c39670f5fd8 in this term.
I20260709 13:09:47.076794 19573 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:09:47.082147 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81eeec454b94074a55f46a651353f9e" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:09:47.083302 13519 raft_consensus.cc:3060] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:47.097090 12773 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.097616 13487 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:47.128301 13519 raft_consensus.cc:2468] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 19.
I20260709 13:09:47.129725 19564 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:47.132432 12771 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:47.142278 19656 raft_consensus.cc:2804] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:47.143049 19656 raft_consensus.cc:697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:47.144601 19656 consensus_queue.cc:237] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:09:47.167213 12630 catalog_manager.cc:5697] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 19 to 20, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 20 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:47.282505 12773 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 303 similar messages]
I20260709 13:09:47.284549 12629 catalog_manager.cc:5697] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 18 to 19, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 19 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.335146 12875 raft_consensus.cc:1275] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:47.335906 12627 catalog_manager.cc:5697] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 14 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 15 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.339126 19564 consensus_queue.cc:1048] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:47.352669 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.340413 12627 catalog_manager.cc:5697] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 16 to 17, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 17 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.367163 12805 raft_consensus.cc:1275] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:47.368762 19564 consensus_queue.cc:1048] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:47.406260 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.419651 13519 raft_consensus.cc:1275] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:47.421331 19656 consensus_queue.cc:1048] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
W20260709 13:09:47.437970 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.440095 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.446105 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.495582 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:47.521286 12805 raft_consensus.cc:1275] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:47.526281 19569 consensus_queue.cc:1048] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
W20260709 13:09:47.547173 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.549217 12875 raft_consensus.cc:1275] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer a865487bf1854df8a5619d42465bb36c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:47.551010 19564 consensus_queue.cc:1048] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:47.568102 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.572072 19656 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.572806 19656 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.575482 19656 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:47.577163 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:09:47.592446 12773 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.592948 12773 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:47.602180 19656 raft_consensus.cc:2749] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:47.619982 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.648551 19573 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.649092 19573 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.651592 19573 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:47.656950 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:47.663374 13514 raft_consensus.cc:1275] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:09:47.664235 19657 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.664935 19657 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.665735 19656 consensus_queue.cc:1048] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:09:47.670306 12847 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.671077 19657 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:47.671787 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:47.674309 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:09:47.676669 19639 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:47.684809 12773 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.685906 12773 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:47.688423 19655 raft_consensus.cc:2749] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:47.709590 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:47.773286 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:47.795787 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:47.808580 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 116411us
W20260709 13:09:47.812680 12617 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 84363us
W20260709 13:09:47.824369 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:09:47.815629 19655 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.837739 19681 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.838457 19681 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.844691 19639 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.845520 19639 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.833098 19655 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:47.857627 19639 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:47.868640 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:47.869315 12803 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:09:47.873337 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:47.874063 12803 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 20.
I20260709 13:09:47.888005 19655 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:47.889101 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:47.850785 19681 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:47.905575 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:09:47.912365 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.914691 12773 leader_election.cc:336] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.915354 12773 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:09:47.928268 19639 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:47.928875 19639 raft_consensus.cc:493] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:47.929270 19639 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:47.939082 19686 raft_consensus.cc:2749] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:47.977533 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.985092 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:47.987936 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 82439.8us
I20260709 13:09:47.988469 19655 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.992846 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:09:47.992817 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 91139.1us
I20260709 13:09:48.004863 19682 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:48.005623 12847 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:48.014158 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.006359 19655 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
W20260709 13:09:48.015818 12696 connection.cc:466] server connection from 127.0.0.1:52120 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52120 (request call id 3888) could send its response
I20260709 13:09:48.017427 19655 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:09:48.006932 19682 raft_consensus.cc:493] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:48.027268 19682 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:48.031623 12847 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:48.033573 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.035533 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.037081 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.042769 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.046583 12698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.077088 12696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 60391.1us
W20260709 13:09:48.076644 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 68887.9us
I20260709 13:09:48.077438 19690 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:48.080123 19690 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.082333 19690 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:09:48.091864 12773 connection.cc:573] client connection to 127.11.78.1:36161 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:09:48.100644 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8" is_pre_election: true
I20260709 13:09:48.103087 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:48.103695 12879 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 14.
I20260709 13:09:48.101449 12804 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:09:48.112771 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.111353 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.117185 19686 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:48.117659 19686 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.118036 19686 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:48.119083 19569 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:48.110672 19682 raft_consensus.cc:515] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.111604 19639 raft_consensus.cc:515] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.132817 19569 raft_consensus.cc:493] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
W20260709 13:09:48.137701 12847 connection.cc:769] client connection to 127.11.78.1:36161 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:09:48.151510 12773 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:48.154671 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.143702 19569 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.187355 19682 leader_election.cc:290] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:48.189499 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc6ee27c224540914eb4905a44b4f1" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:48.209630 12804 raft_consensus.cc:3060] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:48.194335 19639 leader_election.cc:290] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:48.196465 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e93451194c4f75b90838546e466fe0" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:48.214082 12803 raft_consensus.cc:3060] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:48.217389 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 211078us
I20260709 13:09:48.206115 19686 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:48.229406 12803 raft_consensus.cc:2468] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 17.
I20260709 13:09:48.240655 19686 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:48.247628 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.217275 19569 raft_consensus.cc:515] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.253482 12848 leader_election.cc:304] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.254436 19696 raft_consensus.cc:2804] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:48.255182 19696 raft_consensus.cc:697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:48.256773 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:48.256541 19696 consensus_queue.cc:237] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.257489 12881 raft_consensus.cc:3060] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:48.260160 12804 raft_consensus.cc:2468] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 21.
I20260709 13:09:48.262343 12848 leader_election.cc:304] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.263396 19639 raft_consensus.cc:2804] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:48.263945 19639 raft_consensus.cc:697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 21 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:48.264890 19639 consensus_queue.cc:237] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:48.276451 12773 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:09:48.289287 12881 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 15.
I20260709 13:09:48.301393 12628 catalog_manager.cc:5697] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 16 to 17, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 17 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.318615 19569 leader_election.cc:290] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:48.288808 19656 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:48.319682 19656 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.323819 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6c334df7c492f88316fe7c569e7e4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "83d2731c4bc049b3929d6c39670f5fd8"
I20260709 13:09:48.324687 12803 raft_consensus.cc:3060] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.327014 12771 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
I20260709 13:09:48.336450 19655 raft_consensus.cc:2804] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:48.337190 19655 raft_consensus.cc:697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:48.339985 19656 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:48.360349 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.361245 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.365057 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.339136 19655 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:48.389648 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:09:48.390563 12881 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 12.
I20260709 13:09:48.392163 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.395123 19686 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.395563 19686 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72d06460bb5d4ccdbd4edbda8b9a1d63)
I20260709 13:09:48.396054 19686 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.404126 12803 raft_consensus.cc:2468] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 18.
W20260709 13:09:48.414547 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.418280 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.453742 12847 leader_election.cc:336] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:09:48.455381 12848 leader_election.cc:304] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:09:48.411717 19686 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:48.456301 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.461114 12773 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:09:48.463398 19639 raft_consensus.cc:2804] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:48.489152 19639 raft_consensus.cc:697] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:09:48.490289 19639 consensus_queue.cc:237] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:09:48.498757 19686 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Requested vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:09:48.508603 12847 leader_election.cc:336] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:48.509608 12847 leader_election.cc:336] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:48.510354 12847 leader_election.cc:336] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:48.516525 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.529081 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 64615.7us
I20260709 13:09:48.548404 12629 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 13 to 15, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:48.555938 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.568307 12773 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:48.578368 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 98657.2us
I20260709 13:09:48.620915 12875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76bdc6d77354bafb6cab7951596cb2a" candidate_uuid: "83d2731c4bc049b3929d6c39670f5fd8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:09:48.621644 12875 raft_consensus.cc:3060] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:48.636155 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.641968 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.642504 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:48.642885 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.649240 12875 raft_consensus.cc:2468] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83d2731c4bc049b3929d6c39670f5fd8 in term 13.
I20260709 13:09:48.654316 12771 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63
W20260709 13:09:48.649960 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.655192 19686 raft_consensus.cc:2804] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:48.655833 19686 raft_consensus.cc:697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Becoming Leader. State: Replica: 83d2731c4bc049b3929d6c39670f5fd8, State: Running, Role: LEADER
I20260709 13:09:48.657358 19686 consensus_queue.cc:237] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
W20260709 13:09:48.689865 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.694139 12628 catalog_manager.cc:5697] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 20 to 21, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 21 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.697609 12629 catalog_manager.cc:5697] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: term changed from 12 to 13, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2). New cstate: current_term: 13 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.703493 12628 catalog_manager.cc:5697] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 17 to 18, leader changed from 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 18 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.754439 12803 raft_consensus.cc:1275] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:48.757579 19569 consensus_queue.cc:1048] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:48.822687 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.839656 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.860339 12803 raft_consensus.cc:1275] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 21 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:48.862044 19639 consensus_queue.cc:1048] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:48.884917 12875 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:48.886642 19686 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:48.928563 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.943325 19542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38668 (request call id 893) took 6528 ms. Trace:
W20260709 13:09:48.944393 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.943919 19542 rpcz_store.cc:276] 0709 13:09:42.414491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.414617 (+   126us) service_pool.cc:224] Handling call
0709 13:09:42.610542 (+195925us) ts_tablet_manager.cc:934] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161)
0709 13:09:43.840053 (+1229511us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b4c003c7340. stack: 00007f0f3ead4343 00007f0f3ead4240 00007f0f3e4631d4 00007f0f481a1304 00007f0f481a1299 00007f0f3febfa20 00007f0f3fed0a29 00007f0f3fed113f 00007f0f3fe952ab 00007f0f3fec2f3c 00007f0f3fec3461 00007f0f3fec3768 00007f0f45c492eb 00007f0f46b6ed3b 00007f0f46b69008 00007f0f46b68405
0709 13:09:48.943002 (+5102949us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":292,"spinlock_wait_cycles":477227264,"tablet-copy.queue_time_us":126315,"thread_start_us":129879,"threads_started":2}
W20260709 13:09:48.956231 13487 connection.cc:466] server connection from 127.0.0.1:38668 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38668 (request call id 893) could send its response
W20260709 13:09:48.974064 12771 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809): Couldn't send request to peer a865487bf1854df8a5619d42465bb36c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ba3f64a0226433382c2dc48213c8070. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.067435 12799 raft_consensus.cc:1275] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:09:49.070793 19639 consensus_queue.cc:1048] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:49.141376 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.143347 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.160109 11576 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:49.178231 12845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 47614.3us
W20260709 13:09:49.202332 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:49.212453 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:49.213421 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 81388.8us
I20260709 13:09:49.219290 12875 raft_consensus.cc:1275] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:49.224303 19686 consensus_queue.cc:1048] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:49.292981 12773 consensus_peers.cc:597] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.306068 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.650519 19723 ts_tablet_manager.cc:933] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Initiating tablet copy from peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:09:49.680326 19723 tablet_copy_client.cc:323] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.78.2:36791
I20260709 13:09:49.682789 12818 tablet_copy_service.cc:140] P 83d2731c4bc049b3929d6c39670f5fd8: Received BeginTabletCopySession request for tablet 9ba3f64a0226433382c2dc48213c8070 from peer a865487bf1854df8a5619d42465bb36c ({username='slave'} at 127.0.0.1:60724)
I20260709 13:09:49.683534 12818 tablet_copy_service.cc:161] P 83d2731c4bc049b3929d6c39670f5fd8: Beginning new tablet copy session on tablet 9ba3f64a0226433382c2dc48213c8070 from peer a865487bf1854df8a5619d42465bb36c at {username='slave'} at 127.0.0.1:60724: session id = a865487bf1854df8a5619d42465bb36c-9ba3f64a0226433382c2dc48213c8070
I20260709 13:09:49.692601 12818 tablet_copy_source_session.cc:215] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:49.696797 19723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3f64a0226433382c2dc48213c8070. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:49.748648 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:49.746434 19723 tablet_copy_client.cc:806] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 0 data blocks...
W20260709 13:09:49.760423 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.775177 19723 tablet_copy_client.cc:670] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:49.792275 19723 tablet_copy_client.cc:538] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:49.802711 19723 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Bootstrap starting.
W20260709 13:09:49.846637 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.964169 19723 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.965407 19723 tablet_bootstrap.cc:492] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Bootstrap complete.
I20260709 13:09:49.966164 19723 ts_tablet_manager.cc:1403] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Time spent bootstrapping tablet: real 0.164s	user 0.038s	sys 0.010s
I20260709 13:09:49.975194 19723 raft_consensus.cc:359] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:49.977351 19723 raft_consensus.cc:740] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Initialized, Role: LEARNER
I20260709 13:09:49.978039 19723 consensus_queue.cc:260] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: NON_VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: true } }
I20260709 13:09:50.001102 19723 ts_tablet_manager.cc:1434] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:09:50.022069 12818 tablet_copy_service.cc:342] P 83d2731c4bc049b3929d6c39670f5fd8: Request end of tablet copy session a865487bf1854df8a5619d42465bb36c-9ba3f64a0226433382c2dc48213c8070 received from {username='slave'} at 127.0.0.1:60724
I20260709 13:09:50.022598 12818 tablet_copy_service.cc:434] P 83d2731c4bc049b3929d6c39670f5fd8: ending tablet copy session a865487bf1854df8a5619d42465bb36c-9ba3f64a0226433382c2dc48213c8070 on tablet 9ba3f64a0226433382c2dc48213c8070 with peer a865487bf1854df8a5619d42465bb36c
I20260709 13:09:50.039295 13517 raft_consensus.cc:1217] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Deduplicated request from leader. Original: 13.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 13:09:50.052639 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:50.154752 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:50.161173 11576 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:50.163247 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:50.202765 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.208806 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:50.225543 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.252960 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:50.280684 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:50.294811 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.334609 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.406287 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.408860 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.423866 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.455283 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.491074 19726 raft_consensus.cc:1064] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: attempting to promote NON_VOTER a865487bf1854df8a5619d42465bb36c to VOTER
I20260709 13:09:50.493884 19726 consensus_queue.cc:237] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:09:50.500104 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.535821 13519 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 LEARNER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:50.552261 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.555593 19686 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:09:50.597371 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:50.611073 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.650712 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:50.651546 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.660076 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.669937 12879 raft_consensus.cc:1275] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Refusing update from remote peer 83d2731c4bc049b3929d6c39670f5fd8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:50.675840 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.711894 19734 consensus_queue.cc:1048] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:50.724365 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.756202 19734 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
I20260709 13:09:50.761876 12875 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:50.779541 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:50.802574 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:50.805331 12628 catalog_manager.cc:5697] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 reported cstate change: config changed from index 10 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "83d2731c4bc049b3929d6c39670f5fd8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.808426 13512 raft_consensus.cc:2955] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, a865487bf1854df8a5619d42465bb36c (127.11.78.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } } }
W20260709 13:09:50.995765 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.161785 11576 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:51.321543 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:51.347963 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:51.352356 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:51.353114 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.388173 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.406008 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:51.435381 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.452296 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.479058 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 105960us
W20260709 13:09:51.776343 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.789942 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.796363 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.800406 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.800951 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:51.826962 12773 consensus_peers.cc:597] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:52.092535 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:52.107620 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:52.150549 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 44715.1us
W20260709 13:09:52.162310 11576 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:52.298660 13486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111) [suppressed 423 similar messages]
W20260709 13:09:52.382534 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:52.641137 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:52.641894 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:52.643528 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:52.669535 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:52.701614 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:52.734723 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:52.813926 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:52.840924 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:52.930981 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.163575 11576 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:53.170172 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:53.199194 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:53.227607 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.242676 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.249120 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:53.300704 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.306337 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.377038 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.400234 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:53.457173 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.573076 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.602718 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.610726 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.635278 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.665737 12903 debug-util.cc:398] Leaking SignalData structure 0x7b080012bea0 after lost signal to thread 11579
W20260709 13:09:53.667322 12903 debug-util.cc:398] Leaking SignalData structure 0x7b080038bb40 after lost signal to thread 12665
W20260709 13:09:53.669023 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7dc0 after lost signal to thread 12832
W20260709 13:09:53.670511 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08001398e0 after lost signal to thread 12906
W20260709 13:09:53.675237 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.671977 12903 debug-util.cc:398] Leaking SignalData structure 0x7b080033a9a0 after lost signal to thread 13545
W20260709 13:09:53.688259 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.698756 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:53.739086 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.825835 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:53.826438 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:53.840905 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.852609 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.897473 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:53.921590 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:53.979425 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.007004 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.060700 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.145080 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.164409 11576 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:54.237648 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.262907 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.515983 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:54.520608 12773 consensus_peers.cc:597] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:54.523658 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.616623 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:54.947937 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.052570 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 45633.1us
W20260709 13:09:55.103088 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:55.104069 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:55.125736 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.165047 11576 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:55.166693 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.239526 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.339831 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 65741.6us
W20260709 13:09:55.357462 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.390981 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.516350 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.523447 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.547905 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.579922 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:09:55.597904 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:55.622725 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.632419 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:55.745316 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.773934 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:55.916958 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.939055 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.947184 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:55.948091 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.002043 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.022648 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.047245 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.063560 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.108115 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.114928 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:56.165757 11576 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:56.212316 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.212913 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.233276 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.307014 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:56.314568 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:56.343775 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.430439 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:56.518004 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.571408 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.589278 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.672933 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.695125 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.696975 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.834736 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:56.971788 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:57.166474 11576 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:57.424579 12773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111) [suppressed 403 similar messages]
W20260709 13:09:57.448830 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 502663us
W20260709 13:09:57.478621 12773 consensus_peers.cc:597] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:57.499084 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:57.521368 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 59245.1us
W20260709 13:09:57.674738 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:57.684579 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44038.5us
W20260709 13:09:57.891072 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:57.916167 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:57.962195 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:58.007912 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.036947 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.041059 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.086544 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbfe0 after lost signal to thread 11579
W20260709 13:09:58.087745 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080024de20 after lost signal to thread 12665
W20260709 13:09:58.089304 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6100 after lost signal to thread 12832
W20260709 13:09:58.090513 12662 debug-util.cc:398] Leaking SignalData structure 0x7b080004d580 after lost signal to thread 12906
W20260709 13:09:58.091795 12662 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5da0 after lost signal to thread 13545
W20260709 13:09:58.092684 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:58.105783 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:58.126549 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.158881 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.167474 11576 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:58.170822 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.227490 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:58.255568 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.275636 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.343614 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:58.399915 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.437361 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.484392 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.593608 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.700902 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.798708 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.922886 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:58.949673 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.001609 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:59.086144 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.091120 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.103765 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.117013 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:59.120796 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.161715 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:59.168015 11576 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 12754)
W20260709 13:09:59.200057 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.199723 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.208977 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.209734 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.316296 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:59.346184 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.392779 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.484795 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.594432 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.605598 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:59.719165 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.852066 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:59.910291 12773 consensus_peers.cc:597] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:59.967872 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 52416.7us
W20260709 13:10:00.131091 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:00.145036 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:00.168939 11576 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 12754)
W20260709 13:10:00.233230 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 88253.2us
W20260709 13:10:00.601831 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:00.795447 12773 consensus_peers.cc:597] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:00.796077 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:00.803081 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 92951.7us
W20260709 13:10:00.808718 12773 consensus_peers.cc:597] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:00.816509 12773 consensus_peers.cc:597] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:00.820745 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:00.834811 12773 consensus_peers.cc:597] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:00.892974 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:00.897806 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:00.908601 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:00.991300 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:01.054062 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:01.094730 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.098501 12773 consensus_peers.cc:597] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.183558 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.233291 11576 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 12754)
W20260709 13:10:01.251160 12773 consensus_peers.cc:597] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:01.252295 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.259876 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.265492 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.340360 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.373189 12773 consensus_peers.cc:597] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.544167 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:01.589811 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:01.718088 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800259e40 after lost signal to thread 11579
W20260709 13:10:01.719537 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800345ee0 after lost signal to thread 12665
W20260709 13:10:01.721966 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08003041a0 after lost signal to thread 12832
W20260709 13:10:01.723555 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad0c0 after lost signal to thread 12906
W20260709 13:10:01.725158 12903 debug-util.cc:398] Leaking SignalData structure 0x7b080034cf20 after lost signal to thread 13545
W20260709 13:10:01.802979 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 44383.3us
W20260709 13:10:01.832185 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 61276.3us
W20260709 13:10:01.848196 12847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 49749.8us
W20260709 13:10:01.882635 12773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 54184.7us
W20260709 13:10:01.899593 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:01.920262 13484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:36899, user_credentials={real_user=slave}} blocked reactor thread for 68192.8us
W20260709 13:10:01.953235 12771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:40809, user_credentials={real_user=slave}} blocked reactor thread for 119811us
W20260709 13:10:01.988268 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.009310 12773 consensus_peers.cc:597] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:02.030828 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.197319 12847 consensus_peers.cc:597] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.203606 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.272248 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:02.284309 12773 consensus_peers.cc:597] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.285732 12847 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.298933 12847 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:02.310160 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
W20260709 13:10:02.360270 12773 consensus_peers.cc:597] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.381685 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.428871 13486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111) [suppressed 430 similar messages]
I20260709 13:10:02.582706 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:10:02.597251 12847 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.616727 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.634023 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:02.685305 12848 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.690074 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.692081 12847 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.691344 13487 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.696272 13487 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.697651 12848 consensus_peers.cc:597] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.701975 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:02.706013 13487 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.759155 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:02.763892 11576 tablet_replica.cc:333] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
W20260709 13:10:02.759913 12848 consensus_peers.cc:597] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.766191 11576 raft_consensus.cc:2243] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:10:02.752012 13487 consensus_peers.cc:597] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.768249 11576 raft_consensus.cc:2272] T 140b233442844af3b88e29b40d4f25ad P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.771718 11576 tablet_replica.cc:333] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.772756 11576 raft_consensus.cc:2243] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.775013 11576 raft_consensus.cc:2272] T 58d92b468aaa43eb88852feb36a41c17 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.776187 12848 consensus_peers.cc:597] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.777976 11576 tablet_replica.cc:333] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.778903 11576 raft_consensus.cc:2243] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.780087 11576 raft_consensus.cc:2272] T fb04297576e2483ca596edd2dd418b52 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.782895 11576 tablet_replica.cc:333] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.783870 11576 raft_consensus.cc:2243] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.785125 11576 raft_consensus.cc:2272] T 226beb8cd35a475d90c160b1834a29b4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.790908 12848 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.805145 11576 tablet_replica.cc:333] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.806288 11576 raft_consensus.cc:2243] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.807585 11576 raft_consensus.cc:2272] T 49874df91d324eee9febcb540541383f P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.810523 11576 tablet_replica.cc:333] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
W20260709 13:10:02.812794 12773 consensus_peers.cc:597] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:02.813863 11576 raft_consensus.cc:2243] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.822397 11576 raft_consensus.cc:2272] T e22c9d890e514419a9265ab93f02ad09 P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.824487 12848 consensus_peers.cc:597] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.825632 11576 tablet_replica.cc:333] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.826721 11576 raft_consensus.cc:2243] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.828586 11576 raft_consensus.cc:2272] T ad96a33cd7224ee8980e6312e22ec951 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.831432 11576 tablet_replica.cc:333] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.832314 11576 raft_consensus.cc:2243] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.832984 11576 raft_consensus.cc:2272] T 1dbc2136a4b642ca94a5ef49ef811508 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.835793 11576 tablet_replica.cc:333] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.836862 11576 raft_consensus.cc:2243] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.838027 11576 raft_consensus.cc:2272] T 844a3ff085274442b304f06473e07511 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.841826 11576 tablet_replica.cc:333] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.842953 11576 raft_consensus.cc:2243] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.843664 11576 raft_consensus.cc:2272] T dff29d178e6c42cd8abcbd3d7747b77a P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.846814 11576 tablet_replica.cc:333] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.852763 11576 raft_consensus.cc:2243] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.853773 11576 raft_consensus.cc:2272] T 433127d30b7c4bdf91cac2059c29a3f5 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.857440 11576 tablet_replica.cc:333] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.858332 11576 raft_consensus.cc:2243] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.859102 11576 raft_consensus.cc:2272] T f4dc74d6c2504bad83ab3be06d6255c9 P 83d2731c4bc049b3929d6c39670f5fd8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.862098 11576 tablet_replica.cc:333] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.862954 11576 raft_consensus.cc:2243] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.864181 11576 raft_consensus.cc:2272] T 562422a4dc1a44a7bca3a549839874be P 83d2731c4bc049b3929d6c39670f5fd8 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.864367 12848 consensus_peers.cc:597] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.867156 11576 tablet_replica.cc:333] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.868086 11576 raft_consensus.cc:2243] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:10:02.868911 13487 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.869768 11576 raft_consensus.cc:2272] T 9ba3f64a0226433382c2dc48213c8070 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.874154 11576 tablet_replica.cc:333] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.876243 11576 raft_consensus.cc:2243] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.877405 11576 raft_consensus.cc:2272] T c7d64be8779a42e0ad6540bfa7067f2b P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.880129 11576 tablet_replica.cc:333] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.881770 11576 raft_consensus.cc:2243] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.882931 11576 raft_consensus.cc:2272] T 2e6c7d6191794b6790622bf51bb289ee P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.885921 11576 tablet_replica.cc:333] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.888087 11576 raft_consensus.cc:2243] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.888708 11576 raft_consensus.cc:2272] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.891453 11576 tablet_replica.cc:333] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.892359 11576 raft_consensus.cc:2243] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.893309 11576 raft_consensus.cc:2272] T 682296e424dc4d959d7dbe0c329fc149 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.897213 11576 tablet_replica.cc:333] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.898027 11576 raft_consensus.cc:2243] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.899093 11576 raft_consensus.cc:2272] T e6a3cae9c8f5497a965082c096899998 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.902006 11576 tablet_replica.cc:333] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.902858 11576 raft_consensus.cc:2243] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.903627 11576 raft_consensus.cc:2272] T 2d23a1e845884d5e9ad733d5579dcf30 P 83d2731c4bc049b3929d6c39670f5fd8 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.906159 12848 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.906603 11576 tablet_replica.cc:333] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
W20260709 13:10:02.889612 12847 consensus_peers.cc:597] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:02.907680 11576 raft_consensus.cc:2243] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.908916 11576 raft_consensus.cc:2272] T 2226e1c2db5f441197fe25690778db23 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.912292 11576 tablet_replica.cc:333] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.913160 11576 raft_consensus.cc:2243] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.915985 11576 raft_consensus.cc:2272] T b6e93451194c4f75b90838546e466fe0 P 83d2731c4bc049b3929d6c39670f5fd8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.919127 11576 tablet_replica.cc:333] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.919960 11576 raft_consensus.cc:2243] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.920688 11576 raft_consensus.cc:2272] T d8dc6ee27c224540914eb4905a44b4f1 P 83d2731c4bc049b3929d6c39670f5fd8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.923867 11576 tablet_replica.cc:333] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:02.924680 11576 raft_consensus.cc:2243] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:10:02.933650 12773 consensus_peers.cc:597] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:02.940395 11576 raft_consensus.cc:2272] T c36078b972bc46fe827c12e1015e239d P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:02.943825 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:02.944398 13487 consensus_peers.cc:597] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.946692 13487 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.991595 13487 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.994918 13487 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.022686 11576 tablet_replica.cc:333] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.023638 11576 raft_consensus.cc:2243] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.024384 11576 raft_consensus.cc:2272] T a18b1e83629843e7991a12a0e6370ca7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.027374 11576 tablet_replica.cc:333] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.028250 11576 raft_consensus.cc:2243] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.030094 11576 raft_consensus.cc:2272] T 2b86cb4a548944109bfb911e2b3a2591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.033041 11576 tablet_replica.cc:333] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.033788 11576 raft_consensus.cc:2243] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.035102 11576 raft_consensus.cc:2272] T b0e30b9fd61a41b294bf248bd704492b P 83d2731c4bc049b3929d6c39670f5fd8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.038885 11576 tablet_replica.cc:333] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.039876 11576 raft_consensus.cc:2243] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.041409 11576 raft_consensus.cc:2272] T b16b34b3b4a04edca05d5f0f4a3ce868 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.044921 11576 tablet_replica.cc:333] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.045802 11576 raft_consensus.cc:2243] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.047088 11576 raft_consensus.cc:2272] T 250e6770457a4cb087d4ea1e4af49b0d P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.050290 11576 tablet_replica.cc:333] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.051080 11576 raft_consensus.cc:2243] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.051973 11576 raft_consensus.cc:2272] T 28ea7c094d994eea9ec8090103d1142e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.055312 11576 tablet_replica.cc:333] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.056392 11576 raft_consensus.cc:2243] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.057085 11576 raft_consensus.cc:2272] T c3d9f69b18784243b7b412c0ea27e1f4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.060082 11576 tablet_replica.cc:333] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.060882 11576 raft_consensus.cc:2243] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.062300 11576 raft_consensus.cc:2272] T e81eeec454b94074a55f46a651353f9e P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.065480 11576 tablet_replica.cc:333] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.066671 11576 raft_consensus.cc:2243] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.067993 11576 raft_consensus.cc:2272] T cc137392724a42a1a95e4a0543808c28 P 83d2731c4bc049b3929d6c39670f5fd8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.070794 11576 tablet_replica.cc:333] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.071611 11576 raft_consensus.cc:2243] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.072285 11576 raft_consensus.cc:2272] T f21936f5afa14460a22306512f82c201 P 83d2731c4bc049b3929d6c39670f5fd8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.075762 11576 tablet_replica.cc:333] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.076608 11576 raft_consensus.cc:2243] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.077205 11576 raft_consensus.cc:2272] T cd420c179d854f04989e23d8e19b0505 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.080291 11576 tablet_replica.cc:333] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.081485 11576 raft_consensus.cc:2243] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.082223 11576 raft_consensus.cc:2272] T d4c62986a26c4716a060e64c82e8f5a7 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.085525 11576 tablet_replica.cc:333] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.086350 11576 raft_consensus.cc:2243] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.087041 11576 raft_consensus.cc:2272] T 9b483b06f72a4b6e863293d4c6099849 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.090332 11576 tablet_replica.cc:333] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.091092 11576 raft_consensus.cc:2243] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.092314 11576 raft_consensus.cc:2272] T eb5990f0ee644c48952ecb885d6a405b P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.095664 11576 tablet_replica.cc:333] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.096508 11576 raft_consensus.cc:2243] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.097229 11576 raft_consensus.cc:2272] T 098bf8b9f16c41adb5871161f995c638 P 83d2731c4bc049b3929d6c39670f5fd8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.100176 11576 tablet_replica.cc:333] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.100920 11576 raft_consensus.cc:2243] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.101533 11576 raft_consensus.cc:2272] T d985ce4f59254503949afda97665ffd4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.104664 11576 tablet_replica.cc:333] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.105458 11576 raft_consensus.cc:2243] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.106091 11576 raft_consensus.cc:2272] T 5df6c334df7c492f88316fe7c569e7e4 P 83d2731c4bc049b3929d6c39670f5fd8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.108708 11576 tablet_replica.cc:333] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.109427 11576 raft_consensus.cc:2243] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.110090 11576 raft_consensus.cc:2272] T 3e64952f9027442eb482fbc10cf426fe P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.112754 11576 tablet_replica.cc:333] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.113492 11576 raft_consensus.cc:2243] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.114660 11576 raft_consensus.cc:2272] T e76bdc6d77354bafb6cab7951596cb2a P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.117888 11576 tablet_replica.cc:333] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.118762 11576 raft_consensus.cc:2243] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.119439 11576 raft_consensus.cc:2272] T c227f9d3821443ccaf06901b122c4591 P 83d2731c4bc049b3929d6c39670f5fd8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.122359 11576 tablet_replica.cc:333] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.123131 11576 raft_consensus.cc:2243] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.123780 11576 raft_consensus.cc:2272] T ea332acd0f07405e95b83103a4876e08 P 83d2731c4bc049b3929d6c39670f5fd8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.126863 11576 tablet_replica.cc:333] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8: stopping tablet replica
I20260709 13:10:03.128448 11576 raft_consensus.cc:2243] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.129282 11576 raft_consensus.cc:2272] T 281969f368e74705b0bebd5eaacc1e39 P 83d2731c4bc049b3929d6c39670f5fd8 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.195123 12848 consensus_peers.cc:597] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.197227 12848 consensus_peers.cc:597] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.204732 12848 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.205478 12848 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.206346 12848 consensus_peers.cc:597] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.207118 12848 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.207967 12848 consensus_peers.cc:597] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.208626 12848 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.209275 12848 consensus_peers.cc:597] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.275969 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:03.288920 12847 consensus_peers.cc:597] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.331892 12847 consensus_peers.cc:597] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:03.388937 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:03.391376 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.541414 12847 consensus_peers.cc:597] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.566215 12847 consensus_peers.cc:597] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:03.579573 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:03.654053 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.759234 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.771833 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:03.801744 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:10:03.809051 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:03.819775 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:03.880183 19805 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:03.880915 19805 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:03.889429 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:03.891088 19805 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:10:03.893318 12848 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:03.894008 12848 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:10:03.895032 12847 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:03.895340 19805 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:03.927701 19754 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:03.928465 19754 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:03.931867 19754 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:03.933100 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
W20260709 13:10:03.936782 13487 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:03.937374 13484 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:03.941546 19754 raft_consensus.cc:2749] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.019532 19787 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.020171 19787 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.022363 19787 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.026549 19787 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.029816 19787 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.031881 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800337840 after lost signal to thread 11579
W20260709 13:10:04.032994 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800362a00 after lost signal to thread 12665
W20260709 13:10:04.033578 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800340f80 after lost signal to thread 12832
W20260709 13:10:04.034646 12903 debug-util.cc:398] Leaking SignalData structure 0x7b0800131b20 after lost signal to thread 12906
W20260709 13:10:04.038424 12903 debug-util.cc:398] Leaking SignalData structure 0x7b08001aeb80 after lost signal to thread 13545
W20260709 13:10:04.029222 13487 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.061357 19787 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.073112 19816 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.073879 19816 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.079447 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.081100 19816 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.087198 19784 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.087821 19784 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.085714 19806 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.093327 19806 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.095448 19806 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.096606 19784 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:10:04.086120 13487 leader_election.cc:336] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.095916 19806 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.099768 19806 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.101800 19784 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.109012 19806 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.109071 19784 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.111799 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:04.112464 13519 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:10:04.114604 19784 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
W20260709 13:10:04.115782 13486 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.117149 13486 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.130584 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:04.131009 19820 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.131556 13521 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:10:04.131747 19820 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.134305 19754 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.138350 19754 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.138873 19754 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.140843 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:04.141789 13521 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 13.
I20260709 13:10:04.143846 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:04.145529 19819 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.146140 19819 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.147284 19754 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:04.148238 13487 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.148981 13487 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:04.149529 13519 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 16.
I20260709 13:10:04.153772 19819 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.154363 19820 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.154668 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.155716 12882 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
I20260709 13:10:04.157619 13484 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.159334 19816 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.159792 19816 raft_consensus.cc:493] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.160791 19818 raft_consensus.cc:493] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.160976 19816 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.161439 19818 raft_consensus.cc:515] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:10:04.165078 19817 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.165690 19817 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.168295 12848 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.172088 12847 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.172163 19817 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.174146 19818 leader_election.cc:290] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.176009 19820 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.176254 19819 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.181931 12845 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.176884 19820 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.183465 19784 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.183918 19784 raft_consensus.cc:493] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.185902 19784 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.186744 19820 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:04.199084 12848 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.199846 12848 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.200520 12848 leader_election.cc:336] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.211114 19816 raft_consensus.cc:515] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.212929 12845 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.214440 19818 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:04.221472 19818 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.221911 19818 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:04.217234 12848 leader_election.cc:336] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.219071 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16b34b3b4a04edca05d5f0f4a3ce868" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:10:04.224368 12848 leader_election.cc:336] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.224484 12882 raft_consensus.cc:3060] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.224808 12848 leader_election.cc:304] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.228000 19806 raft_consensus.cc:2749] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.219301 19816 leader_election.cc:290] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.234254 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.235644 19805 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.236122 19805 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.236842 19805 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.236152 12882 raft_consensus.cc:2468] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 17.
I20260709 13:10:04.238746 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
I20260709 13:10:04.240983 13484 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.246665 19784 raft_consensus.cc:515] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.248992 12845 leader_election.cc:304] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.250494 19817 raft_consensus.cc:2764] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:04.254743 19817 raft_consensus.cc:493] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.255398 19817 raft_consensus.cc:515] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:10:04.261768 19822 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.262775 19816 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.262571 19822 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.263442 19816 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.265412 19818 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.265868 19787 raft_consensus.cc:2804] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:04.266582 19787 raft_consensus.cc:697] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:10:04.267710 19787 consensus_queue.cc:237] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.269624 19822 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.271848 19817 leader_election.cc:290] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.275076 12882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3f64a0226433382c2dc48213c8070" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.275810 12882 raft_consensus.cc:2468] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:10:04.268234 19816 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.275581 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.276847 12881 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 13.
W20260709 13:10:04.278218 12847 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.279273 13484 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.272728 19805 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.280349 19816 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.283710 19816 raft_consensus.cc:493] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.284190 19816 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.285125 19805 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.281988 19818 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.290185 19817 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.290865 19817 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.270004 13486 leader_election.cc:336] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.292366 13486 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.293329 19784 leader_election.cc:290] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.293669 19817 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.296267 19754 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.303192 13519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:10:04.299383 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:04.311494 13521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
I20260709 13:10:04.311923 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5990f0ee644c48952ecb885d6a405b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:10:04.312779 13516 raft_consensus.cc:3060] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.316471 13514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49874df91d324eee9febcb540541383f" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:10:04.317296 13514 raft_consensus.cc:3060] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.310669 13512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e30b9fd61a41b294bf248bd704492b" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c"
I20260709 13:10:04.321033 13512 raft_consensus.cc:3060] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.324522 19754 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.325574 19754 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.328759 19754 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.329869 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.330765 12878 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 15.
I20260709 13:10:04.331897 13484 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.333077 19754 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:04.333528 19754 raft_consensus.cc:493] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.333943 19754 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.346091 19805 raft_consensus.cc:493] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.346840 19805 raft_consensus.cc:515] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:10:04.349078 19805 leader_election.cc:290] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.350286 13512 raft_consensus.cc:2468] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 15.
I20260709 13:10:04.354892 19822 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.360266 19820 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.361533 19754 raft_consensus.cc:515] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.363751 13514 raft_consensus.cc:2468] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:10:04.374646 13516 raft_consensus.cc:2468] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45825bb09c34201b13ddcec07c4b3f1 in term 14.
I20260709 13:10:04.368685 19816 raft_consensus.cc:515] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.308279 13486 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.379595 19754 leader_election.cc:290] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:04.364279 12847 leader_election.cc:336] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.377996 19820 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.382620 13487 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.384258 19820 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.377734 19822 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.386507 19822 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.385344 13487 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:04.388242 13487 leader_election.cc:336] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.388914 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b86cb4a548944109bfb911e2b3a2591" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
I20260709 13:10:04.390352 12878 raft_consensus.cc:3060] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:04.390668 13487 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.377182 12848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:36791, user_credentials={real_user=slave}} blocked reactor thread for 70831.8us
I20260709 13:10:04.388823 19822 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:04.391991 13486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:36161, user_credentials={real_user=slave}} blocked reactor thread for 83754.2us
W20260709 13:10:04.393713 13487 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.394645 19784 raft_consensus.cc:493] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.398818 19784 raft_consensus.cc:515] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:10:04.400221 19805 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.400921 19805 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.399394 13487 leader_election.cc:336] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.389251 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1" is_pre_election: true
I20260709 13:10:04.403553 19822 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.404057 12881 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
I20260709 13:10:04.404268 19822 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.405052 19805 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), a865487bf1854df8a5619d42465bb36c (127.11.78.4:40809)
I20260709 13:10:04.405867 13484 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.406893 19820 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.407339 19820 raft_consensus.cc:493] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.407748 19820 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:04.409608 13486 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.410180 13486 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.411465 13519 raft_consensus.cc:2393] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 14: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:10:04.420449 13516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "c45825bb09c34201b13ddcec07c4b3f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a865487bf1854df8a5619d42465bb36c" is_pre_election: true
W20260709 13:10:04.421695 12847 leader_election.cc:336] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:10:04.422621 12847 consensus_peers.cc:597] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:04.422152 12629 catalog_manager.cc:5697] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 17 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.424324 12845 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.425465 12845 leader_election.cc:304] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.426012 19816 leader_election.cc:290] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.419719 19784 leader_election.cc:290] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.426409 12845 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
W20260709 13:10:04.426811 12848 leader_election.cc:336] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.427251 19818 raft_consensus.cc:2804] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.427785 19817 raft_consensus.cc:2804] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.428310 19754 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.428458 19817 raft_consensus.cc:697] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:10:04.429682 19817 consensus_queue.cc:237] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.426847 19784 raft_consensus.cc:2804] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:04.430864 19784 raft_consensus.cc:697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:10:04.427449 12845 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:10:04.431845 13486 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.428077 19818 raft_consensus.cc:697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Becoming Leader. State: Replica: c45825bb09c34201b13ddcec07c4b3f1, State: Running, Role: LEADER
I20260709 13:10:04.432390 13486 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.432718 19806 raft_consensus.cc:3060] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.427320 12848 leader_election.cc:304] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.433074 19818 consensus_queue.cc:237] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.434024 19805 raft_consensus.cc:2749] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:04.435173 12848 leader_election.cc:336] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.436275 19754 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.436748 19822 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:04.432165 19784 consensus_queue.cc:237] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.442986 12848 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.443346 12881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226beb8cd35a475d90c160b1834a29b4" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:10:04.443992 12848 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.444741 12848 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.445079 12848 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:10:04.440877 13487 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.446090 13487 leader_election.cc:336] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.446285 19806 raft_consensus.cc:2749] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.455698 19820 raft_consensus.cc:515] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.457432 13516 raft_consensus.cc:2393] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45825bb09c34201b13ddcec07c4b3f1 in current term 17: Already voted for candidate a865487bf1854df8a5619d42465bb36c in this term.
I20260709 13:10:04.417627 12878 raft_consensus.cc:2468] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 16.
I20260709 13:10:04.458938 19820 leader_election.cc:290] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Requested vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:04.480662 19805 raft_consensus.cc:2749] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:04.463939 13486 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.481880 13486 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:04.483690 13486 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:04.484285 13486 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.484437 19754 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:04.487941 13487 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.489183 12881 raft_consensus.cc:2468] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 14.
W20260709 13:10:04.491156 13487 leader_election.cc:336] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.494257 12874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad96a33cd7224ee8980e6312e22ec951" candidate_uuid: "a865487bf1854df8a5619d42465bb36c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c45825bb09c34201b13ddcec07c4b3f1"
W20260709 13:10:04.497442 13486 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:04.516803 12874 raft_consensus.cc:3060] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.517649 13484 leader_election.cc:304] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.519078 19754 raft_consensus.cc:2804] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:04.519676 19754 raft_consensus.cc:697] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:10:04.520695 19754 consensus_queue.cc:237] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.529424 12874 raft_consensus.cc:2468] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a865487bf1854df8a5619d42465bb36c in term 17.
W20260709 13:10:04.536791 13487 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.537473 13487 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:04.538582 13487 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.550091 13487 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.539969 19816 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.552489 13484 leader_election.cc:304] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.554320 13484 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a865487bf1854df8a5619d42465bb36c, c45825bb09c34201b13ddcec07c4b3f1; no voters: 
I20260709 13:10:04.552942 13487 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:04.563048 13487 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.565636 19816 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:04.567417 13487 leader_election.cc:336] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:04.568565 13486 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:04.567881 19819 raft_consensus.cc:2804] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.569756 19819 raft_consensus.cc:697] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:10:04.570842 19819 consensus_queue.cc:237] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:04.574414 19833 raft_consensus.cc:2804] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:04.575095 19833 raft_consensus.cc:697] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Becoming Leader. State: Replica: a865487bf1854df8a5619d42465bb36c, State: Running, Role: LEADER
I20260709 13:10:04.576195 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
W20260709 13:10:04.576555 13486 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:04.576138 19833 consensus_queue.cc:237] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:04.580436 12848 leader_election.cc:336] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.581197 12848 leader_election.cc:304] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:04.588200 13484 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.594235 13484 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.602447 12848 leader_election.cc:336] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.603435 12848 leader_election.cc:304] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 83d2731c4bc049b3929d6c39670f5fd8, a865487bf1854df8a5619d42465bb36c
W20260709 13:10:04.609647 12848 leader_election.cc:336] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.610266 12848 leader_election.cc:304] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.610949 19830 raft_consensus.cc:2749] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.615357 19830 raft_consensus.cc:2749] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.615752 12630 catalog_manager.cc:5697] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.623076 19828 raft_consensus.cc:2749] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.654538 19828 raft_consensus.cc:493] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:04.655171 19828 raft_consensus.cc:515] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } }
I20260709 13:10:04.658929 19828 leader_election.cc:290] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:04.670210 12847 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:10:04.683822 12848 leader_election.cc:336] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:04.687592 12848 leader_election.cc:304] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45825bb09c34201b13ddcec07c4b3f1; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:04.690807 19805 raft_consensus.cc:2749] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.693046 12629 catalog_manager.cc:5697] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 15 to 16, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 16 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.695238 12629 catalog_manager.cc:5697] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 13 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 14 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.705430 12629 catalog_manager.cc:5697] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c reported cstate change: term changed from 16 to 17, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to a865487bf1854df8a5619d42465bb36c (127.11.78.4). New cstate: current_term: 17 leader_uuid: "a865487bf1854df8a5619d42465bb36c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.709050 12630 catalog_manager.cc:5697] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 13 to 14, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 14 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.710850 12630 catalog_manager.cc:5697] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 reported cstate change: term changed from 14 to 15, leader changed from 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2) to c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3). New cstate: current_term: 15 leader_uuid: "c45825bb09c34201b13ddcec07c4b3f1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:04.731307 13484 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.739051 13484 consensus_peers.cc:597] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.739945 13484 consensus_peers.cc:597] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.752404 13484 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.817981 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:04.819545 11576 tablet_replica.cc:333] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.820477 11576 raft_consensus.cc:2243] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.821568 11576 raft_consensus.cc:2272] T 0229d1c0cac14ba68f265bbecd5bf81b P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.821802 13484 consensus_peers.cc:597] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.823156 13484 consensus_peers.cc:597] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.823712 13484 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.830139 11576 tablet_replica.cc:333] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.831393 11576 raft_consensus.cc:2243] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.832223 11576 raft_consensus.cc:2272] T 226beb8cd35a475d90c160b1834a29b4 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.835413 11576 tablet_replica.cc:333] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.836444 11576 raft_consensus.cc:2243] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.838027 11576 pending_rounds.cc:70] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Trying to abort 1 pending ops.
I20260709 13:10:04.838374 11576 pending_rounds.cc:77] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305636267770724352 op_type: NO_OP noop_request { }
I20260709 13:10:04.838979 11576 raft_consensus.cc:2889] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:04.839417 11576 raft_consensus.cc:2272] T 49874df91d324eee9febcb540541383f P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.845100 11576 tablet_replica.cc:333] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.846043 11576 raft_consensus.cc:2243] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.847239 11576 raft_consensus.cc:2272] T 58d92b468aaa43eb88852feb36a41c17 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.850193 11576 tablet_replica.cc:333] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.851296 11576 raft_consensus.cc:2243] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.851929 11576 raft_consensus.cc:2272] T 3f17b4815ff84374bc9e1b330d886c34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.854827 11576 tablet_replica.cc:333] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.855696 11576 raft_consensus.cc:2243] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.856920 11576 raft_consensus.cc:2272] T e22c9d890e514419a9265ab93f02ad09 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.859772 11576 tablet_replica.cc:333] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.860663 11576 raft_consensus.cc:2243] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.861673 11576 raft_consensus.cc:2272] T ad96a33cd7224ee8980e6312e22ec951 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.864639 11576 tablet_replica.cc:333] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.865506 11576 raft_consensus.cc:2243] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:10:04.866535 13484 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.866654 11576 raft_consensus.cc:2272] T 2b39827c8d024243a5a2883bc2c2bd83 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.870500 11576 tablet_replica.cc:333] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.871536 11576 raft_consensus.cc:2243] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.872833 11576 raft_consensus.cc:2272] T 844a3ff085274442b304f06473e07511 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.876000 11576 tablet_replica.cc:333] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.876928 11576 raft_consensus.cc:2243] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.878206 11576 raft_consensus.cc:2272] T dff29d178e6c42cd8abcbd3d7747b77a P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.879622 13484 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.881441 11576 tablet_replica.cc:333] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.882501 11576 raft_consensus.cc:2243] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.883700 11576 raft_consensus.cc:2272] T 1dbc2136a4b642ca94a5ef49ef811508 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.887089 11576 tablet_replica.cc:333] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.888285 11576 raft_consensus.cc:2243] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.888979 11576 raft_consensus.cc:2272] T cc76143509f64c4faa68973765829aec P c45825bb09c34201b13ddcec07c4b3f1 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.892319 13487 consensus_peers.cc:597] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.892309 11576 tablet_replica.cc:333] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.893728 11576 raft_consensus.cc:2243] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.894652 11576 raft_consensus.cc:2272] T 2e6c7d6191794b6790622bf51bb289ee P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.897926 11576 tablet_replica.cc:333] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.898836 11576 raft_consensus.cc:2243] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.899766 11576 raft_consensus.cc:2272] T 9ba3f64a0226433382c2dc48213c8070 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.903185 11576 tablet_replica.cc:333] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.904134 11576 raft_consensus.cc:2243] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.904933 11576 raft_consensus.cc:2272] T 390c91265699487c943fe0217424eb34 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.905526 13484 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.908556 11576 tablet_replica.cc:333] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.909637 11576 raft_consensus.cc:2243] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.910058 13516 raft_consensus.cc:1275] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Refusing update from remote peer c45825bb09c34201b13ddcec07c4b3f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:04.910944 11576 raft_consensus.cc:2272] T 8631a18d7be543f29c587dad80ba4297 P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.913517 19828 consensus_queue.cc:1048] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:04.914250 11576 tablet_replica.cc:333] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.915347 11576 raft_consensus.cc:2243] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.916123 11576 raft_consensus.cc:2272] T bdd615dc3bb34a41801dd1dd2d6aa16e P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.919610 11576 tablet_replica.cc:333] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.920655 11576 raft_consensus.cc:2243] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.922060 11576 raft_consensus.cc:2272] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.925139 11576 tablet_replica.cc:333] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
W20260709 13:10:04.925319 13486 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:04.926030 11576 raft_consensus.cc:2243] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.927958 11576 raft_consensus.cc:2272] T 682296e424dc4d959d7dbe0c329fc149 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.931102 11576 tablet_replica.cc:333] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.931942 11576 raft_consensus.cc:2243] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.932619 11576 raft_consensus.cc:2272] T b16b34b3b4a04edca05d5f0f4a3ce868 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.935817 11576 tablet_replica.cc:333] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.936800 11576 raft_consensus.cc:2243] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.937963 11576 raft_consensus.cc:2272] T 2b86cb4a548944109bfb911e2b3a2591 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.941461 11576 tablet_replica.cc:333] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.942407 11576 raft_consensus.cc:2243] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.943209 11576 raft_consensus.cc:2272] T 96245329d8054ce88bb8c218f5069ede P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.946544 11576 tablet_replica.cc:333] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.947499 11576 raft_consensus.cc:2243] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.948654 11576 pending_rounds.cc:70] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Trying to abort 1 pending ops.
I20260709 13:10:04.948906 11576 pending_rounds.cc:77] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1: Aborting op as it isn't in flight: id { term: 15 index: 14 } timestamp: 7305636267871551488 op_type: NO_OP noop_request { }
I20260709 13:10:04.949277 11576 raft_consensus.cc:2889] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:04.949733 11576 raft_consensus.cc:2272] T b0e30b9fd61a41b294bf248bd704492b P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.955547 11576 tablet_replica.cc:333] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.956645 11576 raft_consensus.cc:2243] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.957906 11576 raft_consensus.cc:2272] T c3d9f69b18784243b7b412c0ea27e1f4 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.960750 11576 tablet_replica.cc:333] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.961632 11576 raft_consensus.cc:2243] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.962548 11576 raft_consensus.cc:2272] T 6e133c6f80354472a921214beecde238 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.965664 11576 tablet_replica.cc:333] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.966524 11576 raft_consensus.cc:2243] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.967150 11576 raft_consensus.cc:2272] T 88a5e3e97cfa425f9fb7a66612ed959b P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.970158 11576 tablet_replica.cc:333] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.971021 11576 raft_consensus.cc:2243] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.971670 11576 raft_consensus.cc:2272] T cc137392724a42a1a95e4a0543808c28 P c45825bb09c34201b13ddcec07c4b3f1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.972258 12848 consensus_peers.cc:597] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.974794 11576 tablet_replica.cc:333] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.975821 11576 raft_consensus.cc:2243] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.979321 11576 raft_consensus.cc:2272] T 250e6770457a4cb087d4ea1e4af49b0d P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.982620 11576 tablet_replica.cc:333] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:04.983484 11576 raft_consensus.cc:2243] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.984117 11576 raft_consensus.cc:2272] T 4a839b697aea46da87cb69b00515389e P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.986985 11576 tablet_replica.cc:333] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
W20260709 13:10:04.987586 13486 consensus_peers.cc:597] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:04.988497 12847 consensus_peers.cc:597] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:04.987818 11576 raft_consensus.cc:2243] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.989494 11576 raft_consensus.cc:2272] T cd420c179d854f04989e23d8e19b0505 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.990624 13484 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.991130 13487 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.003798 11576 tablet_replica.cc:333] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.004961 11576 raft_consensus.cc:2243] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.006899 11576 raft_consensus.cc:2272] T d4c62986a26c4716a060e64c82e8f5a7 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.010496 11576 tablet_replica.cc:333] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.011353 11576 raft_consensus.cc:2243] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.012468 11576 raft_consensus.cc:2272] T f7402969d1144da9a4a218d0c90ba138 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.015223 11576 tablet_replica.cc:333] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.016024 11576 raft_consensus.cc:2243] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.017133 11576 pending_rounds.cc:70] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Trying to abort 1 pending ops.
I20260709 13:10:05.017433 11576 pending_rounds.cc:77] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305636267775074304 op_type: NO_OP noop_request { }
I20260709 13:10:05.017838 11576 raft_consensus.cc:2889] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:05.018237 11576 raft_consensus.cc:2272] T eb5990f0ee644c48952ecb885d6a405b P c45825bb09c34201b13ddcec07c4b3f1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.020560 13487 consensus_peers.cc:597] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.025959 12847 consensus_peers.cc:597] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:05.026727 11576 tablet_replica.cc:333] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.027563 11576 raft_consensus.cc:2243] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.028725 11576 raft_consensus.cc:2272] T f21936f5afa14460a22306512f82c201 P c45825bb09c34201b13ddcec07c4b3f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.031868 11576 tablet_replica.cc:333] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.032653 11576 raft_consensus.cc:2243] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.033852 11576 raft_consensus.cc:2272] T b6e93451194c4f75b90838546e466fe0 P c45825bb09c34201b13ddcec07c4b3f1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.040056 12847 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:05.040172 11576 tablet_replica.cc:333] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.041224 11576 raft_consensus.cc:2243] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.042534 11576 raft_consensus.cc:2272] T d8dc6ee27c224540914eb4905a44b4f1 P c45825bb09c34201b13ddcec07c4b3f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.045580 11576 tablet_replica.cc:333] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.046376 11576 raft_consensus.cc:2243] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.047709 11576 raft_consensus.cc:2272] T 2226e1c2db5f441197fe25690778db23 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.048991 12848 consensus_peers.cc:597] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.052214 11576 tablet_replica.cc:333] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.053174 11576 raft_consensus.cc:2243] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.053829 11576 raft_consensus.cc:2272] T 098bf8b9f16c41adb5871161f995c638 P c45825bb09c34201b13ddcec07c4b3f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.057420 11576 tablet_replica.cc:333] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.058161 11576 raft_consensus.cc:2243] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.059304 11576 raft_consensus.cc:2272] T 5df6c334df7c492f88316fe7c569e7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.062956 11576 tablet_replica.cc:333] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.063614 11576 raft_consensus.cc:2243] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.064646 11576 raft_consensus.cc:2272] T 3e64952f9027442eb482fbc10cf426fe P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.067032 11576 tablet_replica.cc:333] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.067718 11576 raft_consensus.cc:2243] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.068331 11576 raft_consensus.cc:2272] T e76bdc6d77354bafb6cab7951596cb2a P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.070919 11576 tablet_replica.cc:333] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.071789 11576 raft_consensus.cc:2243] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.072993 11576 raft_consensus.cc:2272] T c227f9d3821443ccaf06901b122c4591 P c45825bb09c34201b13ddcec07c4b3f1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.075712 11576 tablet_replica.cc:333] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.076496 11576 raft_consensus.cc:2243] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.078292 11576 raft_consensus.cc:2272] T ea332acd0f07405e95b83103a4876e08 P c45825bb09c34201b13ddcec07c4b3f1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.080643 13484 consensus_peers.cc:597] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.080785 11576 tablet_replica.cc:333] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.082167 11576 raft_consensus.cc:2243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.082808 11576 raft_consensus.cc:2272] T 8d9ae3e4f0c340f180826fd03f63f7e4 P c45825bb09c34201b13ddcec07c4b3f1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.085420 11576 tablet_replica.cc:333] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1: stopping tablet replica
I20260709 13:10:05.086004 11576 raft_consensus.cc:2243] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.086517 11576 raft_consensus.cc:2272] T 281969f368e74705b0bebd5eaacc1e39 P c45825bb09c34201b13ddcec07c4b3f1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.106971 13484 consensus_peers.cc:597] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.122237 13484 consensus_peers.cc:597] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c -> Peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Couldn't send request to peer c45825bb09c34201b13ddcec07c4b3f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.125308 13487 consensus_peers.cc:597] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.190651 13487 consensus_peers.cc:597] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.206497 13487 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.240382 13487 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.264734 13487 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.333528 13487 consensus_peers.cc:597] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.364398 13487 consensus_peers.cc:597] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.564953 13486 consensus_peers.cc:597] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:05.565424 13487 consensus_peers.cc:597] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.572312 13487 consensus_peers.cc:597] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.617956 13487 consensus_peers.cc:597] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c -> Peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Couldn't send request to peer 83d2731c4bc049b3929d6c39670f5fd8. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.628687 13486 consensus_peers.cc:597] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:05.899463 19787 raft_consensus.cc:493] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:05.900825 19787 raft_consensus.cc:515] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:05.903751 19787 leader_election.cc:290] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:05.910246 13487 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:05.911259 13486 leader_election.cc:336] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:05.912663 13486 leader_election.cc:304] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:05.913563 19787 raft_consensus.cc:2749] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:05.918165 13486 consensus_peers.cc:597] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:06.043215 19843 raft_consensus.cc:493] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.044219 19843 raft_consensus.cc:515] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.046886 19843 leader_election.cc:290] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:06.052511 13487 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.054932 13486 leader_election.cc:336] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.055461 13486 leader_election.cc:304] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:06.056246 19787 raft_consensus.cc:2749] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:06.057273 19787 raft_consensus.cc:493] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.058086 19787 raft_consensus.cc:515] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:06.058431 13486 consensus_peers.cc:597] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:06.064337 19787 leader_election.cc:290] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.064895 13487 leader_election.cc:336] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.065555 13484 leader_election.cc:336] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.065994 13484 leader_election.cc:304] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.066805 19787 raft_consensus.cc:2749] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:06.070020 19787 raft_consensus.cc:493] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.071408 19787 raft_consensus.cc:515] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } attrs { replace: true } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.077569 19787 leader_election.cc:290] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.080222 13484 leader_election.cc:336] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
W20260709 13:10:06.083220 13486 leader_election.cc:336] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.083734 13486 leader_election.cc:304] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.084839 19787 raft_consensus.cc:2749] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:06.088862 13487 leader_election.cc:336] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.093077 13486 consensus_peers.cc:597] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:06.147521 13486 consensus_peers.cc:597] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:06.150347 19787 raft_consensus.cc:493] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.151211 19787 raft_consensus.cc:515] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.153388 19787 leader_election.cc:290] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:06.158051 19843 raft_consensus.cc:493] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.158842 19843 raft_consensus.cc:515] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:06.160105 13487 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.161093 19843 leader_election.cc:290] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:06.161943 13484 leader_election.cc:336] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.162809 19843 raft_consensus.cc:493] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.165241 13484 leader_election.cc:304] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.166224 19787 raft_consensus.cc:2749] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.165972 19843 raft_consensus.cc:515] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.167974 19787 raft_consensus.cc:493] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.168968 19787 raft_consensus.cc:515] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } attrs { replace: true } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.171870 19787 leader_election.cc:290] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:06.175321 19787 raft_consensus.cc:493] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.176088 19787 raft_consensus.cc:515] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.177948 19787 leader_election.cc:290] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.171818 13487 leader_election.cc:336] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.169320 19843 leader_election.cc:290] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.180955 13487 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.185348 13486 leader_election.cc:336] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.186167 13486 leader_election.cc:304] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:06.187809 13487 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.189985 19843 raft_consensus.cc:2749] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:06.197755 13484 leader_election.cc:336] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.198386 13484 leader_election.cc:304] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.199925 19844 raft_consensus.cc:2749] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:06.199479 13484 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.201373 13484 leader_election.cc:304] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:10:06.202268 13484 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.202346 19843 raft_consensus.cc:2749] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:06.202669 13486 leader_election.cc:336] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.207762 19843 raft_consensus.cc:493] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.208634 19843 raft_consensus.cc:515] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:06.210474 13486 leader_election.cc:336] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.210927 13486 leader_election.cc:304] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.211212 19843 leader_election.cc:290] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:06.212327 19844 raft_consensus.cc:2749] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:06.217154 13484 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
W20260709 13:10:06.219129 13486 leader_election.cc:336] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.219621 13486 leader_election.cc:304] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.220435 19843 raft_consensus.cc:2749] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:06.226348 13486 consensus_peers.cc:597] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:06.238484 13486 consensus_peers.cc:597] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:06.240134 19843 raft_consensus.cc:493] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.240963 19843 raft_consensus.cc:515] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.247452 19843 leader_election.cc:290] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:06.248495 13487 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.256665 13486 leader_election.cc:336] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.257131 13486 leader_election.cc:304] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:06.257836 19843 raft_consensus.cc:2749] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:06.259931 19844 raft_consensus.cc:493] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.261050 19844 raft_consensus.cc:515] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.259506 19843 raft_consensus.cc:493] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.263047 19843 raft_consensus.cc:515] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.263557 19844 leader_election.cc:290] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:06.265363 19843 leader_election.cc:290] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
I20260709 13:10:06.267468 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:10:06.271456 19844 raft_consensus.cc:493] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.272296 19844 raft_consensus.cc:515] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.274829 19844 leader_election.cc:290] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.275616 13487 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.276392 13487 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.278388 13486 leader_election.cc:336] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.283589 13486 leader_election.cc:304] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
W20260709 13:10:06.284067 13487 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.285068 19843 raft_consensus.cc:2749] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:06.285693 13484 leader_election.cc:336] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.286387 13484 leader_election.cc:304] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
W20260709 13:10:06.287387 13486 leader_election.cc:336] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.287982 19843 raft_consensus.cc:2749] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.288007 13486 leader_election.cc:304] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:06.290403 19843 raft_consensus.cc:2749] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:06.299456 19843 raft_consensus.cc:493] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.300815 19843 raft_consensus.cc:515] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.306957 19843 leader_election.cc:290] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
I20260709 13:10:06.308007 19844 raft_consensus.cc:493] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.308939 19844 raft_consensus.cc:515] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.311769 19844 leader_election.cc:290] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.312088 13486 leader_election.cc:336] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
W20260709 13:10:06.316614 13484 leader_election.cc:336] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.317221 13484 leader_election.cc:304] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.319725 19843 raft_consensus.cc:2749] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:06.320680 13484 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
W20260709 13:10:06.322904 13487 leader_election.cc:336] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.323453 13487 leader_election.cc:304] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.324419 19843 raft_consensus.cc:2749] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.326858 19843 raft_consensus.cc:493] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.327766 19843 raft_consensus.cc:515] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.330843 19843 leader_election.cc:290] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.336771 13484 leader_election.cc:336] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
W20260709 13:10:06.337598 13487 leader_election.cc:336] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.338142 13487 leader_election.cc:304] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.339052 19843 raft_consensus.cc:2749] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:06.376883 13486 consensus_peers.cc:597] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:06.418113 19843 raft_consensus.cc:493] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.419206 19843 raft_consensus.cc:515] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.422662 19843 leader_election.cc:290] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.427548 13484 leader_election.cc:336] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
W20260709 13:10:06.430392 13487 leader_election.cc:336] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.431005 13487 leader_election.cc:304] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.431988 19843 raft_consensus.cc:2749] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:06.436758 19843 raft_consensus.cc:493] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45825bb09c34201b13ddcec07c4b3f1)
I20260709 13:10:06.437834 19843 raft_consensus.cc:515] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "c45825bb09c34201b13ddcec07c4b3f1" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 36899 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
W20260709 13:10:06.448719 13487 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
I20260709 13:10:06.450269 19843 leader_election.cc:290] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791), c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899)
W20260709 13:10:06.459739 13484 leader_election.cc:336] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c45825bb09c34201b13ddcec07c4b3f1 (127.11.78.3:36899): Network error: Client connection negotiation failed: client connection to 127.11.78.3:36899: connect: Connection refused (error 111)
I20260709 13:10:06.460453 13484 leader_election.cc:304] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 83d2731c4bc049b3929d6c39670f5fd8, c45825bb09c34201b13ddcec07c4b3f1
I20260709 13:10:06.462502 19787 raft_consensus.cc:2749] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:06.477324 13486 consensus_peers.cc:597] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:06.479729 13486 consensus_peers.cc:597] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:06.491878 11576 tablet_server.cc:179] TabletServer@127.11.78.4:0 shutting down...
W20260709 13:10:06.533591 13486 consensus_peers.cc:597] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c -> Peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Couldn't send request to peer 72d06460bb5d4ccdbd4edbda8b9a1d63. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:06.548368 19843 raft_consensus.cc:493] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 83d2731c4bc049b3929d6c39670f5fd8)
I20260709 13:10:06.549336 19843 raft_consensus.cc:515] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "72d06460bb5d4ccdbd4edbda8b9a1d63" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36161 } } peers { permanent_uuid: "83d2731c4bc049b3929d6c39670f5fd8" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 36791 } } peers { permanent_uuid: "a865487bf1854df8a5619d42465bb36c" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 40809 } attrs { promote: false } }
I20260709 13:10:06.553627 19843 leader_election.cc:290] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161), 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791)
W20260709 13:10:06.565241 13487 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 83d2731c4bc049b3929d6c39670f5fd8 (127.11.78.2:36791): Network error: Client connection negotiation failed: client connection to 127.11.78.2:36791: connect: Connection refused (error 111)
W20260709 13:10:06.566427 13486 leader_election.cc:336] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:06.566965 13486 leader_election.cc:304] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a865487bf1854df8a5619d42465bb36c; no voters: 72d06460bb5d4ccdbd4edbda8b9a1d63, 83d2731c4bc049b3929d6c39670f5fd8
I20260709 13:10:06.568226 19843 raft_consensus.cc:2749] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:06.584081 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.585109 11576 tablet_replica.cc:333] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.586404 11576 raft_consensus.cc:2243] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.587395 11576 raft_consensus.cc:2272] T 9ba3f64a0226433382c2dc48213c8070 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.590700 11576 tablet_replica.cc:333] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.591691 11576 raft_consensus.cc:2243] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.592883 11576 raft_consensus.cc:2272] T 2226e1c2db5f441197fe25690778db23 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.595999 11576 tablet_replica.cc:333] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.596939 11576 raft_consensus.cc:2243] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.597630 11576 raft_consensus.cc:2272] T 682296e424dc4d959d7dbe0c329fc149 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.600680 11576 tablet_replica.cc:333] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.601423 11576 raft_consensus.cc:2243] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.603224 11576 raft_consensus.cc:2272] T 433127d30b7c4bdf91cac2059c29a3f5 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.607209 11576 tablet_replica.cc:333] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.608274 11576 raft_consensus.cc:2243] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.609913 11576 pending_rounds.cc:70] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Trying to abort 1 pending ops.
I20260709 13:10:06.610215 11576 pending_rounds.cc:77] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305636268127821824 op_type: NO_OP noop_request { }
I20260709 13:10:06.610822 11576 raft_consensus.cc:2889] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.611212 11576 raft_consensus.cc:2272] T 2b86cb4a548944109bfb911e2b3a2591 P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.614595 11576 tablet_replica.cc:333] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.615474 11576 raft_consensus.cc:2243] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.616529 11576 raft_consensus.cc:2272] T b0e30b9fd61a41b294bf248bd704492b P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.620483 11576 tablet_replica.cc:333] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.621313 11576 raft_consensus.cc:2243] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.623179 11576 raft_consensus.cc:2272] T 96245329d8054ce88bb8c218f5069ede P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.626128 11576 tablet_replica.cc:333] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.626830 11576 raft_consensus.cc:2243] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.627828 11576 pending_rounds.cc:70] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Trying to abort 1 pending ops.
I20260709 13:10:06.628090 11576 pending_rounds.cc:77] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c: Aborting op as it isn't in flight: id { term: 17 index: 14 } timestamp: 7305636267102756864 op_type: NO_OP noop_request { }
I20260709 13:10:06.628409 11576 raft_consensus.cc:2889] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.628750 11576 raft_consensus.cc:2272] T b16b34b3b4a04edca05d5f0f4a3ce868 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.632400 11576 tablet_replica.cc:333] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.633213 11576 raft_consensus.cc:2243] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.634572 11576 raft_consensus.cc:2272] T 8631a18d7be543f29c587dad80ba4297 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.637849 11576 tablet_replica.cc:333] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.638525 11576 raft_consensus.cc:2243] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.639663 11576 raft_consensus.cc:2272] T 140b233442844af3b88e29b40d4f25ad P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.642398 11576 tablet_replica.cc:333] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.643158 11576 raft_consensus.cc:2243] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.644908 11576 raft_consensus.cc:2272] T 0229d1c0cac14ba68f265bbecd5bf81b P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.647689 11576 tablet_replica.cc:333] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.648386 11576 raft_consensus.cc:2243] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.649248 11576 raft_consensus.cc:2272] T 49874df91d324eee9febcb540541383f P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.652132 11576 tablet_replica.cc:333] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.652879 11576 raft_consensus.cc:2243] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.654539 11576 raft_consensus.cc:2272] T 6e133c6f80354472a921214beecde238 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.658181 11576 tablet_replica.cc:333] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.658864 11576 raft_consensus.cc:2243] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.659922 11576 raft_consensus.cc:2272] T cd420c179d854f04989e23d8e19b0505 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.662628 11576 tablet_replica.cc:333] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.663314 11576 raft_consensus.cc:2243] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.664283 11576 raft_consensus.cc:2272] T f7402969d1144da9a4a218d0c90ba138 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.666847 11576 tablet_replica.cc:333] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.667495 11576 raft_consensus.cc:2243] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.668099 11576 pending_rounds.cc:70] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Trying to abort 1 pending ops.
I20260709 13:10:06.668385 11576 pending_rounds.cc:77] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305636267775074304 op_type: NO_OP noop_request { }
I20260709 13:10:06.668689 11576 raft_consensus.cc:2889] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.668967 11576 raft_consensus.cc:2272] T eb5990f0ee644c48952ecb885d6a405b P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.671166 11576 tablet_replica.cc:333] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.671768 11576 raft_consensus.cc:2243] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.672899 11576 raft_consensus.cc:2272] T 9b483b06f72a4b6e863293d4c6099849 P a865487bf1854df8a5619d42465bb36c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.675604 11576 tablet_replica.cc:333] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.676543 11576 raft_consensus.cc:2243] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.677160 11576 raft_consensus.cc:2272] T c7d64be8779a42e0ad6540bfa7067f2b P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.680649 11576 tablet_replica.cc:333] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.681449 11576 raft_consensus.cc:2243] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.682601 11576 raft_consensus.cc:2272] T 390c91265699487c943fe0217424eb34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.686021 11576 tablet_replica.cc:333] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.686753 11576 raft_consensus.cc:2243] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.687959 11576 raft_consensus.cc:2272] T 2d23a1e845884d5e9ad733d5579dcf30 P a865487bf1854df8a5619d42465bb36c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.690198 11576 tablet_replica.cc:333] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.690811 11576 raft_consensus.cc:2243] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.691814 11576 raft_consensus.cc:2272] T f21936f5afa14460a22306512f82c201 P a865487bf1854df8a5619d42465bb36c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.694509 11576 tablet_replica.cc:333] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.695089 11576 raft_consensus.cc:2243] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.695967 11576 raft_consensus.cc:2272] T e6a3cae9c8f5497a965082c096899998 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.698727 11576 tablet_replica.cc:333] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.699301 11576 raft_consensus.cc:2243] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.700304 11576 raft_consensus.cc:2272] T fb04297576e2483ca596edd2dd418b52 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.702584 11576 tablet_replica.cc:333] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.703161 11576 raft_consensus.cc:2243] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.704234 11576 raft_consensus.cc:2272] T 4a839b697aea46da87cb69b00515389e P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.706743 11576 tablet_replica.cc:333] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.707356 11576 raft_consensus.cc:2243] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.708751 11576 pending_rounds.cc:70] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Trying to abort 1 pending ops.
I20260709 13:10:06.708995 11576 pending_rounds.cc:77] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c: Aborting op as it isn't in flight: id { term: 17 index: 12 } timestamp: 7305636268439707648 op_type: NO_OP noop_request { }
I20260709 13:10:06.709276 11576 raft_consensus.cc:2889] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.709589 11576 raft_consensus.cc:2272] T ad96a33cd7224ee8980e6312e22ec951 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.712427 11576 tablet_replica.cc:333] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.712996 11576 raft_consensus.cc:2243] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.713864 11576 raft_consensus.cc:2272] T e81eeec454b94074a55f46a651353f9e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.716292 11576 tablet_replica.cc:333] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.716878 11576 raft_consensus.cc:2243] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.717634 11576 raft_consensus.cc:2272] T c36078b972bc46fe827c12e1015e239d P a865487bf1854df8a5619d42465bb36c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.720129 11576 tablet_replica.cc:333] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.720783 11576 raft_consensus.cc:2243] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.721757 11576 pending_rounds.cc:70] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Trying to abort 1 pending ops.
I20260709 13:10:06.721988 11576 pending_rounds.cc:77] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305636268440297472 op_type: NO_OP noop_request { }
I20260709 13:10:06.722268 11576 raft_consensus.cc:2889] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.722548 11576 raft_consensus.cc:2272] T 226beb8cd35a475d90c160b1834a29b4 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.724970 11576 tablet_replica.cc:333] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.725539 11576 raft_consensus.cc:2243] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.726845 11576 raft_consensus.cc:2272] T 28ea7c094d994eea9ec8090103d1142e P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.730214 11576 tablet_replica.cc:333] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.730895 11576 raft_consensus.cc:2243] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.731981 11576 raft_consensus.cc:2272] T 21f97de57a4f4bf7a4ac5fde6b3bc613 P a865487bf1854df8a5619d42465bb36c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.735001 11576 tablet_replica.cc:333] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.735554 11576 raft_consensus.cc:2243] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.736482 11576 raft_consensus.cc:2272] T 88a5e3e97cfa425f9fb7a66612ed959b P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.738545 11576 tablet_replica.cc:333] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.739123 11576 raft_consensus.cc:2243] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.740100 11576 raft_consensus.cc:2272] T 8d9ae3e4f0c340f180826fd03f63f7e4 P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.741905 11576 tablet_replica.cc:333] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.742398 11576 raft_consensus.cc:2243] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.742895 11576 raft_consensus.cc:2272] T 3e64952f9027442eb482fbc10cf426fe P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.744820 11576 tablet_replica.cc:333] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.745589 11576 raft_consensus.cc:2243] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.746392 11576 raft_consensus.cc:2272] T dff29d178e6c42cd8abcbd3d7747b77a P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.749377 11576 tablet_replica.cc:333] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.750092 11576 raft_consensus.cc:2243] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.751053 11576 raft_consensus.cc:2272] T 2b39827c8d024243a5a2883bc2c2bd83 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.753655 11576 tablet_replica.cc:333] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.754184 11576 raft_consensus.cc:2243] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.755347 11576 raft_consensus.cc:2272] T f4dc74d6c2504bad83ab3be06d6255c9 P a865487bf1854df8a5619d42465bb36c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.757661 11576 tablet_replica.cc:333] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.758181 11576 raft_consensus.cc:2243] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.759142 11576 raft_consensus.cc:2272] T 3f17b4815ff84374bc9e1b330d886c34 P a865487bf1854df8a5619d42465bb36c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.761370 11576 tablet_replica.cc:333] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.761883 11576 raft_consensus.cc:2243] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.762730 11576 raft_consensus.cc:2272] T a18b1e83629843e7991a12a0e6370ca7 P a865487bf1854df8a5619d42465bb36c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.764791 11576 tablet_replica.cc:333] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.765386 11576 raft_consensus.cc:2243] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.766150 11576 raft_consensus.cc:2272] T 844a3ff085274442b304f06473e07511 P a865487bf1854df8a5619d42465bb36c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.768767 11576 tablet_replica.cc:333] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.769294 11576 raft_consensus.cc:2243] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.770272 11576 raft_consensus.cc:2272] T 098bf8b9f16c41adb5871161f995c638 P a865487bf1854df8a5619d42465bb36c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.772321 11576 tablet_replica.cc:333] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.772873 11576 raft_consensus.cc:2243] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.773733 11576 raft_consensus.cc:2272] T d985ce4f59254503949afda97665ffd4 P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.775889 11576 tablet_replica.cc:333] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.776417 11576 raft_consensus.cc:2243] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.776953 11576 raft_consensus.cc:2272] T 562422a4dc1a44a7bca3a549839874be P a865487bf1854df8a5619d42465bb36c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.778892 11576 tablet_replica.cc:333] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.779356 11576 raft_consensus.cc:2243] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.780257 11576 raft_consensus.cc:2272] T cc76143509f64c4faa68973765829aec P a865487bf1854df8a5619d42465bb36c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.782229 11576 tablet_replica.cc:333] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c: stopping tablet replica
I20260709 13:10:06.782709 11576 raft_consensus.cc:2243] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.783638 11576 raft_consensus.cc:2272] T bdd615dc3bb34a41801dd1dd2d6aa16e P a865487bf1854df8a5619d42465bb36c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.063052 11576 tablet_server.cc:196] TabletServer@127.11.78.4:0 shutdown complete.
I20260709 13:10:07.152420 11576 master.cc:562] Master@127.11.78.62:43083 shutting down...
W20260709 13:10:07.201282 12679 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:10:07.201603 12679 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:07.201887 12679 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:20.191495 12617 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111) [suppressed 549 similar messages]
W20260709 13:10:20.195415 12617 catalog_manager.cc:4755] TS 72d06460bb5d4ccdbd4edbda8b9a1d63 (127.11.78.1:36161): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2226e1c2db5f441197fe25690778db23: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36161: connect: Connection refused (error 111)
I20260709 13:10:20.820722 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.822173 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.822599 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P d95a6396e3d84f5fb98713ce86e01813: stopping tablet replica
I20260709 13:10:21.057472 11576 master.cc:584] Master@127.11.78.62:43083 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (249334 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:10:21.187213 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:45221
I20260709 13:10:21.188851 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.197126 19849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.197288 19848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.198698 19851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.199227 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:21.202622 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.202910 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.203120 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602621203099 us; error 0 us; skew 500 ppm
I20260709 13:10:21.203702 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.206688 11576 webserver.cc:533] Webserver started at http://127.11.78.62:44183/ using document root <none> and password file <none>
I20260709 13:10:21.207602 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.207890 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.208271 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.209925 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "3502d846919542858dce16a7f3cc577b"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.215188 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:21.219117 19856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.220309 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:21.220710 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "3502d846919542858dce16a7f3cc577b"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.221031 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.238895 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.240394 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.293258 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:45221
I20260709 13:10:21.293632 19907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:45221 every 8 connection(s)
I20260709 13:10:21.298038 19908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.313925 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b: Bootstrap starting.
I20260709 13:10:21.319749 19908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.325268 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b: No bootstrap required, opened a new log
I20260709 13:10:21.327992 19908 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER }
I20260709 13:10:21.328565 19908 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.328850 19908 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3502d846919542858dce16a7f3cc577b, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.329555 19908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER }
I20260709 13:10:21.330192 19908 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:21.330423 19908 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:21.330767 19908 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.337308 19908 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER }
I20260709 13:10:21.338143 19908 leader_election.cc:304] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3502d846919542858dce16a7f3cc577b; no voters: 
I20260709 13:10:21.339658 19908 leader_election.cc:290] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:21.340169 19911 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.341886 19911 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 1 LEADER]: Becoming Leader. State: Replica: 3502d846919542858dce16a7f3cc577b, State: Running, Role: LEADER
I20260709 13:10:21.342872 19911 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER }
I20260709 13:10:21.344254 19908 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:21.350579 19912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3502d846919542858dce16a7f3cc577b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER } }
I20260709 13:10:21.351562 19912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.351763 19913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3502d846919542858dce16a7f3cc577b. Latest consensus state: current_term: 1 leader_uuid: "3502d846919542858dce16a7f3cc577b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3502d846919542858dce16a7f3cc577b" member_type: VOTER } }
I20260709 13:10:21.353086 19913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.353875 19918 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:21.359795 19918 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:21.373636 19918 catalog_manager.cc:1383] Generated new cluster ID: 02fbd212cf29483481326146f3b20967
I20260709 13:10:21.374070 19918 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:21.374121 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:21.412220 19918 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:21.413826 19918 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:21.437320 19918 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b: Generated new TSK 0
I20260709 13:10:21.438025 19918 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:21.506290 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.513453 19929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.514920 19930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.516695 19932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.518493 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:21.521277 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.521500 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.521718 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602621521679 us; error 0 us; skew 500 ppm
I20260709 13:10:21.522326 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.525585 11576 webserver.cc:533] Webserver started at http://127.11.78.1:37789/ using document root <none> and password file <none>
I20260709 13:10:21.526118 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.526324 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.526623 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.528388 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.534009 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:21.538113 19937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.539466 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:21.539917 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.540340 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.556963 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.558236 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.559980 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.562582 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.562820 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.563087 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.563288 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.612287 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:42127
I20260709 13:10:21.612457 19999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:42127 every 8 connection(s)
I20260709 13:10:21.617584 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.626488 20004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.627677 20005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.632450 20007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.633234 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:21.636245 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.636473 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.636706 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602621636688 us; error 0 us; skew 500 ppm
I20260709 13:10:21.637434 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.637562 20000 heartbeater.cc:344] Connected to a master server at 127.11.78.62:45221
I20260709 13:10:21.638106 20000 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:21.639052 20000 heartbeater.cc:507] Master 127.11.78.62:45221 requested a full tablet report, sending...
I20260709 13:10:21.640472 11576 webserver.cc:533] Webserver started at http://127.11.78.2:46039/ using document root <none> and password file <none>
I20260709 13:10:21.641203 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.641441 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.641776 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.641917 19873 ts_manager.cc:194] Registered new tserver with Master: e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:21.643404 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.644627 19873 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47274
I20260709 13:10:21.649125 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:10:21.652962 20012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.653837 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:10:21.654127 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.654392 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.677134 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.678354 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.679949 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.682436 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.682636 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.682938 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.683110 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.737672 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:35489
I20260709 13:10:21.737865 20074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:35489 every 8 connection(s)
I20260709 13:10:21.742962 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.751132 20078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.754941 20079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.755196 11576 server_base.cc:1061] running on GCE node
W20260709 13:10:21.755556 20081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.757237 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.757537 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.757782 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602621757750 us; error 0 us; skew 500 ppm
I20260709 13:10:21.758599 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.760180 20075 heartbeater.cc:344] Connected to a master server at 127.11.78.62:45221
I20260709 13:10:21.760735 20075 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:21.761720 20075 heartbeater.cc:507] Master 127.11.78.62:45221 requested a full tablet report, sending...
I20260709 13:10:21.762218 11576 webserver.cc:533] Webserver started at http://127.11.78.3:36235/ using document root <none> and password file <none>
I20260709 13:10:21.762928 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.763186 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.763521 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.764588 19873 ts_manager.cc:194] Registered new tserver with Master: af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:21.765547 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "b112290c0b6e4aa08967a0350cf4b215"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.766942 19873 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47290
I20260709 13:10:21.771756 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:10:21.776322 20086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.777370 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:21.777773 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "b112290c0b6e4aa08967a0350cf4b215"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.778107 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.798128 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.799675 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.801545 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.804262 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.804520 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.804853 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.805007 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.857447 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:45445
I20260709 13:10:21.857522 20148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:45445 every 8 connection(s)
I20260709 13:10:21.863261 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.871922 20152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.873399 20153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.876503 20149 heartbeater.cc:344] Connected to a master server at 127.11.78.62:45221
I20260709 13:10:21.877077 20149 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:21.877786 20155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.878053 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:21.878213 20149 heartbeater.cc:507] Master 127.11.78.62:45221 requested a full tablet report, sending...
I20260709 13:10:21.879405 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.879683 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.879941 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602621879918 us; error 0 us; skew 500 ppm
I20260709 13:10:21.880759 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.881160 19873 ts_manager.cc:194] Registered new tserver with Master: b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:21.883035 19873 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47300
I20260709 13:10:21.883728 11576 webserver.cc:533] Webserver started at http://127.11.78.4:45763/ using document root <none> and password file <none>
I20260709 13:10:21.884543 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.884806 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.885177 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.886519 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-3-root/instance:
uuid: "9e3242b28df94215893da755f099a6e2"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.891459 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:21.895267 20160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.896389 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:21.896845 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
uuid: "9e3242b28df94215893da755f099a6e2"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:21.897185 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.922806 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.924480 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.926443 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.929090 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.929344 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.929611 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.929818 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.986456 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.4:46123
I20260709 13:10:21.986568 20222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.4:46123 every 8 connection(s)
I20260709 13:10:22.004336 20223 heartbeater.cc:344] Connected to a master server at 127.11.78.62:45221
I20260709 13:10:22.004792 20223 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.005761 20223 heartbeater.cc:507] Master 127.11.78.62:45221 requested a full tablet report, sending...
I20260709 13:10:22.007926 19873 ts_manager.cc:194] Registered new tserver with Master: 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:22.008783 11576 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018013683s
I20260709 13:10:22.009763 19873 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47312
I20260709 13:10:22.040732 19873 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47314:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:10:22.311400 20039 tablet_service.cc:1511] Processing CreateTablet for tablet cd2390af31254060951179e822c53383 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.312827 20038 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd3c2ff5d348dd9b5baa2b04163b97 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.313733 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2390af31254060951179e822c53383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.311470 20040 tablet_service.cc:1511] Processing CreateTablet for tablet 965320aa73c0442fab090a329cb3f3d4 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.316282 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965320aa73c0442fab090a329cb3f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.317366 20114 tablet_service.cc:1511] Processing CreateTablet for tablet 965320aa73c0442fab090a329cb3f3d4 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.318866 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965320aa73c0442fab090a329cb3f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.319299 19965 tablet_service.cc:1511] Processing CreateTablet for tablet 965320aa73c0442fab090a329cb3f3d4 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.320570 20038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd3c2ff5d348dd9b5baa2b04163b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.321103 19965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965320aa73c0442fab090a329cb3f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.324597 20113 tablet_service.cc:1511] Processing CreateTablet for tablet c021951a7255405393cb29fc326c0791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.326128 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c021951a7255405393cb29fc326c0791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.328900 20112 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd3c2ff5d348dd9b5baa2b04163b97 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.330408 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd3c2ff5d348dd9b5baa2b04163b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.335011 19964 tablet_service.cc:1511] Processing CreateTablet for tablet cd2390af31254060951179e822c53383 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.336714 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2390af31254060951179e822c53383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.338441 20037 tablet_service.cc:1511] Processing CreateTablet for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.340204 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.341195 20111 tablet_service.cc:1511] Processing CreateTablet for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.343072 20111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.346308 20036 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3013974914421182c82eaf339e22cc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.347929 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3013974914421182c82eaf339e22cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.350152 20110 tablet_service.cc:1511] Processing CreateTablet for tablet d813cf323225419f955c3efdae688a83 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.352111 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d813cf323225419f955c3efdae688a83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:22.361294 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:22.366321 20035 tablet_service.cc:1511] Processing CreateTablet for tablet eac9c02fc91043da80c23156c017b264 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.368198 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9c02fc91043da80c23156c017b264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.368908 20109 tablet_service.cc:1511] Processing CreateTablet for tablet eac9c02fc91043da80c23156c017b264 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.370445 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9c02fc91043da80c23156c017b264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.374269 20034 tablet_service.cc:1511] Processing CreateTablet for tablet a213a8358e61477cac2ad10e043ba2bb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.377444 19963 tablet_service.cc:1511] Processing CreateTablet for tablet c021951a7255405393cb29fc326c0791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.378374 20108 tablet_service.cc:1511] Processing CreateTablet for tablet a213a8358e61477cac2ad10e043ba2bb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.379067 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c021951a7255405393cb29fc326c0791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.379838 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a213a8358e61477cac2ad10e043ba2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.375926 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a213a8358e61477cac2ad10e043ba2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.424918 20242 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:22.420902 20040 tablet_service.cc:1511] Processing CreateTablet for tablet 2f32b127d2f647c8b07a07d61f643bdf (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.427850 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f32b127d2f647c8b07a07d61f643bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.428547 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.430032 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f32ec9cdc7b42a8807ae68a8b3db7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.439142 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3013974914421182c82eaf339e22cc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.441280 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3013974914421182c82eaf339e22cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.447741 19964 tablet_service.cc:1511] Processing CreateTablet for tablet d813cf323225419f955c3efdae688a83 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.449723 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d813cf323225419f955c3efdae688a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.459311 19960 tablet_service.cc:1511] Processing CreateTablet for tablet a213a8358e61477cac2ad10e043ba2bb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.461320 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a213a8358e61477cac2ad10e043ba2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.472193 20243 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:22.473790 20244 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:22.474300 19959 tablet_service.cc:1511] Processing CreateTablet for tablet 2f32b127d2f647c8b07a07d61f643bdf (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.476006 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f32b127d2f647c8b07a07d61f643bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.482419 20108 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca23f3e5d7849b78fc9a0c03c170791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:22.483477 20243 tablet_bootstrap.cc:654] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.483850 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca23f3e5d7849b78fc9a0c03c170791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.491246 20242 tablet_bootstrap.cc:654] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.495249 20188 tablet_service.cc:1511] Processing CreateTablet for tablet cd2390af31254060951179e822c53383 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.497416 20186 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd3c2ff5d348dd9b5baa2b04163b97 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.497982 20183 tablet_service.cc:1511] Processing CreateTablet for tablet eac9c02fc91043da80c23156c017b264 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.499081 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd3c2ff5d348dd9b5baa2b04163b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.500413 20183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9c02fc91043da80c23156c017b264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.501873 20187 tablet_service.cc:1511] Processing CreateTablet for tablet c021951a7255405393cb29fc326c0791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.508915 20187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c021951a7255405393cb29fc326c0791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.503845 20184 tablet_service.cc:1511] Processing CreateTablet for tablet d813cf323225419f955c3efdae688a83 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.510838 20184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d813cf323225419f955c3efdae688a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.514356 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2390af31254060951179e822c53383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.506162 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3013974914421182c82eaf339e22cc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.523947 20182 tablet_service.cc:1511] Processing CreateTablet for tablet 2f32b127d2f647c8b07a07d61f643bdf (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.538733 20181 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca23f3e5d7849b78fc9a0c03c170791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:22.544447 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f32b127d2f647c8b07a07d61f643bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.545410 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3013974914421182c82eaf339e22cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.549952 20039 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0e701ffff44788247b6796c34378b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:22.551285 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca23f3e5d7849b78fc9a0c03c170791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.553298 19963 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca23f3e5d7849b78fc9a0c03c170791 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:22.554710 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca23f3e5d7849b78fc9a0c03c170791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.558400 20113 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0e701ffff44788247b6796c34378b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:22.559705 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0e701ffff44788247b6796c34378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.563400 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0e701ffff44788247b6796c34378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.574240 20244 tablet_bootstrap.cc:654] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.581110 20180 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0e701ffff44788247b6796c34378b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:22.583670 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0e701ffff44788247b6796c34378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.584280 19959 tablet_service.cc:1511] Processing CreateTablet for tablet f0b4623789f6400a90a64898d6bc2bd8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:22.584810 20040 tablet_service.cc:1511] Processing CreateTablet for tablet f0b4623789f6400a90a64898d6bc2bd8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:22.585894 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b4623789f6400a90a64898d6bc2bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.586285 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b4623789f6400a90a64898d6bc2bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.609436 20243 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:22.627976 20188 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e3a9b96d4af1ad4db55958206dd9 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:22.629518 20244 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:22.629699 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e3a9b96d4af1ad4db55958206dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.630203 20244 ts_tablet_manager.cc:1403] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.007s
I20260709 13:10:22.637729 20244 raft_consensus.cc:359] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:22.638588 20244 raft_consensus.cc:385] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.638911 20244 raft_consensus.cc:740] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.612248 20243 ts_tablet_manager.cc:1403] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.141s	user 0.044s	sys 0.051s
I20260709 13:10:22.648703 20000 heartbeater.cc:499] Master 127.11.78.62:45221 was elected leader, sending a full tablet report...
I20260709 13:10:22.649282 20248 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:22.655314 20243 raft_consensus.cc:359] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:22.657210 19963 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e3a9b96d4af1ad4db55958206dd9 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:22.679879 20186 tablet_service.cc:1511] Processing CreateTablet for tablet dfc07241f7bb4356a03e4bb862681665 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:22.660548 20035 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e3a9b96d4af1ad4db55958206dd9 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:22.639707 20244 consensus_queue.cc:260] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:22.643651 20108 tablet_service.cc:1511] Processing CreateTablet for tablet f0b4623789f6400a90a64898d6bc2bd8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:22.681505 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e3a9b96d4af1ad4db55958206dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.672899 20243 raft_consensus.cc:385] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.681936 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b4623789f6400a90a64898d6bc2bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.682192 20243 raft_consensus.cc:740] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.683173 20243 consensus_queue.cc:260] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:22.658648 20248 tablet_bootstrap.cc:654] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.681918 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e3a9b96d4af1ad4db55958206dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.679737 20113 tablet_service.cc:1511] Processing CreateTablet for tablet dfc07241f7bb4356a03e4bb862681665 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:22.680209 19959 tablet_service.cc:1511] Processing CreateTablet for tablet dfc07241f7bb4356a03e4bb862681665 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:22.676496 20242 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:22.684573 20114 tablet_service.cc:1511] Processing CreateTablet for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:22.697762 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc07241f7bb4356a03e4bb862681665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.687628 20034 tablet_service.cc:1511] Processing CreateTablet for tablet 882ba423a74c496d8a4d5dba170a5748 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:22.699448 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ba423a74c496d8a4d5dba170a5748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.699612 20112 tablet_service.cc:1511] Processing CreateTablet for tablet 882ba423a74c496d8a4d5dba170a5748 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:22.692401 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 882ba423a74c496d8a4d5dba170a5748 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:22.701856 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc07241f7bb4356a03e4bb862681665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.697760 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc07241f7bb4356a03e4bb862681665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.702773 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.702966 20242 ts_tablet_manager.cc:1403] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.279s	user 0.016s	sys 0.019s
I20260709 13:10:22.706120 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ba423a74c496d8a4d5dba170a5748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.677850 20040 tablet_service.cc:1511] Processing CreateTablet for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:22.708570 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.718439 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 1da0f3e9b2604f71afd4792bd89d38ca (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:22.720263 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ba423a74c496d8a4d5dba170a5748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.720816 20180 tablet_service.cc:1511] Processing CreateTablet for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:22.721446 20243 ts_tablet_manager.cc:1434] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.007s
I20260709 13:10:22.722362 20075 heartbeater.cc:499] Master 127.11.78.62:45221 was elected leader, sending a full tablet report...
I20260709 13:10:22.728715 20243 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:22.734018 20244 ts_tablet_manager.cc:1434] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.009s
W20260709 13:10:22.742828 20076 tablet.cc:2406] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:22.707080 20242 raft_consensus.cc:359] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.744812 20242 raft_consensus.cc:385] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.745196 20242 raft_consensus.cc:740] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.746524 20244 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:22.747195 19963 tablet_service.cc:1511] Processing CreateTablet for tablet 1da0f3e9b2604f71afd4792bd89d38ca (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:22.748749 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da0f3e9b2604f71afd4792bd89d38ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.748386 20243 tablet_bootstrap.cc:654] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.760087 20039 tablet_service.cc:1511] Processing CreateTablet for tablet 1da0f3e9b2604f71afd4792bd89d38ca (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:22.771246 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da0f3e9b2604f71afd4792bd89d38ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.748430 20242 consensus_queue.cc:260] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.755636 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da0f3e9b2604f71afd4792bd89d38ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.773367 20109 tablet_service.cc:1511] Processing CreateTablet for tablet f34249aa09174ce3b90e9cbf1bfebb62 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:22.783842 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34249aa09174ce3b90e9cbf1bfebb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.785727 20188 tablet_service.cc:1511] Processing CreateTablet for tablet f34249aa09174ce3b90e9cbf1bfebb62 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:22.802079 19962 tablet_service.cc:1511] Processing CreateTablet for tablet f34249aa09174ce3b90e9cbf1bfebb62 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:22.803715 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34249aa09174ce3b90e9cbf1bfebb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.804190 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494e6d6aa8a4b80b4f36c9a880d4ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.812180 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34249aa09174ce3b90e9cbf1bfebb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.816715 20110 tablet_service.cc:1511] Processing CreateTablet for tablet 928d42c4bfd54d59bdda6b75cfd037db (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:22.818257 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928d42c4bfd54d59bdda6b75cfd037db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.824559 20034 tablet_service.cc:1511] Processing CreateTablet for tablet 928d42c4bfd54d59bdda6b75cfd037db (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:22.827121 20244 tablet_bootstrap.cc:654] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.832165 20248 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:22.835366 20248 ts_tablet_manager.cc:1403] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.029s
I20260709 13:10:22.845541 20242 ts_tablet_manager.cc:1434] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.142s	user 0.027s	sys 0.010s
I20260709 13:10:22.846545 19964 tablet_service.cc:1511] Processing CreateTablet for tablet ca40d47d506d494e96cc28c3474730f7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:22.857638 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40d47d506d494e96cc28c3474730f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.848798 20182 tablet_service.cc:1511] Processing CreateTablet for tablet 928d42c4bfd54d59bdda6b75cfd037db (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:22.860932 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928d42c4bfd54d59bdda6b75cfd037db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.855141 20036 tablet_service.cc:1511] Processing CreateTablet for tablet ca40d47d506d494e96cc28c3474730f7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:22.881027 20149 heartbeater.cc:499] Master 127.11.78.62:45221 was elected leader, sending a full tablet report...
I20260709 13:10:22.889081 20242 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:22.891767 20243 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:22.892587 20243 ts_tablet_manager.cc:1403] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.164s	user 0.030s	sys 0.016s
I20260709 13:10:22.908381 20108 tablet_service.cc:1511] Processing CreateTablet for tablet ca40d47d506d494e96cc28c3474730f7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:22.908954 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 15f30be759394f459819ccb2558de4b3 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:22.910099 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40d47d506d494e96cc28c3474730f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.868243 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928d42c4bfd54d59bdda6b75cfd037db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.867965 20248 raft_consensus.cc:359] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.911998 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40d47d506d494e96cc28c3474730f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.912079 20248 raft_consensus.cc:385] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.912660 20248 raft_consensus.cc:740] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.913830 20248 consensus_queue.cc:260] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.916159 20243 raft_consensus.cc:359] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.917105 20243 raft_consensus.cc:385] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.917436 20243 raft_consensus.cc:740] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.918598 20243 consensus_queue.cc:260] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:22.928560 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f30be759394f459819ccb2558de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.929301 20243 ts_tablet_manager.cc:1434] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:10:22.930596 20243 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:22.934580 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 15f30be759394f459819ccb2558de4b3 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:22.936291 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f30be759394f459819ccb2558de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.946784 20036 tablet_service.cc:1511] Processing CreateTablet for tablet 15f30be759394f459819ccb2558de4b3 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:22.948654 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f30be759394f459819ccb2558de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.951324 20244 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:22.952842 20244 ts_tablet_manager.cc:1403] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.207s	user 0.036s	sys 0.040s
I20260709 13:10:22.956122 20244 raft_consensus.cc:359] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:22.958411 20244 raft_consensus.cc:385] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.958889 20244 raft_consensus.cc:740] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.959764 20244 consensus_queue.cc:260] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:22.960300 20112 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9f15408e44661bc3aaf3d74fbba55 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:22.962033 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9f15408e44661bc3aaf3d74fbba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.957548 20242 tablet_bootstrap.cc:654] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.965654 20223 heartbeater.cc:499] Master 127.11.78.62:45221 was elected leader, sending a full tablet report...
I20260709 13:10:22.968500 20248 ts_tablet_manager.cc:1434] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.125s	user 0.010s	sys 0.001s
I20260709 13:10:22.977404 20244 ts_tablet_manager.cc:1434] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:10:22.982085 20244 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:22.979231 20248 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:22.990558 20248 tablet_bootstrap.cc:654] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.991436 19961 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9f15408e44661bc3aaf3d74fbba55 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:22.996991 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9f15408e44661bc3aaf3d74fbba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.992251 20242 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:22.993268 20040 tablet_service.cc:1511] Processing CreateTablet for tablet ae3c66d6c878411e93702c52bee230c1 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:22.995833 20244 tablet_bootstrap.cc:654] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.000084 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c66d6c878411e93702c52bee230c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.000295 20242 ts_tablet_manager.cc:1403] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.000s
I20260709 13:10:22.998507 20182 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9f15408e44661bc3aaf3d74fbba55 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:23.010083 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9f15408e44661bc3aaf3d74fbba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.016657 20250 raft_consensus.cc:493] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.010344 20242 raft_consensus.cc:359] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.017383 20242 raft_consensus.cc:385] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.017323 20250 raft_consensus.cc:515] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.018445 20253 raft_consensus.cc:493] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.023406 20253 raft_consensus.cc:515] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:23.025794 20250 leader_election.cc:290] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:23.020774 20110 tablet_service.cc:1511] Processing CreateTablet for tablet ae3c66d6c878411e93702c52bee230c1 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:23.032274 20242 raft_consensus.cc:740] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.033003 20253 leader_election.cc:290] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:23.063877 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c66d6c878411e93702c52bee230c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.066318 20242 consensus_queue.cc:260] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.067505 20244 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:23.073200 20244 ts_tablet_manager.cc:1403] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.018s
I20260709 13:10:23.081524 20186 tablet_service.cc:1511] Processing CreateTablet for tablet ae3c66d6c878411e93702c52bee230c1 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:23.083158 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c66d6c878411e93702c52bee230c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.072342 20242 ts_tablet_manager.cc:1434] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:10:23.089643 20244 raft_consensus.cc:359] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.101114 20242 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:23.109242 20243 tablet_bootstrap.cc:654] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.095877 20244 raft_consensus.cc:385] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.107151 19962 tablet_service.cc:1511] Processing CreateTablet for tablet d7feca13708f480e844a83b8c1828d1c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:23.113137 20244 raft_consensus.cc:740] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.114773 20244 consensus_queue.cc:260] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.115613 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7feca13708f480e844a83b8c1828d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.120783 20244 ts_tablet_manager.cc:1434] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:10:23.122117 20244 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:23.121542 20180 tablet_service.cc:1511] Processing CreateTablet for tablet f7888f5f6364427b9a0d647763feb39f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.123589 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7888f5f6364427b9a0d647763feb39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.126637 20253 raft_consensus.cc:493] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.127277 20253 raft_consensus.cc:515] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.130306 20253 leader_election.cc:290] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:23.132619 20250 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.133464 20250 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.143538 20250 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:23.193255 20249 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.194253 20249 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.208762 20113 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3ac05b81ea4c3c83799ea30724a707 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.210270 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3ac05b81ea4c3c83799ea30724a707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.209561 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3ac05b81ea4c3c83799ea30724a707 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.229125 20040 tablet_service.cc:1511] Processing CreateTablet for tablet f7888f5f6364427b9a0d647763feb39f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.228349 20034 tablet_service.cc:1511] Processing CreateTablet for tablet d7feca13708f480e844a83b8c1828d1c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:23.231191 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7888f5f6364427b9a0d647763feb39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.231240 20108 tablet_service.cc:1511] Processing CreateTablet for tablet d7feca13708f480e844a83b8c1828d1c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:23.232760 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7feca13708f480e844a83b8c1828d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.233172 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7feca13708f480e844a83b8c1828d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.228902 20248 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:23.229893 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3ac05b81ea4c3c83799ea30724a707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.240947 20244 tablet_bootstrap.cc:654] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.243778 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.248381 20248 ts_tablet_manager.cc:1403] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.269s	user 0.031s	sys 0.015s
I20260709 13:10:23.250026 20243 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:23.251506 20242 tablet_bootstrap.cc:654] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.252482 20249 leader_election.cc:290] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:23.265055 20036 tablet_service.cc:1511] Processing CreateTablet for tablet 69a1f4669e774779972fe3fd39706aef (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:10:23.261807 19940 leader_election.cc:343] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.266422 20243 ts_tablet_manager.cc:1403] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.336s	user 0.023s	sys 0.045s
I20260709 13:10:23.281234 20112 tablet_service.cc:1511] Processing CreateTablet for tablet 69a1f4669e774779972fe3fd39706aef (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:23.281103 20248 raft_consensus.cc:359] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.282459 20248 raft_consensus.cc:385] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.282878 20248 raft_consensus.cc:740] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.285578 20039 tablet_service.cc:1511] Processing CreateTablet for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.287099 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.286846 20186 tablet_service.cc:1511] Processing CreateTablet for tablet 69a1f4669e774779972fe3fd39706aef (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:23.287273 20114 tablet_service.cc:1511] Processing CreateTablet for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.288434 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a1f4669e774779972fe3fd39706aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.288283 20248 consensus_queue.cc:260] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.294162 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.291531 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 96254c9e0b6a4f8e828190935026cf4b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.296012 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.297107 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96254c9e0b6a4f8e828190935026cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.298031 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.298532 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:23.299463 20089 leader_election.cc:343] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.282936 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a1f4669e774779972fe3fd39706aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.301297 20109 tablet_service.cc:1511] Processing CreateTablet for tablet dae08a3fb8914d8eb858aea9fd39e4d8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.302078 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.302769 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae08a3fb8914d8eb858aea9fd39e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.303305 20243 raft_consensus.cc:359] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:23.304813 19939 leader_election.cc:343] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.299968 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a1f4669e774779972fe3fd39706aef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.304992 20087 leader_election.cc:343] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.306548 20035 tablet_service.cc:1511] Processing CreateTablet for tablet 96254c9e0b6a4f8e828190935026cf4b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.320386 19939 leader_election.cc:304] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:23.307608 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.321979 19939 leader_election.cc:343] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.323173 20250 raft_consensus.cc:2749] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.315709 20248 ts_tablet_manager.cc:1434] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:10:23.278419 20249 raft_consensus.cc:493] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.317546 20243 raft_consensus.cc:385] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.328430 20249 raft_consensus.cc:515] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:23.328675 20243 raft_consensus.cc:740] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.338354 20050 raft_consensus.cc:2468] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:23.339915 20249 leader_election.cc:290] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:23.340869 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96254c9e0b6a4f8e828190935026cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.344692 20089 leader_election.cc:304] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:23.354066 20253 raft_consensus.cc:2804] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.354635 20253 raft_consensus.cc:493] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.355136 20253 raft_consensus.cc:3060] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.354688 20180 tablet_service.cc:1511] Processing CreateTablet for tablet dae08a3fb8914d8eb858aea9fd39e4d8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.355511 20244 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:23.359891 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae08a3fb8914d8eb858aea9fd39e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.359822 20244 ts_tablet_manager.cc:1403] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.238s	user 0.020s	sys 0.011s
I20260709 13:10:23.354079 20248 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:23.364162 20037 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3109762d1147289ef7abb943db28d0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:23.365717 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3109762d1147289ef7abb943db28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.369166 20244 raft_consensus.cc:359] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.370043 20244 raft_consensus.cc:385] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.370373 20244 raft_consensus.cc:740] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
W20260709 13:10:23.371330 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:23.371199 20244 consensus_queue.cc:260] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.372974 20243 consensus_queue.cc:260] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.389480 20243 ts_tablet_manager.cc:1434] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.004s
I20260709 13:10:23.409113 20244 ts_tablet_manager.cc:1434] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:10:23.414934 20181 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3109762d1147289ef7abb943db28d0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:23.417614 20244 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:23.422916 20110 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3109762d1147289ef7abb943db28d0 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:23.424358 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3109762d1147289ef7abb943db28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.426285 19961 tablet_service.cc:1511] Processing CreateTablet for tablet f7888f5f6364427b9a0d647763feb39f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.427883 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7888f5f6364427b9a0d647763feb39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.429214 20243 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:23.404629 20255 raft_consensus.cc:493] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.433200 20270 raft_consensus.cc:493] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.433626 20250 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.433815 20270 raft_consensus.cc:515] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.434224 20250 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.432895 20255 raft_consensus.cc:515] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:23.436893 20250 leader_election.cc:290] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:23.438352 20255 leader_election.cc:290] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:23.439412 20270 leader_election.cc:290] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:23.439647 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.440712 20050 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:23.465991 19963 tablet_service.cc:1511] Processing CreateTablet for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.467531 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163d17ff6a2c4c4795e2cdbe07cd15dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.467272 19964 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3ac05b81ea4c3c83799ea30724a707 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.469478 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3ac05b81ea4c3c83799ea30724a707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.475895 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3109762d1147289ef7abb943db28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.477445 20253 raft_consensus.cc:515] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:23.484725 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:23.485419 20050 raft_consensus.cc:3060] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.487550 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 96254c9e0b6a4f8e828190935026cf4b (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.497720 19960 tablet_service.cc:1511] Processing CreateTablet for tablet e96d6093e3af49e2b8fd8e162a7277a7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.500861 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96d6093e3af49e2b8fd8e162a7277a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.502756 19959 tablet_service.cc:1511] Processing CreateTablet for tablet dae08a3fb8914d8eb858aea9fd39e4d8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.506664 20248 tablet_bootstrap.cc:654] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.462116 19940 leader_election.cc:304] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:23.513126 20250 raft_consensus.cc:2804] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.513777 20250 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.514161 20250 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.514326 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae08a3fb8914d8eb858aea9fd39e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.513007 19940 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 60948.5us
I20260709 13:10:23.539964 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
W20260709 13:10:23.542016 20087 leader_election.cc:343] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.542599 20087 leader_election.cc:304] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:23.548769 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96254c9e0b6a4f8e828190935026cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.545955 20036 tablet_service.cc:1511] Processing CreateTablet for tablet e96d6093e3af49e2b8fd8e162a7277a7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.550098 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96d6093e3af49e2b8fd8e162a7277a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.561923 20244 tablet_bootstrap.cc:654] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.564333 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:23.564635 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:23.565603 19974 raft_consensus.cc:2468] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:23.535671 20250 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.576208 19975 raft_consensus.cc:2393] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:23.581224 20013 leader_election.cc:304] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:23.582216 20270 raft_consensus.cc:2804] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.582707 20270 raft_consensus.cc:493] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.583163 20270 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.584436 20253 leader_election.cc:290] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:23.585610 20253 raft_consensus.cc:2749] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.589344 20112 tablet_service.cc:1511] Processing CreateTablet for tablet e96d6093e3af49e2b8fd8e162a7277a7 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.613744 20250 leader_election.cc:290] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:23.616329 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96d6093e3af49e2b8fd8e162a7277a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.617836 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:23.618667 20049 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.622952 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 580e9dc6e4c24718873d74c4398812dd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.627350 19964 tablet_service.cc:1511] Processing CreateTablet for tablet 580e9dc6e4c24718873d74c4398812dd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.628885 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580e9dc6e4c24718873d74c4398812dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.611769 20243 tablet_bootstrap.cc:654] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.632988 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580e9dc6e4c24718873d74c4398812dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.642112 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:23.642714 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:23.630811 20255 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.632740 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:23.635020 20035 tablet_service.cc:1511] Processing CreateTablet for tablet 580e9dc6e4c24718873d74c4398812dd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.645395 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580e9dc6e4c24718873d74c4398812dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.644404 20255 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.640549 20250 raft_consensus.cc:493] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.648267 20198 raft_consensus.cc:2468] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:23.648373 20250 raft_consensus.cc:515] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:23.644220 19938 leader_election.cc:343] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.649969 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.650418 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.652585 20242 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:23.653076 20255 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:23.653276 20242 ts_tablet_manager.cc:1403] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.552s	user 0.023s	sys 0.005s
W20260709 13:10:23.654182 20162 leader_election.cc:343] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:23.655143 19938 leader_election.cc:343] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.652719 20110 tablet_service.cc:1511] Processing CreateTablet for tablet 2716c2c5bb624410a935d9f5de12ea96 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:23.660923 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2716c2c5bb624410a935d9f5de12ea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.662065 20250 leader_election.cc:290] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:23.662544 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.668556 19938 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:23.665565 20186 tablet_service.cc:1511] Processing CreateTablet for tablet 2716c2c5bb624410a935d9f5de12ea96 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:10:23.655051 20162 leader_election.cc:343] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:23.669492 19940 leader_election.cc:343] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.671767 20250 raft_consensus.cc:2804] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.673388 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:23.673635 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:23.673527 20270 raft_consensus.cc:515] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.674413 20248 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:23.674934 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:23.675062 20248 ts_tablet_manager.cc:1403] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.326s	user 0.013s	sys 0.007s
W20260709 13:10:23.675117 20013 leader_election.cc:343] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:23.677276 20013 leader_election.cc:343] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.677453 20050 raft_consensus.cc:2468] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:23.677723 20013 leader_election.cc:304] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:23.672691 20250 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.684267 20250 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.679252 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2716c2c5bb624410a935d9f5de12ea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.680243 20270 leader_election.cc:290] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:23.681573 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:23.689347 19974 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:23.626787 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 84812us
I20260709 13:10:23.690578 20049 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:23.691210 20249 raft_consensus.cc:2749] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.678958 20089 leader_election.cc:304] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:23.692979 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.693342 20283 raft_consensus.cc:2804] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.694061 20283 raft_consensus.cc:697] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
W20260709 13:10:23.694654 20163 leader_election.cc:343] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.695243 20163 leader_election.cc:304] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:23.708500 20255 raft_consensus.cc:2749] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.695168 20283 consensus_queue.cc:237] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:23.718482 20242 raft_consensus.cc:359] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.719417 20242 raft_consensus.cc:385] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.720279 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:23.725477 20108 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac48363d4d4312b0a4ce40551b6a6c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.727111 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac48363d4d4312b0a4ce40551b6a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.729899 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.730155 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:23.720641 20248 raft_consensus.cc:359] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.719791 20242 raft_consensus.cc:740] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.731513 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.736121 20248 raft_consensus.cc:385] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.722747 20244 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
W20260709 13:10:23.736840 20087 leader_election.cc:343] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.738437 19940 leader_election.cc:304] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:23.739969 20035 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac48363d4d4312b0a4ce40551b6a6c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.757552 20037 tablet_service.cc:1511] Processing CreateTablet for tablet ec431714e0b74545b9e734e354354f2c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.759191 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec431714e0b74545b9e734e354354f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.760630 20014 leader_election.cc:304] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:23.762104 20014 leader_election.cc:343] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:23.762814 20014 leader_election.cc:343] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.763715 20270 raft_consensus.cc:2749] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.741109 20248 raft_consensus.cc:740] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.764369 19974 raft_consensus.cc:2468] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:23.759820 19872 catalog_manager.cc:5697] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.766336 20248 consensus_queue.cc:260] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.766664 20013 leader_election.cc:304] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:23.768594 20250 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.769003 20248 ts_tablet_manager.cc:1434] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 13:10:23.770406 20248 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:23.770851 20270 raft_consensus.cc:2804] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.769084 20181 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac48363d4d4312b0a4ce40551b6a6c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.772806 20270 raft_consensus.cc:697] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:23.773628 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac48363d4d4312b0a4ce40551b6a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.773761 20270 consensus_queue.cc:237] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.771090 20250 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
W20260709 13:10:23.740411 19938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 71826.4us
I20260709 13:10:23.749663 20244 ts_tablet_manager.cc:1403] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.332s	user 0.015s	sys 0.024s
I20260709 13:10:23.772006 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:23.777621 19938 leader_election.cc:343] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:23.778060 19939 leader_election.cc:343] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.778234 19938 leader_election.cc:304] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:23.778861 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:23.779584 20198 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.787403 20250 raft_consensus.cc:2804] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.790387 19963 tablet_service.cc:1511] Processing CreateTablet for tablet 2716c2c5bb624410a935d9f5de12ea96 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:23.796674 20285 raft_consensus.cc:2749] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.798606 20109 tablet_service.cc:1511] Processing CreateTablet for tablet ec431714e0b74545b9e734e354354f2c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.802661 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2716c2c5bb624410a935d9f5de12ea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.803586 20243 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:23.804524 20243 ts_tablet_manager.cc:1403] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.376s	user 0.019s	sys 0.012s
I20260709 13:10:23.812071 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec431714e0b74545b9e734e354354f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.812474 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac48363d4d4312b0a4ce40551b6a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.779946 20244 raft_consensus.cc:359] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.814402 20244 raft_consensus.cc:385] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.814867 20244 raft_consensus.cc:740] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.794387 20250 raft_consensus.cc:697] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:23.816953 20250 consensus_queue.cc:237] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.820420 20243 raft_consensus.cc:359] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.821578 20243 raft_consensus.cc:385] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.821982 20243 raft_consensus.cc:740] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.826514 20198 raft_consensus.cc:2468] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:23.828888 20244 consensus_queue.cc:260] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.840193 20244 ts_tablet_manager.cc:1434] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.004s
I20260709 13:10:23.781117 20242 consensus_queue.cc:260] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.843456 20036 tablet_service.cc:1511] Processing CreateTablet for tablet dc59f19c65354a2882be0da8f9b88764 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:10:23.834296 19938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 56563.4us
I20260709 13:10:23.846138 20185 tablet_service.cc:1511] Processing CreateTablet for tablet b95d568843284ddda0eda68734cdd590 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.841043 20243 consensus_queue.cc:260] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.839938 20180 tablet_service.cc:1511] Processing CreateTablet for tablet dc59f19c65354a2882be0da8f9b88764 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:23.849542 19873 catalog_manager.cc:5697] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.858783 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc59f19c65354a2882be0da8f9b88764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.860698 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95d568843284ddda0eda68734cdd590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.859709 20040 tablet_service.cc:1511] Processing CreateTablet for tablet adb0269325f84a20b8bbf06dba278dcb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.859709 20112 tablet_service.cc:1511] Processing CreateTablet for tablet b95d568843284ddda0eda68734cdd590 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.862926 20040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb0269325f84a20b8bbf06dba278dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.864305 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc59f19c65354a2882be0da8f9b88764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.860407 19964 tablet_service.cc:1511] Processing CreateTablet for tablet ec431714e0b74545b9e734e354354f2c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.866778 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec431714e0b74545b9e734e354354f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.868789 20112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95d568843284ddda0eda68734cdd590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.879603 20244 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:23.885281 20243 ts_tablet_manager.cc:1434] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:10:23.886560 20243 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:23.886360 20113 tablet_service.cc:1511] Processing CreateTablet for tablet adb0269325f84a20b8bbf06dba278dcb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.887792 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb0269325f84a20b8bbf06dba278dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.890288 20182 tablet_service.cc:1511] Processing CreateTablet for tablet adb0269325f84a20b8bbf06dba278dcb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.891813 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb0269325f84a20b8bbf06dba278dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.890765 20242 ts_tablet_manager.cc:1434] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.237s	user 0.010s	sys 0.000s
I20260709 13:10:23.897584 19871 catalog_manager.cc:5697] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.903607 20039 tablet_service.cc:1511] Processing CreateTablet for tablet c908cda42a1b4577845ec65410d29f6f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.904991 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908cda42a1b4577845ec65410d29f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.907060 20244 tablet_bootstrap.cc:654] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.907900 20114 tablet_service.cc:1511] Processing CreateTablet for tablet c908cda42a1b4577845ec65410d29f6f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.909335 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908cda42a1b4577845ec65410d29f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.909567 19962 tablet_service.cc:1511] Processing CreateTablet for tablet dc59f19c65354a2882be0da8f9b88764 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:23.909832 19959 tablet_service.cc:1511] Processing CreateTablet for tablet b95d568843284ddda0eda68734cdd590 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.911150 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc59f19c65354a2882be0da8f9b88764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.911422 19938 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:23.912322 19960 tablet_service.cc:1511] Processing CreateTablet for tablet c908cda42a1b4577845ec65410d29f6f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.913018 20250 raft_consensus.cc:2804] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.913723 20250 raft_consensus.cc:697] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:23.898730 20242 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:23.914705 20250 consensus_queue.cc:237] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:23.913125 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95d568843284ddda0eda68734cdd590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.921379 20255 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.922035 20255 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:23.926616 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:23.927659 20049 raft_consensus.cc:2393] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:23.926599 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908cda42a1b4577845ec65410d29f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.926713 20255 leader_election.cc:290] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:23.931512 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 049e74a7f6364769958bf3682e89a7da (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.933128 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049e74a7f6364769958bf3682e89a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.946676 20248 tablet_bootstrap.cc:654] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.946997 20270 raft_consensus.cc:493] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.947628 20270 raft_consensus.cc:515] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:23.951416 20111 tablet_service.cc:1511] Processing CreateTablet for tablet c577376c4e4f414c9e6b3b717c9dea3c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:23.952695 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:23.952942 20111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c577376c4e4f414c9e6b3b717c9dea3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.953423 20123 raft_consensus.cc:2468] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:23.954305 20270 leader_election.cc:290] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:23.955631 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:23.956820 20014 leader_election.cc:304] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
W20260709 13:10:23.958871 20013 leader_election.cc:343] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.959869 20270 raft_consensus.cc:2804] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.960319 20270 raft_consensus.cc:493] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.960668 20270 raft_consensus.cc:3060] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.971236 20037 tablet_service.cc:1511] Processing CreateTablet for tablet 049e74a7f6364769958bf3682e89a7da (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.973034 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049e74a7f6364769958bf3682e89a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.977216 20243 tablet_bootstrap.cc:654] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.980847 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:23.982559 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:23.988620 20161 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:23.990175 20161 leader_election.cc:304] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:23.990384 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 049e74a7f6364769958bf3682e89a7da (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.995564 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049e74a7f6364769958bf3682e89a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.997550 20242 tablet_bootstrap.cc:654] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.992167 20255 raft_consensus.cc:2749] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.001421 20255 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.002283 20183 tablet_service.cc:1511] Processing CreateTablet for tablet c577376c4e4f414c9e6b3b717c9dea3c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:24.003904 20183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c577376c4e4f414c9e6b3b717c9dea3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.987813 20270 raft_consensus.cc:515] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.027973 19963 tablet_service.cc:1511] Processing CreateTablet for tablet c577376c4e4f414c9e6b3b717c9dea3c (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:24.029956 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c577376c4e4f414c9e6b3b717c9dea3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.029762 20035 tablet_service.cc:1511] Processing CreateTablet for tablet d3e25a4e35244733b59abb26b98e197f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:24.030715 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
W20260709 13:10:24.032975 20013 leader_election.cc:343] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.042706 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:24.043468 20123 raft_consensus.cc:3060] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.047012 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e25a4e35244733b59abb26b98e197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.047783 20255 raft_consensus.cc:2749] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.049290 20109 tablet_service.cc:1511] Processing CreateTablet for tablet d3e25a4e35244733b59abb26b98e197f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:24.050760 20244 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:24.051589 20244 ts_tablet_manager.cc:1403] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.002s
I20260709 13:10:24.055316 20123 raft_consensus.cc:2468] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:24.059017 20244 raft_consensus.cc:359] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.059293 20181 tablet_service.cc:1511] Processing CreateTablet for tablet d3e25a4e35244733b59abb26b98e197f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:24.061504 19965 tablet_service.cc:1511] Processing CreateTablet for tablet a5d7d14edd7844d3ac28ac51635a1a74 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:24.061671 20034 tablet_service.cc:1511] Processing CreateTablet for tablet a5d7d14edd7844d3ac28ac51635a1a74 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:24.062958 19965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d7d14edd7844d3ac28ac51635a1a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.061656 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e25a4e35244733b59abb26b98e197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.063359 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d7d14edd7844d3ac28ac51635a1a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.050881 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e25a4e35244733b59abb26b98e197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.036769 20270 leader_election.cc:290] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:24.037461 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 47402.2us
I20260709 13:10:24.060066 20244 raft_consensus.cc:385] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.072750 20244 raft_consensus.cc:740] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.074396 20248 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:24.072479 20014 leader_election.cc:304] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:24.075338 20248 ts_tablet_manager.cc:1403] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.305s	user 0.021s	sys 0.009s
I20260709 13:10:24.076977 20244 consensus_queue.cc:260] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.085917 20244 ts_tablet_manager.cc:1434] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.003s
I20260709 13:10:24.085815 20270 raft_consensus.cc:2804] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.090623 20270 raft_consensus.cc:697] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:24.092988 20244 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:24.096807 20248 raft_consensus.cc:359] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.103367 20108 tablet_service.cc:1511] Processing CreateTablet for tablet a5d7d14edd7844d3ac28ac51635a1a74 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:24.095465 20270 consensus_queue.cc:237] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.108210 20039 tablet_service.cc:1511] Processing CreateTablet for tablet 50c50d6c7464403bb75d1dbbcc2bcecd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:24.109118 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d7d14edd7844d3ac28ac51635a1a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.109826 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c50d6c7464403bb75d1dbbcc2bcecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.108258 20248 raft_consensus.cc:385] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.116709 20248 raft_consensus.cc:740] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.116993 20114 tablet_service.cc:1511] Processing CreateTablet for tablet 8821119294dc4787ae9b90b24070a2fc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:24.117607 20248 consensus_queue.cc:260] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.118783 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821119294dc4787ae9b90b24070a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.120610 20036 tablet_service.cc:1511] Processing CreateTablet for tablet e9882d3537dc4f1487e6f5784c2b999a (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:24.123781 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9882d3537dc4f1487e6f5784c2b999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.147941 20110 tablet_service.cc:1511] Processing CreateTablet for tablet e9882d3537dc4f1487e6f5784c2b999a (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:24.154026 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9882d3537dc4f1487e6f5784c2b999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.154351 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 50c50d6c7464403bb75d1dbbcc2bcecd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:24.155637 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c50d6c7464403bb75d1dbbcc2bcecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.156646 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 8821119294dc4787ae9b90b24070a2fc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:24.158178 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821119294dc4787ae9b90b24070a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.147605 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 8821119294dc4787ae9b90b24070a2fc (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:24.160892 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821119294dc4787ae9b90b24070a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.161077 20248 ts_tablet_manager.cc:1434] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.004s
I20260709 13:10:24.162209 20248 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:24.153112 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 50c50d6c7464403bb75d1dbbcc2bcecd (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:24.164163 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c50d6c7464403bb75d1dbbcc2bcecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.176192 20283 consensus_queue.cc:1048] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.184062 20244 tablet_bootstrap.cc:654] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.201113 19873 catalog_manager.cc:5697] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.204649 20243 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:24.205550 19960 tablet_service.cc:1511] Processing CreateTablet for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:24.206940 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.205621 20243 ts_tablet_manager.cc:1403] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.319s	user 0.013s	sys 0.010s
I20260709 13:10:24.227138 20242 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:24.227907 20283 raft_consensus.cc:493] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.229700 20283 raft_consensus.cc:515] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.231779 20283 leader_election.cc:290] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:24.233880 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:24.234903 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:24.235671 20198 raft_consensus.cc:2468] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:24.236311 20250 raft_consensus.cc:493] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.237027 20250 raft_consensus.cc:515] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:24.237336 20087 leader_election.cc:343] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.237876 20181 tablet_service.cc:1511] Processing CreateTablet for tablet e9882d3537dc4f1487e6f5784c2b999a (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:24.239578 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9882d3537dc4f1487e6f5784c2b999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.241015 20087 leader_election.cc:304] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:24.246321 20283 raft_consensus.cc:2804] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.247108 20283 raft_consensus.cc:493] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.247699 20283 raft_consensus.cc:3060] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.258092 20037 tablet_service.cc:1511] Processing CreateTablet for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:24.262669 20250 leader_election.cc:290] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:24.264168 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:24.265854 19940 leader_election.cc:343] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.236397 20243 raft_consensus.cc:359] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.266749 20243 raft_consensus.cc:385] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.266763 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.271538 20248 tablet_bootstrap.cc:654] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.227900 20242 ts_tablet_manager.cc:1403] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.329s	user 0.017s	sys 0.010s
I20260709 13:10:24.272239 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:24.273665 19939 leader_election.cc:343] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.274178 19939 leader_election.cc:304] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.278116 20250 raft_consensus.cc:2749] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.267138 20243 raft_consensus.cc:740] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.275758 20242 raft_consensus.cc:359] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.289443 20243 consensus_queue.cc:260] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.286257 20242 raft_consensus.cc:385] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.292510 20242 raft_consensus.cc:740] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.293450 20242 consensus_queue.cc:260] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.300513 20243 ts_tablet_manager.cc:1434] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:10:24.323005 20243 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:24.323557 20289 consensus_queue.cc:1048] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.307210 20108 tablet_service.cc:1511] Processing CreateTablet for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:24.326823 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb50b2a2fa2b492aa6f523acc8ff6cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.314181 20249 consensus_queue.cc:1048] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.338302 20289 consensus_queue.cc:1048] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.316622 20283 raft_consensus.cc:515] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.309190 20183 tablet_service.cc:1511] Processing CreateTablet for tablet 05e2711a72b24afe97685d3b68ca9465 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:24.367810 20183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e2711a72b24afe97685d3b68ca9465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.368870 20283 leader_election.cc:290] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:24.370074 20244 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:24.370599 20244 ts_tablet_manager.cc:1403] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.278s	user 0.014s	sys 0.007s
I20260709 13:10:24.373128 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 05e2711a72b24afe97685d3b68ca9465 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:24.373706 20035 tablet_service.cc:1511] Processing CreateTablet for tablet 05e2711a72b24afe97685d3b68ca9465 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:24.374516 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e2711a72b24afe97685d3b68ca9465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.374953 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e2711a72b24afe97685d3b68ca9465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.376427 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:24.377058 20197 raft_consensus.cc:3060] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.381289 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
W20260709 13:10:24.382067 19939 consensus_peers.cc:597] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.379029 19871 catalog_manager.cc:5697] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:24.384516 20087 leader_election.cc:343] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:24.385919 20014 consensus_peers.cc:597] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.387743 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:24.397660 20242 ts_tablet_manager.cc:1434] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.125s	user 0.023s	sys 0.005s
I20260709 13:10:24.409380 20242 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:24.414747 20108 tablet_service.cc:1511] Processing CreateTablet for tablet fcd1831330c34053b8dc72271c19c552 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:24.416121 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd1831330c34053b8dc72271c19c552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.417711 20243 tablet_bootstrap.cc:654] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.421500 20250 consensus_queue.cc:1048] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.423025 20250 raft_consensus.cc:493] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.423488 20250 raft_consensus.cc:515] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:24.366581 20089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 43633.3us
I20260709 13:10:24.441794 20185 tablet_service.cc:1511] Processing CreateTablet for tablet fcd1831330c34053b8dc72271c19c552 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:24.448818 20248 tablet_bootstrap.cc:492] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:24.450426 20248 ts_tablet_manager.cc:1403] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.288s	user 0.026s	sys 0.015s
I20260709 13:10:24.452999 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd1831330c34053b8dc72271c19c552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.453749 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:24.458199 20250 leader_election.cc:290] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:24.465349 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:24.466349 20123 raft_consensus.cc:2393] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:24.468504 19939 leader_election.cc:304] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.469508 20289 raft_consensus.cc:3060] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.470060 19962 tablet_service.cc:1511] Processing CreateTablet for tablet fcd1831330c34053b8dc72271c19c552 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:24.471510 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd1831330c34053b8dc72271c19c552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.489326 20039 tablet_service.cc:1511] Processing CreateTablet for tablet 1afe0f7aca434ac08f951c456f44801d (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:24.497805 20197 raft_consensus.cc:2468] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
W20260709 13:10:24.498351 20087 consensus_peers.cc:597] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 -> Peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Couldn't send request to peer 9e3242b28df94215893da755f099a6e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.502136 20242 tablet_bootstrap.cc:654] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.502182 20087 leader_election.cc:304] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:24.502941 20039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afe0f7aca434ac08f951c456f44801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.503896 20307 raft_consensus.cc:2804] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.500771 20244 raft_consensus.cc:359] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.504662 20307 raft_consensus.cc:697] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:24.504937 20244 raft_consensus.cc:385] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.505337 20244 raft_consensus.cc:740] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.505625 20307 consensus_queue.cc:237] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.521391 20181 tablet_service.cc:1511] Processing CreateTablet for tablet 1afe0f7aca434ac08f951c456f44801d (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:24.521965 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac09267db943769573413621ec2923 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:24.522825 20181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afe0f7aca434ac08f951c456f44801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.523504 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac09267db943769573413621ec2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.519475 20244 consensus_queue.cc:260] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.527107 20244 ts_tablet_manager.cc:1434] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.004s
I20260709 13:10:24.539330 20036 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac09267db943769573413621ec2923 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:24.540997 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac09267db943769573413621ec2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.542044 20244 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:24.552386 20110 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac09267db943769573413621ec2923 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:24.553900 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac09267db943769573413621ec2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.558852 20248 raft_consensus.cc:359] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.559731 20248 raft_consensus.cc:385] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.532358 20289 raft_consensus.cc:2749] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.544008 20109 tablet_service.cc:1511] Processing CreateTablet for tablet 1afe0f7aca434ac08f951c456f44801d (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:24.574085 20108 tablet_service.cc:1511] Processing CreateTablet for tablet 96b550827c3d4286a9fa6f1a30de0033 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.564344 20109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afe0f7aca434ac08f951c456f44801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.568572 20244 tablet_bootstrap.cc:654] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.563719 20306 raft_consensus.cc:493] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.594014 20306 raft_consensus.cc:515] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.585330 20037 tablet_service.cc:1511] Processing CreateTablet for tablet e123c09eb9fb4796a206bad4baa67b05 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.599331 20108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b550827c3d4286a9fa6f1a30de0033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.596716 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123c09eb9fb4796a206bad4baa67b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.567983 20035 tablet_service.cc:1511] Processing CreateTablet for tablet 5716bb9307734152b1901998813a44eb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.579716 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 96b550827c3d4286a9fa6f1a30de0033 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.578438 20183 tablet_service.cc:1511] Processing CreateTablet for tablet 5716bb9307734152b1901998813a44eb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.561929 20248 raft_consensus.cc:740] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.596697 20114 tablet_service.cc:1511] Processing CreateTablet for tablet e123c09eb9fb4796a206bad4baa67b05 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.605559 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5716bb9307734152b1901998813a44eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:24.610917 19938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 49713.7us
I20260709 13:10:24.611528 20317 consensus_queue.cc:1048] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.610922 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:24.608579 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:24.616879 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123c09eb9fb4796a206bad4baa67b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.609992 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b550827c3d4286a9fa6f1a30de0033. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:24.620240 20089 leader_election.cc:343] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.597748 20306 leader_election.cc:290] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:24.616333 20195 raft_consensus.cc:2468] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:24.614091 20270 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.637720 20250 raft_consensus.cc:493] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.638391 20250 raft_consensus.cc:515] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.639922 20243 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:24.632140 20087 leader_election.cc:304] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:24.640578 20243 ts_tablet_manager.cc:1403] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.318s	user 0.013s	sys 0.010s
I20260709 13:10:24.641676 20186 tablet_service.cc:1511] Processing CreateTablet for tablet e123c09eb9fb4796a206bad4baa67b05 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.643213 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123c09eb9fb4796a206bad4baa67b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.643507 20306 raft_consensus.cc:2804] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.643926 20306 raft_consensus.cc:493] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.644297 20306 raft_consensus.cc:3060] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.644906 20250 leader_election.cc:290] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:24.646639 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:24.632019 20248 consensus_queue.cc:260] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.648133 19961 tablet_service.cc:1511] Processing CreateTablet for tablet 5716bb9307734152b1901998813a44eb (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.649593 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5716bb9307734152b1901998813a44eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.651134 20317 consensus_queue.cc:1048] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.654183 20242 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:24.654775 20242 ts_tablet_manager.cc:1403] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.246s	user 0.022s	sys 0.019s
I20260709 13:10:24.655419 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 96b550827c3d4286a9fa6f1a30de0033 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.656692 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b550827c3d4286a9fa6f1a30de0033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.665966 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:24.666993 20196 raft_consensus.cc:2393] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:24.670192 20244 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:24.670539 20243 raft_consensus.cc:359] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.674899 19960 tablet_service.cc:1511] Processing CreateTablet for tablet 90fbcef945e3478d827ecd923ce8d57f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.679673 20248 ts_tablet_manager.cc:1434] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.229s	user 0.010s	sys 0.000s
I20260709 13:10:24.679708 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fbcef945e3478d827ecd923ce8d57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.681267 20297 raft_consensus.cc:493] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.681818 20297 raft_consensus.cc:515] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.683549 20243 raft_consensus.cc:385] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.685801 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:24.684998 20297 leader_election.cc:290] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:24.685194 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd3c2ff5d348dd9b5baa2b04163b97" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:24.681231 20248 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:24.685981 20243 raft_consensus.cc:740] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.671494 20270 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.683614 19873 catalog_manager.cc:5697] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.695164 20243 consensus_queue.cc:260] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.697557 20244 ts_tablet_manager.cc:1403] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.004s
I20260709 13:10:24.695606 20163 leader_election.cc:304] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.700732 20297 raft_consensus.cc:2749] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.706871 20037 tablet_service.cc:1511] Processing CreateTablet for tablet 90fbcef945e3478d827ecd923ce8d57f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.708343 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fbcef945e3478d827ecd923ce8d57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.690769 20183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5716bb9307734152b1901998813a44eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.717357 20242 raft_consensus.cc:359] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.723603 20242 raft_consensus.cc:385] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.725346 20114 tablet_service.cc:1511] Processing CreateTablet for tablet 90fbcef945e3478d827ecd923ce8d57f (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.719925 20243 ts_tablet_manager.cc:1434] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.004s
I20260709 13:10:24.736096 20243 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:24.742887 20114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fbcef945e3478d827ecd923ce8d57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.744019 20243 tablet_bootstrap.cc:654] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.745555 20270 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:24.677845 19938 leader_election.cc:304] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:24.746856 19938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 69136.7us
I20260709 13:10:24.748492 20036 tablet_service.cc:1511] Processing CreateTablet for tablet a5d2c82b22aa4ac9802e9161cc6c6c23 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.746893 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:24.747133 20250 raft_consensus.cc:3060] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.750411 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d2c82b22aa4ac9802e9161cc6c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:24.753940 20013 leader_election.cc:343] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.756421 20186 tablet_service.cc:1511] Processing CreateTablet for tablet a5d2c82b22aa4ac9802e9161cc6c6c23 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.763860 20306 raft_consensus.cc:515] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.767158 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:24.767721 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:24.768510 20195 raft_consensus.cc:3060] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:24.768857 20089 leader_election.cc:343] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.728619 20242 raft_consensus.cc:740] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.772869 20186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d2c82b22aa4ac9802e9161cc6c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.776450 20242 consensus_queue.cc:260] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.737370 20244 raft_consensus.cc:359] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.777741 20244 raft_consensus.cc:385] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.778107 20244 raft_consensus.cc:740] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.779170 20242 ts_tablet_manager.cc:1434] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.002s
I20260709 13:10:24.784782 20242 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:24.780206 20306 leader_election.cc:290] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:24.782891 20244 consensus_queue.cc:260] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.786402 20123 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.787487 20244 ts_tablet_manager.cc:1434] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
I20260709 13:10:24.788654 20244 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:24.796309 20248 tablet_bootstrap.cc:654] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.805150 19961 tablet_service.cc:1511] Processing CreateTablet for tablet a5d2c82b22aa4ac9802e9161cc6c6c23 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.809473 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d2c82b22aa4ac9802e9161cc6c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.822386 20110 tablet_service.cc:1511] Processing CreateTablet for tablet 159ac08d09bd48f1a2d00965fb182e47 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.808856 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:24.823902 20110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ac08d09bd48f1a2d00965fb182e47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:24.825933 20013 leader_election.cc:343] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.826426 20013 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:24.827768 20270 raft_consensus.cc:2749] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.830441 20250 raft_consensus.cc:2749] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.831632 20185 tablet_service.cc:1511] Processing CreateTablet for tablet 159ac08d09bd48f1a2d00965fb182e47 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.833240 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ac08d09bd48f1a2d00965fb182e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.834301 20243 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:24.838620 20243 ts_tablet_manager.cc:1403] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.000s
I20260709 13:10:24.842254 20244 tablet_bootstrap.cc:654] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.847137 20242 tablet_bootstrap.cc:654] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.849745 20195 raft_consensus.cc:2468] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:24.851842 20087 leader_election.cc:304] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:24.847175 20243 raft_consensus.cc:359] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.852892 20243 raft_consensus.cc:385] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.853224 20306 raft_consensus.cc:2804] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.853786 20306 raft_consensus.cc:697] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:24.860652 20270 raft_consensus.cc:493] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.860201 20306 consensus_queue.cc:237] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.861235 20270 raft_consensus.cc:515] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.853222 20243 raft_consensus.cc:740] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.863478 20243 consensus_queue.cc:260] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.873090 20270 leader_election.cc:290] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:24.874493 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:24.875145 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:24.875809 19974 raft_consensus.cc:2468] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
W20260709 13:10:24.876230 20014 leader_election.cc:343] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.877159 20243 ts_tablet_manager.cc:1434] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:10:24.877364 20013 leader_election.cc:304] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.878464 20243 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:24.878749 20270 raft_consensus.cc:2804] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.879181 20270 raft_consensus.cc:493] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.879532 20270 raft_consensus.cc:3060] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.885581 20289 raft_consensus.cc:493] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.886792 20289 raft_consensus.cc:515] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.894150 20289 leader_election.cc:290] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:24.896426 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:24.897475 20248 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:24.898108 20248 ts_tablet_manager.cc:1403] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.012s
W20260709 13:10:24.898543 19939 leader_election.cc:343] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.901777 20243 tablet_bootstrap.cc:654] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.901896 20270 raft_consensus.cc:515] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.908346 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:24.908615 20270 leader_election.cc:290] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:24.909035 19974 raft_consensus.cc:3060] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.910442 20244 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:24.910969 20244 ts_tablet_manager.cc:1403] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.014s
I20260709 13:10:24.913064 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:24.915395 19938 leader_election.cc:343] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.915928 19938 leader_election.cc:304] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.916745 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a213a8358e61477cac2ad10e043ba2bb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:24.923066 20014 leader_election.cc:343] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.924660 20289 raft_consensus.cc:2749] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.924422 20244 raft_consensus.cc:359] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.928342 20244 raft_consensus.cc:385] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.928844 20244 raft_consensus.cc:740] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.930531 20244 consensus_queue.cc:260] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.927765 19960 tablet_service.cc:1511] Processing CreateTablet for tablet 159ac08d09bd48f1a2d00965fb182e47 (DEFAULT_TABLE table=test-workload [id=d6fd3f1f4cdd4e8ba67b432b0fb0beee]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.931684 19974 raft_consensus.cc:2468] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:24.933521 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ac08d09bd48f1a2d00965fb182e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.934166 20248 raft_consensus.cc:359] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.940289 20248 raft_consensus.cc:385] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.939256 20013 leader_election.cc:304] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:24.941593 20270 raft_consensus.cc:2804] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.942112 20270 raft_consensus.cc:697] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:24.942992 20270 consensus_queue.cc:237] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.945802 20244 ts_tablet_manager.cc:1434] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:10:24.938182 20243 tablet_bootstrap.cc:492] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:24.946962 20243 ts_tablet_manager.cc:1403] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.004s
I20260709 13:10:24.946955 20244 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:24.948220 20248 raft_consensus.cc:740] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.951437 20243 raft_consensus.cc:359] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.953958 20243 raft_consensus.cc:385] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.954430 20243 raft_consensus.cc:740] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.955699 20243 consensus_queue.cc:260] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:24.952739 20248 consensus_queue.cc:260] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:24.944394 19872 catalog_manager.cc:5697] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.954494 20244 tablet_bootstrap.cc:654] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.963907 20242 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:24.965842 20248 ts_tablet_manager.cc:1434] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.002s
I20260709 13:10:24.971809 20242 ts_tablet_manager.cc:1403] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.187s	user 0.019s	sys 0.006s
I20260709 13:10:24.972819 20248 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:24.973981 19871 catalog_manager.cc:5697] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.975103 20242 raft_consensus.cc:359] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.976637 20242 raft_consensus.cc:385] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.976959 20242 raft_consensus.cc:740] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.977927 20242 consensus_queue.cc:260] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:24.980583 20244 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:24.981169 20244 ts_tablet_manager.cc:1403] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:10:24.982084 20242 ts_tablet_manager.cc:1434] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:24.984313 20244 raft_consensus.cc:359] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.968839 20243 ts_tablet_manager.cc:1434] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:10:24.985122 20244 raft_consensus.cc:385] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.985491 20244 raft_consensus.cc:740] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.986014 20243 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:24.986223 20244 consensus_queue.cc:260] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:24.989096 20244 ts_tablet_manager.cc:1434] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:24.983263 20242 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:24.991314 20248 tablet_bootstrap.cc:654] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.994220 20244 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:24.996376 20243 tablet_bootstrap.cc:654] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.001632 20244 tablet_bootstrap.cc:654] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.011078 20242 tablet_bootstrap.cc:654] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.011094 20248 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.013118 20248 ts_tablet_manager.cc:1403] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 13:10:25.014523 20244 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.015300 20244 ts_tablet_manager.cc:1403] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:10:25.017794 20242 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:25.018405 20242 ts_tablet_manager.cc:1403] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:10:25.018575 20244 raft_consensus.cc:359] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.018534 20248 raft_consensus.cc:359] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.019670 20248 raft_consensus.cc:385] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.019819 20244 raft_consensus.cc:385] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.019888 20270 raft_consensus.cc:493] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.020118 20248 raft_consensus.cc:740] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.020351 20244 raft_consensus.cc:740] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.020756 20270 raft_consensus.cc:515] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.021412 20244 consensus_queue.cc:260] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.021538 20248 consensus_queue.cc:260] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.023229 20270 leader_election.cc:290] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:25.024223 20243 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.024770 20243 ts_tablet_manager.cc:1403] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 13:10:25.024797 20244 ts_tablet_manager.cc:1434] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:10:25.026067 20244 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.027647 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.028172 20243 raft_consensus.cc:359] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.028892 20243 raft_consensus.cc:385] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.029167 20243 raft_consensus.cc:740] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.029899 20243 consensus_queue.cc:260] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.032173 20244 tablet_bootstrap.cc:654] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.032747 20243 ts_tablet_manager.cc:1434] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:25.033969 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9c02fc91043da80c23156c017b264" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.034811 20195 raft_consensus.cc:2393] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:25.037606 20289 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.037873 20243 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:25.038189 20289 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.040524 20289 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:25.041847 20013 leader_election.cc:304] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.043242 20270 raft_consensus.cc:3060] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.045060 20243 tablet_bootstrap.cc:654] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.052078 20248 ts_tablet_manager.cc:1434] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:10:25.054116 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:25.055236 20049 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:25.057036 20248 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.057914 20297 raft_consensus.cc:493] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.058568 20297 raft_consensus.cc:515] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.060176 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.061203 20196 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:25.062662 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.063223 19938 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
W20260709 13:10:25.064875 20162 leader_election.cc:343] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.065326 20195 raft_consensus.cc:3060] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.067037 20297 leader_election.cc:290] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.069401 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.070447 19974 raft_consensus.cc:2468] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:25.073809 20161 leader_election.cc:304] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.075435 20297 raft_consensus.cc:2804] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.076015 20297 raft_consensus.cc:493] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.076578 20297 raft_consensus.cc:3060] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.076610 20250 raft_consensus.cc:2804] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.077416 20250 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.077927 20250 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.093815 20306 consensus_queue.cc:1048] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:25.090127 20289 raft_consensus.cc:493] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.097611 20307 consensus_queue.cc:1048] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.098780 20289 raft_consensus.cc:515] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.102128 20289 leader_election.cc:290] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:25.087517 20297 raft_consensus.cc:515] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.104396 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:25.107089 19940 leader_election.cc:343] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.107260 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:25.109400 20162 leader_election.cc:343] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.111932 20297 leader_election.cc:290] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.113776 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.116000 20248 tablet_bootstrap.cc:654] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:25.118358 19938 leader_election.cc:343] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.121536 19938 leader_election.cc:304] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:25.124506 20289 raft_consensus.cc:2749] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.022166 20242 raft_consensus.cc:359] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.146203 20244 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.147369 20244 ts_tablet_manager.cc:1403] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.122s	user 0.046s	sys 0.065s
I20260709 13:10:25.143695 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:25.140901 20250 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.145610 20242 raft_consensus.cc:385] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.159435 20270 raft_consensus.cc:2749] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.161367 20244 raft_consensus.cc:359] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.162153 20244 raft_consensus.cc:385] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.162426 20244 raft_consensus.cc:740] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.160246 20242 raft_consensus.cc:740] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.163463 20242 consensus_queue.cc:260] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.151471 19975 raft_consensus.cc:3060] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.166812 20250 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:25.167904 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:25.168609 20197 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.171981 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:25.172616 20049 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.176595 20242 ts_tablet_manager.cc:1434] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.003s
I20260709 13:10:25.177677 20242 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:25.177452 20244 consensus_queue.cc:260] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.178951 20306 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.179455 20306 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.181458 20244 ts_tablet_manager.cc:1434] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 13:10:25.183112 20244 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.181540 20306 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.185823 20243 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.186573 20243 ts_tablet_manager.cc:1403] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.153s	user 0.056s	sys 0.084s
I20260709 13:10:25.190068 20244 tablet_bootstrap.cc:654] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.190511 19975 raft_consensus.cc:2468] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:25.206548 20161 leader_election.cc:304] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.207782 20297 raft_consensus.cc:2804] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.210024 20248 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.213755 20248 ts_tablet_manager.cc:1403] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.005s
I20260709 13:10:25.214941 20242 tablet_bootstrap.cc:654] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.216938 20297 raft_consensus.cc:697] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:25.217952 20197 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:25.202921 20244 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.190749 20243 raft_consensus.cc:359] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.218230 20297 consensus_queue.cc:237] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.220109 20049 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:25.255069 19940 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.219844 20248 raft_consensus.cc:359] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.256464 20248 raft_consensus.cc:385] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.256621 20250 raft_consensus.cc:2804] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.223305 20244 ts_tablet_manager.cc:1403] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.000s
I20260709 13:10:25.256951 20248 raft_consensus.cc:740] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:25.228152 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 49558.7us
I20260709 13:10:25.258157 20250 raft_consensus.cc:697] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:25.260447 20243 raft_consensus.cc:385] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.260903 20243 raft_consensus.cc:740] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.261059 20242 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:25.260006 20248 consensus_queue.cc:260] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.261147 20244 raft_consensus.cc:359] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.262457 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.262590 20244 raft_consensus.cc:385] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.263108 20244 raft_consensus.cc:740] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.263827 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.264113 20248 ts_tablet_manager.cc:1434] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:10:25.264061 20244 consensus_queue.cc:260] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.265619 20248 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.265854 20087 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:25.261260 20250 consensus_queue.cc:237] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.273852 20248 tablet_bootstrap.cc:654] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.261648 20242 ts_tablet_manager.cc:1403] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.003s
I20260709 13:10:25.278620 20242 raft_consensus.cc:359] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.278118 19873 catalog_manager.cc:5697] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.279377 20242 raft_consensus.cc:385] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.279691 20242 raft_consensus.cc:740] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.283113 20242 consensus_queue.cc:260] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.288792 20242 ts_tablet_manager.cc:1434] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:10:25.289829 20242 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:25.290858 20248 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.291364 20248 ts_tablet_manager.cc:1403] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:10:25.266956 20244 ts_tablet_manager.cc:1434] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:25.261714 20243 consensus_queue.cc:260] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.267614 20344 raft_consensus.cc:2749] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.294032 20243 ts_tablet_manager.cc:1434] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.107s	user 0.018s	sys 0.009s
I20260709 13:10:25.293689 19872 catalog_manager.cc:5697] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.299211 20243 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:25.301110 20242 tablet_bootstrap.cc:654] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.307436 20243 tablet_bootstrap.cc:654] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.314306 20248 raft_consensus.cc:359] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.315411 20248 raft_consensus.cc:385] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.315774 20248 raft_consensus.cc:740] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.316665 20248 consensus_queue.cc:260] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.318028 20244 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.319350 20248 ts_tablet_manager.cc:1434] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:25.320526 20248 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.329180 20123 raft_consensus.cc:3060] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.333534 20249 raft_consensus.cc:493] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.334203 20249 raft_consensus.cc:515] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.339574 20248 tablet_bootstrap.cc:654] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.341411 20249 leader_election.cc:290] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.343906 20344 consensus_queue.cc:1048] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:25.343144 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.344084 20317 consensus_queue.cc:1048] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:25.360100 19974 raft_consensus.cc:2468] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:25.329317 20244 tablet_bootstrap.cc:654] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.362196 20243 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.362409 20013 leader_election.cc:304] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.362850 20243 ts_tablet_manager.cc:1403] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.002s
I20260709 13:10:25.365343 20249 raft_consensus.cc:2804] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.365828 20249 raft_consensus.cc:493] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.366302 20249 raft_consensus.cc:3060] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.366385 20243 raft_consensus.cc:359] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.367221 20243 raft_consensus.cc:385] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.367522 20243 raft_consensus.cc:740] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.344054 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.360522 20270 consensus_queue.cc:1048] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.352699 20242 tablet_bootstrap.cc:492] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:25.370242 20242 ts_tablet_manager.cc:1403] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.017s
I20260709 13:10:25.375685 20248 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.376248 20197 raft_consensus.cc:2468] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:25.376281 20248 ts_tablet_manager.cc:1403] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.006s
I20260709 13:10:25.381456 20123 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.383198 20242 raft_consensus.cc:359] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.383994 20242 raft_consensus.cc:385] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.384301 20242 raft_consensus.cc:740] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.385129 20306 consensus_queue.cc:1048] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.385421 20248 raft_consensus.cc:359] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.386402 20248 raft_consensus.cc:385] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.386745 20248 raft_consensus.cc:740] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.387554 20248 consensus_queue.cc:260] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.388686 20242 consensus_queue.cc:260] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.389114 20250 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.389312 20306 raft_consensus.cc:493] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.389729 20250 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.391261 20242 ts_tablet_manager.cc:1434] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 13:10:25.389803 20306 raft_consensus.cc:515] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.393111 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:25.393797 20050 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:25.394138 20248 ts_tablet_manager.cc:1434] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:25.394891 20306 leader_election.cc:290] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.394759 20243 consensus_queue.cc:260] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.395191 19940 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.396198 20289 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.396966 20243 ts_tablet_manager.cc:1434] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:10:25.396581 20289 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.396739 20250 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.397665 20289 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.396555 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.398752 19975 raft_consensus.cc:2393] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:25.397851 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:25.401032 19939 leader_election.cc:343] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.402083 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca23f3e5d7849b78fc9a0c03c170791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.403328 20248 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.405193 20244 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.405831 20244 ts_tablet_manager.cc:1403] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.008s
I20260709 13:10:25.408946 20297 raft_consensus.cc:493] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.409545 20297 raft_consensus.cc:515] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.410368 20249 raft_consensus.cc:515] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.413184 20297 leader_election.cc:290] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.413329 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.414254 20087 leader_election.cc:304] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:25.414425 20124 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:25.414997 20289 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.415829 20306 raft_consensus.cc:3060] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.416306 20162 leader_election.cc:304] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:25.414599 20248 tablet_bootstrap.cc:654] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.417591 20297 raft_consensus.cc:2804] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.418119 20297 raft_consensus.cc:493] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.418568 20297 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.421868 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:25.422626 20050 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:25.413277 20243 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:25.427827 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:25.428768 20050 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.392570 20242 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
W20260709 13:10:25.461122 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:25.476276 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:25.476955 19974 raft_consensus.cc:3060] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.477705 20289 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.474962 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f32b127d2f647c8b07a07d61f643bdf" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:25.475911 20306 raft_consensus.cc:2749] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.479243 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:25.484673 19939 leader_election.cc:343] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.489336 20248 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.490052 20248 ts_tablet_manager.cc:1403] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.038s
I20260709 13:10:25.480214 20249 leader_election.cc:290] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.468748 20297 raft_consensus.cc:515] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.492751 19974 raft_consensus.cc:2468] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:25.493698 20248 raft_consensus.cc:359] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.494277 20297 leader_election.cc:290] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.494553 20248 raft_consensus.cc:385] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.494334 20013 leader_election.cc:304] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.495138 20248 raft_consensus.cc:740] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.495993 20248 consensus_queue.cc:260] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.497058 20363 raft_consensus.cc:2804] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.497336 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:25.497707 20363 raft_consensus.cc:697] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:25.498133 20049 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.498478 20248 ts_tablet_manager.cc:1434] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:25.498747 20363 consensus_queue.cc:237] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.471160 20244 raft_consensus.cc:359] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.443894 20243 tablet_bootstrap.cc:654] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.481542 20050 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:25.483055 20195 raft_consensus.cc:3060] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.500125 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:25.500823 20122 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.502440 20248 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.500160 20244 raft_consensus.cc:385] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.506525 20244 raft_consensus.cc:740] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.507529 20244 consensus_queue.cc:260] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.509699 20244 ts_tablet_manager.cc:1434] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.002s
I20260709 13:10:25.510761 20244 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.515326 20195 raft_consensus.cc:2468] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:25.515928 20248 tablet_bootstrap.cc:654] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.518491 20122 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:25.520007 20162 leader_election.cc:304] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:25.520452 20049 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:25.521214 20297 raft_consensus.cc:2804] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.522267 20297 raft_consensus.cc:697] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:25.523661 20297 consensus_queue.cc:237] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.529886 20244 tablet_bootstrap.cc:654] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.534116 20242 tablet_bootstrap.cc:654] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:25.537088 19940 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 61402.3us
I20260709 13:10:25.538133 20250 raft_consensus.cc:493] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.538653 20250 raft_consensus.cc:515] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.539522 20243 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.540473 20243 ts_tablet_manager.cc:1403] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.006s
I20260709 13:10:25.540831 20250 leader_election.cc:290] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:25.545076 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:25.547605 19938 leader_election.cc:343] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.549458 19940 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.550786 20250 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.551432 20250 raft_consensus.cc:697] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:25.552670 20250 consensus_queue.cc:237] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.545500 20243 raft_consensus.cc:359] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.555858 20243 raft_consensus.cc:385] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.556238 20243 raft_consensus.cc:740] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.556743 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.557091 20243 consensus_queue.cc:260] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.558028 20248 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.557555 19871 catalog_manager.cc:5697] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:25.558595 19939 leader_election.cc:343] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.558856 20248 ts_tablet_manager.cc:1403] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.024s
I20260709 13:10:25.559168 19939 leader_election.cc:304] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.559849 20243 ts_tablet_manager.cc:1434] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:10:25.560295 20366 raft_consensus.cc:2749] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.561013 20243 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:25.562714 20248 raft_consensus.cc:359] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.563575 20248 raft_consensus.cc:385] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.563894 20248 raft_consensus.cc:740] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.564725 20248 consensus_queue.cc:260] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.567788 20248 ts_tablet_manager.cc:1434] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:25.568902 20248 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:25.570906 20243 tablet_bootstrap.cc:654] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.585777 20248 tablet_bootstrap.cc:654] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.588665 19872 catalog_manager.cc:5697] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.600093 20242 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:25.600962 20242 ts_tablet_manager.cc:1403] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.209s	user 0.019s	sys 0.017s
I20260709 13:10:25.608515 20244 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.609547 20242 raft_consensus.cc:359] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.609144 20244 ts_tablet_manager.cc:1403] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.008s
I20260709 13:10:25.611006 20242 raft_consensus.cc:385] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.611519 20242 raft_consensus.cc:740] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.612416 20242 consensus_queue.cc:260] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.614128 20244 raft_consensus.cc:359] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.614836 20244 raft_consensus.cc:385] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.615103 20244 raft_consensus.cc:740] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.615319 20242 ts_tablet_manager.cc:1434] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:10:25.615875 20244 consensus_queue.cc:260] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.618630 20244 ts_tablet_manager.cc:1434] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:25.619344 20243 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.620072 20243 ts_tablet_manager.cc:1403] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.012s
I20260709 13:10:25.620198 20244 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.617760 20242 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:25.623767 20243 raft_consensus.cc:359] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.624620 20243 raft_consensus.cc:385] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.624949 20243 raft_consensus.cc:740] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.627295 20248 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.609104 19873 catalog_manager.cc:5697] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.668627 20248 ts_tablet_manager.cc:1403] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.004s
I20260709 13:10:25.625681 20243 consensus_queue.cc:260] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.676779 20250 raft_consensus.cc:493] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.678406 20250 raft_consensus.cc:515] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.680866 20243 ts_tablet_manager.cc:1434] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 13:10:25.683627 20243 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:25.686952 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.688895 20250 leader_election.cc:290] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:25.694772 20345 raft_consensus.cc:493] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.698413 20249 raft_consensus.cc:493] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.699054 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.699548 20249 raft_consensus.cc:515] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:25.691234 19939 leader_election.cc:343] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.695933 20345 raft_consensus.cc:515] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:25.713580 19938 leader_election.cc:343] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.714535 19938 leader_election.cc:304] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.716153 20250 raft_consensus.cc:2749] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.717722 20249 leader_election.cc:290] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.718396 20345 leader_election.cc:290] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.718863 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.721429 20195 raft_consensus.cc:2468] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:25.721874 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.722239 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:25.723188 19974 raft_consensus.cc:2468] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:25.724910 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.725129 20013 leader_election.cc:304] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.726318 19975 raft_consensus.cc:2468] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:25.726516 20249 raft_consensus.cc:2804] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.728590 20087 leader_election.cc:304] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.730479 20345 raft_consensus.cc:2804] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.730536 20248 raft_consensus.cc:359] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.731252 20345 raft_consensus.cc:493] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.732714 20248 raft_consensus.cc:385] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.732937 20345 raft_consensus.cc:3060] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.728286 20249 raft_consensus.cc:493] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.733223 20248 raft_consensus.cc:740] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.734963 20242 tablet_bootstrap.cc:654] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.734112 20249 raft_consensus.cc:3060] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.735355 20248 consensus_queue.cc:260] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:25.744912 20087 leader_election.cc:343] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.745321 20363 raft_consensus.cc:493] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.746287 20363 raft_consensus.cc:515] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:25.750594 20363 leader_election.cc:290] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:25.750758 20248 ts_tablet_manager.cc:1434] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.081s	user 0.016s	sys 0.000s
I20260709 13:10:25.751827 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.753530 20248 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
W20260709 13:10:25.754385 20014 leader_election.cc:343] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.751827 20243 tablet_bootstrap.cc:654] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.761081 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:25.766707 20013 leader_election.cc:343] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.767536 20013 leader_election.cc:304] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:25.775251 20317 raft_consensus.cc:2749] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.778505 20242 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:25.779619 20242 ts_tablet_manager.cc:1403] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.018s
I20260709 13:10:25.784080 20242 raft_consensus.cc:359] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.785183 20242 raft_consensus.cc:385] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.785545 20242 raft_consensus.cc:740] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.793390 20244 tablet_bootstrap.cc:654] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.794620 20248 tablet_bootstrap.cc:654] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.804131 20242 consensus_queue.cc:260] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.807314 20249 raft_consensus.cc:515] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.810133 20249 leader_election.cc:290] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.814335 20345 raft_consensus.cc:515] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:25.814960 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:25.814364 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e3a9b96d4af1ad4db55958206dd9" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:25.816918 20197 raft_consensus.cc:3060] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.817934 20297 consensus_queue.cc:1048] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.816670 19974 raft_consensus.cc:3060] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.824600 20366 consensus_queue.cc:1048] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.826077 20244 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:25.826910 20244 ts_tablet_manager.cc:1403] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.207s	user 0.018s	sys 0.004s
I20260709 13:10:25.831192 20244 raft_consensus.cc:359] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.832252 20244 raft_consensus.cc:385] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.832556 20244 raft_consensus.cc:740] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.833413 20244 consensus_queue.cc:260] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.835721 20242 ts_tablet_manager.cc:1434] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.004s
I20260709 13:10:25.837540 20242 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:25.844393 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
W20260709 13:10:25.846441 20087 leader_election.cc:343] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.846642 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:25.847416 19973 raft_consensus.cc:3060] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.853544 20345 leader_election.cc:290] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:25.856087 20244 ts_tablet_manager.cc:1434] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 13:10:25.861989 19974 raft_consensus.cc:2468] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:25.863581 20013 leader_election.cc:304] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.865986 20197 raft_consensus.cc:2468] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:25.868474 20317 raft_consensus.cc:2804] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.869166 20317 raft_consensus.cc:697] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:25.869289 20363 raft_consensus.cc:493] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.869933 20363 raft_consensus.cc:515] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.870363 20317 consensus_queue.cc:237] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.872179 20244 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:25.873888 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:25.874384 20243 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:25.874641 19974 raft_consensus.cc:2468] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:25.874909 20243 ts_tablet_manager.cc:1403] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.008s
I20260709 13:10:25.875240 20248 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:25.876117 20248 ts_tablet_manager.cc:1403] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.024s
I20260709 13:10:25.885223 20297 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.885838 20297 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.888752 20244 tablet_bootstrap.cc:654] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.890627 20363 leader_election.cc:290] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.877933 20013 leader_election.cc:304] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:25.891129 20349 consensus_queue.cc:1048] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.892318 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:25.892618 20297 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:25.894063 20363 raft_consensus.cc:2804] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.894515 20363 raft_consensus.cc:493] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.894901 20363 raft_consensus.cc:3060] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:25.898170 20014 leader_election.cc:343] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.899756 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:25.901943 20163 leader_election.cc:343] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.902083 20243 raft_consensus.cc:359] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.902977 20243 raft_consensus.cc:385] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.903278 20243 raft_consensus.cc:740] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.904403 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
W20260709 13:10:25.910871 20161 leader_election.cc:343] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.911437 20161 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:25.915510 20297 raft_consensus.cc:2749] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.916301 20363 raft_consensus.cc:515] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.919875 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:25.920715 19975 raft_consensus.cc:3060] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.904011 20243 consensus_queue.cc:260] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.927212 20363 leader_election.cc:290] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:25.928969 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:25.931334 20244 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
W20260709 13:10:25.932933 20014 leader_election.cc:343] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.933061 20244 ts_tablet_manager.cc:1403] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.020s
I20260709 13:10:25.934772 20297 raft_consensus.cc:493] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.935384 20297 raft_consensus.cc:515] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.936573 20244 raft_consensus.cc:359] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.937638 20244 raft_consensus.cc:385] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.937929 20244 raft_consensus.cc:740] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.937665 20297 leader_election.cc:290] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:25.906414 19973 raft_consensus.cc:2468] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:25.949043 20243 ts_tablet_manager.cc:1434] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.004s
I20260709 13:10:25.960093 20242 tablet_bootstrap.cc:654] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.950295 20244 consensus_queue.cc:260] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.975410 20250 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.976366 20289 raft_consensus.cc:493] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.988147 20244 ts_tablet_manager.cc:1434] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
W20260709 13:10:25.984025 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 48144.2us
I20260709 13:10:25.991425 20289 raft_consensus.cc:515] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:25.985263 20250 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:25.999452 20289 leader_election.cc:290] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.000422 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.001741 19975 raft_consensus.cc:2468] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:26.004866 20243 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:26.004952 20248 raft_consensus.cc:359] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.006806 20248 raft_consensus.cc:385] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.007057 20248 raft_consensus.cc:740] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.011641 20389 raft_consensus.cc:493] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.011783 20013 leader_election.cc:304] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.013842 20389 raft_consensus.cc:515] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.017378 20389 leader_election.cc:290] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.017719 20363 raft_consensus.cc:2804] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.018299 20363 raft_consensus.cc:697] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:26.018438 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:26.019261 20363 consensus_queue.cc:237] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.019788 20249 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.021960 20249 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.023976 20249 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.025279 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.026352 19975 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:26.028400 20013 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.018564 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:26.020344 19939 leader_election.cc:343] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.029438 20046 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:26.029690 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:26.030993 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.031260 19940 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.037842 20366 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.038313 20366 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.038648 20366 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.038722 20242 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:26.039287 20244 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.039391 20242 ts_tablet_manager.cc:1403] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.202s	user 0.019s	sys 0.001s
W20260709 13:10:26.043861 20014 leader_election.cc:343] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.031934 20249 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.017221 20250 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.036239 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:26.047022 20249 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.045641 20389 consensus_queue.cc:1048] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:26.048296 20249 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.055236 20087 leader_election.cc:304] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:26.055850 20242 raft_consensus.cc:359] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.058328 20242 raft_consensus.cc:385] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.058724 20242 raft_consensus.cc:740] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.060209 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.061031 19973 raft_consensus.cc:2468] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:26.063860 20345 raft_consensus.cc:2804] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.065135 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.065366 20345 raft_consensus.cc:697] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
W20260709 13:10:26.066205 20162 leader_election.cc:343] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.066715 20345 consensus_queue.cc:237] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:26.067644 19940 leader_election.cc:343] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.068513 20197 raft_consensus.cc:2468] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:26.068984 20242 consensus_queue.cc:260] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.069681 20248 consensus_queue.cc:260] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.069893 20250 consensus_queue.cc:1048] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.070963 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.072013 20250 consensus_queue.cc:1048] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.072695 20161 leader_election.cc:304] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.074671 20349 raft_consensus.cc:2804] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.075067 20349 raft_consensus.cc:493] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.075470 20248 ts_tablet_manager.cc:1434] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.198s	user 0.011s	sys 0.000s
I20260709 13:10:26.075418 20349 raft_consensus.cc:3060] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.076980 20248 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.077924 19871 catalog_manager.cc:5697] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.082917 20244 tablet_bootstrap.cc:654] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.083293 20317 consensus_queue.cc:1048] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.085517 20307 raft_consensus.cc:493] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.078948 20366 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.116405 20242 ts_tablet_manager.cc:1434] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.002s
I20260709 13:10:26.126511 20349 raft_consensus.cc:515] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.086158 20307 raft_consensus.cc:515] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.133193 20242 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:26.150288 20249 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.160440 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:26.160991 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:26.191498 20349 leader_election.cc:290] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.193655 20307 leader_election.cc:290] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:26.193858 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.194360 20242 tablet_bootstrap.cc:654] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.194447 20014 leader_election.cc:343] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.194695 20048 raft_consensus.cc:2468] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:26.196388 20089 leader_election.cc:304] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:26.196606 20123 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.198788 20345 raft_consensus.cc:2804] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.199247 20345 raft_consensus.cc:493] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.199584 20345 raft_consensus.cc:3060] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.201015 20244 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:26.201632 20244 ts_tablet_manager.cc:1403] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.014s
I20260709 13:10:26.203361 20248 tablet_bootstrap.cc:654] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.207204 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 134272us
I20260709 13:10:26.188839 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:26.209714 19975 raft_consensus.cc:3060] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.209936 20345 raft_consensus.cc:515] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.209151 20250 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.212508 20250 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.213599 20345 leader_election.cc:290] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:26.215081 20250 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.216799 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.216451 19870 catalog_manager.cc:5697] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.217481 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:26.218231 20048 raft_consensus.cc:3060] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:26.219374 19940 leader_election.cc:343] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.220265 20250 consensus_queue.cc:1048] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:26.208340 20249 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.208436 20244 raft_consensus.cc:359] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.227792 20244 raft_consensus.cc:385] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:26.227978 20163 leader_election.cc:343] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.229918 20349 consensus_queue.cc:1048] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.228226 20244 raft_consensus.cc:740] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.229956 20163 leader_election.cc:304] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.231935 20244 consensus_queue.cc:260] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.232606 20050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:26.233496 20050 raft_consensus.cc:2393] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:26.233650 20349 raft_consensus.cc:2749] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.234555 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:26.233031 19938 leader_election.cc:304] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:26.236820 20243 tablet_bootstrap.cc:654] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.172122 20399 consensus_queue.cc:1048] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:10:26.252938 20242 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:26.253671 20242 ts_tablet_manager.cc:1403] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.010s
I20260709 13:10:26.161443 19973 raft_consensus.cc:2393] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:26.258718 20242 raft_consensus.cc:359] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.261377 20242 raft_consensus.cc:385] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.262374 20244 ts_tablet_manager.cc:1434] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:10:26.262784 20242 raft_consensus.cc:740] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.245846 19975 raft_consensus.cc:2468] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:26.259914 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.287353 20244 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.283900 20242 consensus_queue.cc:260] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.278040 20013 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:26.288949 20395 raft_consensus.cc:2764] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:26.281143 20161 leader_election.cc:304] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.284678 20366 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.292448 20248 tablet_bootstrap.cc:492] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:26.302819 20248 ts_tablet_manager.cc:1403] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.002s
I20260709 13:10:26.293084 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:26.296296 20087 leader_election.cc:343] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.296643 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.310070 20192 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:26.297519 20048 raft_consensus.cc:2468] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:26.302235 20399 raft_consensus.cc:2749] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.305438 20349 raft_consensus.cc:2804] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.314317 20349 raft_consensus.cc:697] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:26.315425 20349 consensus_queue.cc:237] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.317613 20248 raft_consensus.cc:359] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.325894 20248 raft_consensus.cc:385] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.318720 19871 catalog_manager.cc:5697] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:26.323715 19939 leader_election.cc:343] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.309209 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494e6d6aa8a4b80b4f36c9a880d4ed0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:26.326423 20248 raft_consensus.cc:740] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.328229 20244 tablet_bootstrap.cc:654] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.304149 20163 leader_election.cc:343] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.339622 20242 ts_tablet_manager.cc:1434] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.086s	user 0.003s	sys 0.008s
I20260709 13:10:26.333206 19939 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.346423 20407 raft_consensus.cc:2749] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.349179 20248 consensus_queue.cc:260] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.352151 20194 raft_consensus.cc:3060] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.352895 20248 ts_tablet_manager.cc:1434] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:10:26.360958 20248 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.353260 20089 leader_election.cc:304] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:26.364238 20307 raft_consensus.cc:2804] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.364799 20307 raft_consensus.cc:697] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:26.365705 20307 consensus_queue.cc:237] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.378759 20242 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:26.379240 20194 raft_consensus.cc:2468] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
W20260709 13:10:26.385452 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 90013.6us
I20260709 13:10:26.389711 20349 raft_consensus.cc:493] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.390513 20349 raft_consensus.cc:515] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.391080 19938 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:26.394131 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:26.395257 20349 leader_election.cc:290] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:26.399307 20242 tablet_bootstrap.cc:654] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.402755 20248 tablet_bootstrap.cc:654] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.419008 20408 raft_consensus.cc:2804] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.419569 20408 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.419955 20408 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.422449 20242 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:26.424495 20242 ts_tablet_manager.cc:1403] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.013s
I20260709 13:10:26.427796 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34249aa09174ce3b90e9cbf1bfebb62" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.428817 19975 raft_consensus.cc:2393] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:26.431188 20243 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:26.429683 20242 raft_consensus.cc:359] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.431679 20243 ts_tablet_manager.cc:1403] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.442s	user 0.016s	sys 0.015s
I20260709 13:10:26.431676 20242 raft_consensus.cc:385] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.432951 20161 leader_election.cc:304] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:26.437148 20242 raft_consensus.cc:740] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.438365 20242 consensus_queue.cc:260] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.439838 20349 raft_consensus.cc:3060] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.453140 20242 ts_tablet_manager.cc:1434] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:10:26.454663 20242 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:26.455788 20408 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.458556 20408 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.466334 20244 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:26.467147 20244 ts_tablet_manager.cc:1403] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.190s	user 0.025s	sys 0.006s
I20260709 13:10:26.468509 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:26.473599 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:26.475492 20194 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.478557 19873 catalog_manager.cc:5697] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.479843 20399 consensus_queue.cc:1048] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.482757 20243 raft_consensus.cc:359] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.483582 20243 raft_consensus.cc:385] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.487670 20124 raft_consensus.cc:3060] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.495244 20194 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:26.498220 19938 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.502576 20407 raft_consensus.cc:2804] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.500636 20399 consensus_queue.cc:1048] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:26.503255 20407 raft_consensus.cc:697] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
W20260709 13:10:26.504197 19940 leader_election.cc:343] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.483860 20243 raft_consensus.cc:740] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.510864 20243 consensus_queue.cc:260] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.505125 20407 consensus_queue.cc:237] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.511096 20244 raft_consensus.cc:359] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.518080 20244 raft_consensus.cc:385] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.518435 20244 raft_consensus.cc:740] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.524318 20400 consensus_queue.cc:1048] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.504904 20349 raft_consensus.cc:2749] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.520736 20244 consensus_queue.cc:260] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.548225 20243 ts_tablet_manager.cc:1434] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 13:10:26.550439 20399 consensus_queue.cc:1048] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.561054 20408 raft_consensus.cc:493] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.561661 20408 raft_consensus.cc:515] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.568687 20243 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:26.576519 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:26.578763 19940 leader_election.cc:343] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.579512 20408 leader_election.cc:290] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:26.583328 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:26.585539 19939 leader_election.cc:343] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.586002 19939 leader_election.cc:304] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.586129 20248 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:26.588114 20244 ts_tablet_manager.cc:1434] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.121s	user 0.005s	sys 0.008s
I20260709 13:10:26.588481 20243 tablet_bootstrap.cc:654] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.588534 20248 ts_tablet_manager.cc:1403] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.028s
I20260709 13:10:26.591540 20244 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.592235 20242 tablet_bootstrap.cc:654] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.594669 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:26.595484 20307 consensus_queue.cc:1048] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.598184 19869 catalog_manager.cc:5697] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.591337 19871 catalog_manager.cc:5697] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.612830 20248 raft_consensus.cc:359] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.613695 20248 raft_consensus.cc:385] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.614020 20248 raft_consensus.cc:740] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.621819 20248 consensus_queue.cc:260] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.625078 20248 ts_tablet_manager.cc:1434] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:10:26.600574 20407 raft_consensus.cc:2749] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.628917 20242 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:26.629518 20242 ts_tablet_manager.cc:1403] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.004s
I20260709 13:10:26.632726 20242 raft_consensus.cc:359] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.633673 20244 tablet_bootstrap.cc:654] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.633759 20242 raft_consensus.cc:385] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.634370 20242 raft_consensus.cc:740] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.635340 20242 consensus_queue.cc:260] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.641273 20242 ts_tablet_manager.cc:1434] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:10:26.625034 20344 raft_consensus.cc:493] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af9bb61060db4eff9bfe238bbcbea9ca)
I20260709 13:10:26.643720 20242 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:26.643328 20344 raft_consensus.cc:515] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.645920 20400 raft_consensus.cc:493] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.651091 20248 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.650990 20400 raft_consensus.cc:515] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.655435 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.656517 20407 raft_consensus.cc:493] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.657104 20407 raft_consensus.cc:515] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.658671 20242 tablet_bootstrap.cc:654] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.660020 20400 leader_election.cc:290] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:26.668570 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da0f3e9b2604f71afd4792bd89d38ca" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.669436 19974 raft_consensus.cc:2393] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:26.671423 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:26.673718 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.665772 20407 leader_election.cc:290] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:26.676344 20013 leader_election.cc:304] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:26.677043 20344 leader_election.cc:290] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.679713 20398 raft_consensus.cc:3060] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:26.681967 19938 leader_election.cc:343] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.683111 20307 consensus_queue.cc:1048] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.683429 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
W20260709 13:10:26.688688 19939 leader_election.cc:343] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.688833 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882ba423a74c496d8a4d5dba170a5748" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.689204 19939 leader_election.cc:304] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:26.690568 20407 raft_consensus.cc:2749] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.691232 20248 tablet_bootstrap.cc:654] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.693066 20087 leader_election.cc:304] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:26.693442 20398 raft_consensus.cc:2749] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.693953 20345 raft_consensus.cc:2749] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.739017 20243 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:26.739682 20243 ts_tablet_manager.cc:1403] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.171s	user 0.009s	sys 0.013s
I20260709 13:10:26.743381 20244 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:26.744175 20248 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:26.743997 20244 ts_tablet_manager.cc:1403] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.001s
I20260709 13:10:26.744763 20248 ts_tablet_manager.cc:1403] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.038s
I20260709 13:10:26.747689 20248 raft_consensus.cc:359] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.748383 20248 raft_consensus.cc:385] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.748667 20248 raft_consensus.cc:740] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.748737 20307 raft_consensus.cc:493] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.749269 20307 raft_consensus.cc:515] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.749496 20248 consensus_queue.cc:260] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.751677 20307 leader_election.cc:290] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:26.752771 20248 ts_tablet_manager.cc:1434] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:26.754086 20248 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.753815 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.754670 19975 raft_consensus.cc:2468] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:26.761811 20087 leader_election.cc:304] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.762903 20248 tablet_bootstrap.cc:654] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.763074 20243 raft_consensus.cc:359] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.768275 20243 raft_consensus.cc:385] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.768656 20243 raft_consensus.cc:740] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.769451 20243 consensus_queue.cc:260] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.770690 20248 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:26.771325 20248 ts_tablet_manager.cc:1403] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:10:26.765887 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:26.772112 20194 raft_consensus.cc:2468] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:26.747514 20244 raft_consensus.cc:359] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.763414 20307 raft_consensus.cc:2804] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.773612 20244 raft_consensus.cc:385] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.773702 20307 raft_consensus.cc:493] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.774124 20244 raft_consensus.cc:740] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.774240 20307 raft_consensus.cc:3060] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.774771 20248 raft_consensus.cc:359] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.775527 20248 raft_consensus.cc:385] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.775875 20248 raft_consensus.cc:740] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.775285 20244 consensus_queue.cc:260] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.776659 20248 consensus_queue.cc:260] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.778851 20244 ts_tablet_manager.cc:1434] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:10:26.779083 20248 ts_tablet_manager.cc:1434] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:26.779057 20349 consensus_queue.cc:1048] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.780449 20244 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.780582 20248 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.771499 20243 ts_tablet_manager.cc:1434] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:10:26.787827 20248 tablet_bootstrap.cc:654] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.788026 20244 tablet_bootstrap.cc:654] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.802762 20244 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:26.803455 20244 ts_tablet_manager.cc:1403] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.001s
I20260709 13:10:26.806077 20344 consensus_queue.cc:1048] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.807168 20244 raft_consensus.cc:359] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.807582 20243 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:26.807977 20244 raft_consensus.cc:385] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.808458 20244 raft_consensus.cc:740] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.809222 20244 consensus_queue.cc:260] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.810217 20307 raft_consensus.cc:515] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.811820 20244 ts_tablet_manager.cc:1434] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:26.819052 20349 raft_consensus.cc:493] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.835927 20244 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.819908 20349 raft_consensus.cc:515] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:26.838153 20349 leader_election.cc:290] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:26.844462 20307 leader_election.cc:290] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:26.845757 20248 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:26.845665 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:26.846487 20248 ts_tablet_manager.cc:1403] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.028s
I20260709 13:10:26.846463 19975 raft_consensus.cc:3060] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.848621 20243 tablet_bootstrap.cc:654] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.853210 19975 raft_consensus.cc:2468] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:26.855094 20087 leader_election.cc:304] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:26.855793 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7888f5f6364427b9a0d647763feb39f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.856087 20345 raft_consensus.cc:2804] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.856567 20345 raft_consensus.cc:697] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:26.857497 20345 consensus_queue.cc:237] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.858287 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc07241f7bb4356a03e4bb862681665" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:26.859290 20194 raft_consensus.cc:3060] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.857565 20244 tablet_bootstrap.cc:654] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.868531 20248 raft_consensus.cc:359] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:26.869778 20248 raft_consensus.cc:385] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.870182 20248 raft_consensus.cc:740] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.873487 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7888f5f6364427b9a0d647763feb39f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:26.873293 20248 consensus_queue.cc:260] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:26.857365 20163 leader_election.cc:343] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.874467 19973 raft_consensus.cc:2468] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:26.900285 20243 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:26.901006 20243 ts_tablet_manager.cc:1403] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.020s
I20260709 13:10:26.904549 20248 ts_tablet_manager.cc:1434] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:10:26.912556 20243 raft_consensus.cc:359] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.913499 20243 raft_consensus.cc:385] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.913787 20243 raft_consensus.cc:740] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.924383 20243 consensus_queue.cc:260] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.906970 20297 consensus_queue.cc:1048] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:10:26.929567 20242 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:26.930300 20242 ts_tablet_manager.cc:1403] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.287s	user 0.026s	sys 0.048s
I20260709 13:10:26.933002 20248 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:26.919580 20345 raft_consensus.cc:493] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.945526 20345 raft_consensus.cc:515] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:26.952478 20243 ts_tablet_manager.cc:1434] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 13:10:26.955201 20244 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:26.955224 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:26.955904 20244 ts_tablet_manager.cc:1403] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.007s
I20260709 13:10:26.957244 20194 raft_consensus.cc:2468] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
W20260709 13:10:26.957432 20089 leader_election.cc:343] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.920293 20161 leader_election.cc:304] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:26.959038 20244 raft_consensus.cc:359] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.959781 20244 raft_consensus.cc:385] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.960068 20244 raft_consensus.cc:740] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
W20260709 13:10:26.960018 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 45316.2us
I20260709 13:10:26.961097 20439 raft_consensus.cc:2804] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.961638 20439 raft_consensus.cc:493] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.961314 20244 consensus_queue.cc:260] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.969944 20244 ts_tablet_manager.cc:1434] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:26.971215 20244 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:26.964170 20439 raft_consensus.cc:3060] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.976388 20243 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:26.969038 20345 leader_election.cc:290] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:26.993291 20248 tablet_bootstrap.cc:654] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.996399 20242 raft_consensus.cc:359] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:26.997128 20242 raft_consensus.cc:385] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.997382 20242 raft_consensus.cc:740] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.996650 19871 catalog_manager.cc:5697] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.000634 20242 consensus_queue.cc:260] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.002565 20439 raft_consensus.cc:515] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.003440 20242 ts_tablet_manager.cc:1434] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 13:10:27.006579 20244 tablet_bootstrap.cc:654] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.009694 20243 tablet_bootstrap.cc:654] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.010749 20400 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.011391 20400 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.014322 20400 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:27.018501 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.019438 20194 raft_consensus.cc:2393] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:27.019641 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.020572 20242 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:27.023644 20013 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:27.024248 20345 consensus_queue.cc:1048] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.025172 20249 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.032473 20407 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.045116 20407 raft_consensus.cc:493] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.046186 20407 raft_consensus.cc:515] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.048115 20249 raft_consensus.cc:2749] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.049849 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.050592 20439 leader_election.cc:290] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:27.051604 19940 leader_election.cc:343] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.056450 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7888f5f6364427b9a0d647763feb39f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:27.062026 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7888f5f6364427b9a0d647763feb39f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.067317 20408 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.069034 20407 leader_election.cc:290] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:27.070325 20163 leader_election.cc:343] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.071931 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.072629 20197 raft_consensus.cc:2468] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:27.078322 19973 raft_consensus.cc:3060] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.084941 20244 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:27.085619 20244 ts_tablet_manager.cc:1403] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.007s
I20260709 13:10:27.086598 20243 tablet_bootstrap.cc:492] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.087095 20243 ts_tablet_manager.cc:1403] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.022s
I20260709 13:10:27.088786 20244 raft_consensus.cc:359] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.089578 20244 raft_consensus.cc:385] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.089989 20244 raft_consensus.cc:740] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.089339 20087 leader_election.cc:304] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:27.092232 20345 raft_consensus.cc:2804] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.092651 20345 raft_consensus.cc:493] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.093046 20345 raft_consensus.cc:3060] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.099221 20243 raft_consensus.cc:359] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.101833 20248 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.102419 20248 ts_tablet_manager.cc:1403] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.182s	user 0.038s	sys 0.036s
I20260709 13:10:27.103432 20243 raft_consensus.cc:385] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.103838 20243 raft_consensus.cc:740] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.090822 20244 consensus_queue.cc:260] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.104630 20243 consensus_queue.cc:260] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.105973 20345 raft_consensus.cc:515] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.107344 20243 ts_tablet_manager.cc:1434] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:27.108721 20243 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.109366 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:27.110023 20049 raft_consensus.cc:3060] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.110275 20439 raft_consensus.cc:493] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.111085 20439 raft_consensus.cc:515] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.115228 20243 tablet_bootstrap.cc:654] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.117233 19973 raft_consensus.cc:2468] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:27.124362 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3c66d6c878411e93702c52bee230c1" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.125003 20161 leader_election.cc:304] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:27.119372 20049 raft_consensus.cc:2468] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:27.125118 20047 raft_consensus.cc:2468] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:27.126109 20297 raft_consensus.cc:2804] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.126874 20297 raft_consensus.cc:697] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:27.127566 20163 leader_election.cc:304] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:27.128787 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.127758 20297 consensus_queue.cc:237] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.128916 20441 raft_consensus.cc:2804] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.129757 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3c66d6c878411e93702c52bee230c1" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.126228 20244 ts_tablet_manager.cc:1434] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:10:27.131372 20244 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:27.134497 20162 leader_election.cc:343] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.129978 20441 raft_consensus.cc:493] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.135411 20441 raft_consensus.cc:3060] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.136515 19939 leader_election.cc:343] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.137028 19939 leader_election.cc:304] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.138080 20366 raft_consensus.cc:2749] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.139681 20089 leader_election.cc:304] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:27.142469 20345 leader_election.cc:290] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.142807 20445 raft_consensus.cc:2804] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.143411 20445 raft_consensus.cc:697] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:27.144291 20445 consensus_queue.cc:237] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.145586 20248 raft_consensus.cc:359] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.146343 20248 raft_consensus.cc:385] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.146582 20248 raft_consensus.cc:740] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.147210 20248 consensus_queue.cc:260] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.148180 20243 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.148729 20243 ts_tablet_manager.cc:1403] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.006s
I20260709 13:10:27.153245 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928d42c4bfd54d59bdda6b75cfd037db" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:27.153841 20197 raft_consensus.cc:3060] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.154556 20441 raft_consensus.cc:515] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.159415 20439 leader_election.cc:290] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.151423 20243 raft_consensus.cc:359] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.163900 20197 raft_consensus.cc:2468] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:27.163965 20243 raft_consensus.cc:385] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.164667 20243 raft_consensus.cc:740] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.165423 20243 consensus_queue.cc:260] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.172363 20243 ts_tablet_manager.cc:1434] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:10:27.173444 20243 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.121424 20242 tablet_bootstrap.cc:654] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.178488 20248 ts_tablet_manager.cc:1434] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 13:10:27.179714 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3c66d6c878411e93702c52bee230c1" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:27.181396 20049 raft_consensus.cc:3060] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.184676 20243 tablet_bootstrap.cc:654] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.186661 20441 leader_election.cc:290] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.187204 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3c66d6c878411e93702c52bee230c1" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:27.189195 20162 leader_election.cc:343] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.191375 20244 tablet_bootstrap.cc:654] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.193317 20408 raft_consensus.cc:493] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.193879 20408 raft_consensus.cc:515] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.194851 20248 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.197237 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:27.198828 19939 leader_election.cc:343] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.199434 19871 catalog_manager.cc:5697] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.204340 20243 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.204928 20243 ts_tablet_manager.cc:1403] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.010s
I20260709 13:10:27.204722 20408 leader_election.cc:290] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.207326 20248 tablet_bootstrap.cc:654] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.207610 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.208084 20243 raft_consensus.cc:359] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.208981 20243 raft_consensus.cc:385] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.209367 20243 raft_consensus.cc:740] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.210477 20243 consensus_queue.cc:260] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.213515 20243 ts_tablet_manager.cc:1434] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:27.208732 20194 raft_consensus.cc:2468] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:27.217985 20243 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.219748 19938 leader_election.cc:304] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.221823 20408 raft_consensus.cc:2804] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.222435 20408 raft_consensus.cc:493] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.222942 20408 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.224761 20243 tablet_bootstrap.cc:654] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.226578 20248 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.227212 20248 ts_tablet_manager.cc:1403] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:10:27.233374 20249 raft_consensus.cc:493] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.234071 20249 raft_consensus.cc:515] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.235529 20366 raft_consensus.cc:493] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.236308 20366 raft_consensus.cc:515] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.237037 20249 leader_election.cc:290] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.238355 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
W20260709 13:10:27.240792 20013 leader_election.cc:343] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.241073 20366 leader_election.cc:290] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.242627 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.243018 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.245050 20248 raft_consensus.cc:359] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.246008 20248 raft_consensus.cc:385] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.246349 20248 raft_consensus.cc:740] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:27.246702 19939 leader_election.cc:343] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.247145 20248 consensus_queue.cc:260] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:27.247774 20014 leader_election.cc:343] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.248477 20243 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.249135 20243 ts_tablet_manager.cc:1403] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.010s
I20260709 13:10:27.249866 20248 ts_tablet_manager.cc:1434] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:10:27.248512 20014 leader_election.cc:304] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:27.251134 20248 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.251379 20249 raft_consensus.cc:2749] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.252174 20243 raft_consensus.cc:359] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.252916 20243 raft_consensus.cc:385] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.253175 20243 raft_consensus.cc:740] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.254012 20439 raft_consensus.cc:493] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.254537 20439 raft_consensus.cc:515] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.256703 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.257025 20439 leader_election.cc:290] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:27.257833 20243 consensus_queue.cc:260] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.259657 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.261034 20243 ts_tablet_manager.cc:1434] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:27.263340 20243 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.263840 20408 raft_consensus.cc:515] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:27.264807 20162 leader_election.cc:343] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.269376 20243 tablet_bootstrap.cc:654] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.270179 20049 raft_consensus.cc:2468] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:27.274873 20163 leader_election.cc:304] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.275187 20244 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:27.275749 20244 ts_tablet_manager.cc:1403] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.010s
I20260709 13:10:27.276270 20441 raft_consensus.cc:2804] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.276866 20441 raft_consensus.cc:697] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:27.278579 20244 raft_consensus.cc:359] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.279301 20244 raft_consensus.cc:385] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.279572 20244 raft_consensus.cc:740] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.281087 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:27.281731 20197 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.282343 19938 leader_election.cc:343] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.282860 19938 leader_election.cc:304] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.284323 20366 raft_consensus.cc:2749] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.285801 20441 consensus_queue.cc:237] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.288125 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.288856 19973 raft_consensus.cc:2468] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:27.272218 20408 leader_election.cc:290] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.290110 20161 leader_election.cc:304] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.292117 20439 raft_consensus.cc:2804] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.292811 20439 raft_consensus.cc:493] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.281133 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:27.293331 20439 raft_consensus.cc:3060] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.294950 19939 leader_election.cc:343] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.297372 20197 raft_consensus.cc:2468] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:27.280295 20244 consensus_queue.cc:260] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.300500 20244 ts_tablet_manager.cc:1434] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:10:27.302191 20244 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:27.309787 20244 tablet_bootstrap.cc:654] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.310596 20445 consensus_queue.cc:1048] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.281852 20242 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:27.317854 20242 ts_tablet_manager.cc:1403] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.298s	user 0.011s	sys 0.002s
I20260709 13:10:27.321080 20242 raft_consensus.cc:359] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.328145 20242 raft_consensus.cc:385] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.330879 20248 tablet_bootstrap.cc:654] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.337440 20243 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.337957 20243 ts_tablet_manager.cc:1403] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.014s
I20260709 13:10:27.331646 20439 raft_consensus.cc:515] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.312798 19938 leader_election.cc:304] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.335541 20244 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:27.347373 20244 ts_tablet_manager.cc:1403] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 13:10:27.342677 20242 raft_consensus.cc:740] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.345890 20248 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.348268 20248 ts_tablet_manager.cc:1403] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.008s
I20260709 13:10:27.351585 20248 raft_consensus.cc:359] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.352432 20248 raft_consensus.cc:385] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.341475 20408 raft_consensus.cc:2804] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.352667 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:27.353318 20408 raft_consensus.cc:697] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:27.354482 20408 consensus_queue.cc:237] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.358009 20242 consensus_queue.cc:260] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.358949 20123 raft_consensus.cc:3060] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.361596 19873 catalog_manager.cc:5697] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.364414 20249 raft_consensus.cc:493] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.365023 20249 raft_consensus.cc:515] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.367808 20123 raft_consensus.cc:2468] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:27.369557 20249 leader_election.cc:290] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.340803 20243 raft_consensus.cc:359] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.370883 20243 raft_consensus.cc:385] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.371336 20243 raft_consensus.cc:740] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.372299 20243 consensus_queue.cc:260] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.372879 20242 ts_tablet_manager.cc:1434] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.004s
I20260709 13:10:27.375204 20242 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:27.375635 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.376569 19974 raft_consensus.cc:2468] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:27.378638 20013 leader_election.cc:304] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:27.380501 20400 raft_consensus.cc:2804] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.380986 20400 raft_consensus.cc:493] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.381359 20400 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.385674 20243 ts_tablet_manager.cc:1434] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:10:27.387485 20242 tablet_bootstrap.cc:654] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.389436 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.393172 20439 leader_election.cc:290] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:27.393951 20014 leader_election.cc:343] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.396651 20162 leader_election.cc:304] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:27.403635 20297 raft_consensus.cc:2804] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.404415 20297 raft_consensus.cc:697] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:27.405555 20445 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.406469 20445 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.405601 20297 consensus_queue.cc:237] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.413460 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.414723 20049 raft_consensus.cc:2393] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:27.415467 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.418941 19975 raft_consensus.cc:2393] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:27.396514 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.427845 20445 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.427547 20087 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:27.430272 20344 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.430795 20243 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.435907 20244 raft_consensus.cc:359] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.436755 20244 raft_consensus.cc:385] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.436977 20244 raft_consensus.cc:740] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.352744 20248 raft_consensus.cc:740] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.428876 19974 raft_consensus.cc:3060] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.440240 20244 consensus_queue.cc:260] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.456378 20248 consensus_queue.cc:260] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.459913 20244 ts_tablet_manager.cc:1434] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:10:27.463876 20248 ts_tablet_manager.cc:1434] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 13:10:27.466059 19872 catalog_manager.cc:5697] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.469738 20243 tablet_bootstrap.cc:654] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.473493 20307 consensus_queue.cc:1048] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.485270 20248 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.488291 19974 raft_consensus.cc:2468] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:27.492790 20248 tablet_bootstrap.cc:654] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.502849 19873 catalog_manager.cc:5697] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.505781 20248 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.506321 20248 ts_tablet_manager.cc:1403] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:10:27.478106 20400 raft_consensus.cc:515] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.478852 20244 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:27.478685 20249 raft_consensus.cc:493] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.508899 20249 raft_consensus.cc:515] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.511158 20249 leader_election.cc:290] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.480793 20344 raft_consensus.cc:2749] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.482429 20242 tablet_bootstrap.cc:492] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:27.512292 20242 ts_tablet_manager.cc:1403] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.137s	user 0.027s	sys 0.048s
I20260709 13:10:27.509311 20248 raft_consensus.cc:359] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.512830 20248 raft_consensus.cc:385] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.513124 20248 raft_consensus.cc:740] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.515249 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.516175 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:27.516832 20014 leader_election.cc:343] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.516862 20197 raft_consensus.cc:2468] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:27.515615 20242 raft_consensus.cc:359] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.520154 20242 raft_consensus.cc:385] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.519938 20013 leader_election.cc:304] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.520573 20242 raft_consensus.cc:740] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.521409 20242 consensus_queue.cc:260] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.515291 20248 consensus_queue.cc:260] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.526340 20244 tablet_bootstrap.cc:654] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.528334 20248 ts_tablet_manager.cc:1434] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:10:27.528592 20242 ts_tablet_manager.cc:1434] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:27.530027 20242 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:27.533782 20248 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.535692 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.536804 19974 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.540921 20249 raft_consensus.cc:2804] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.542403 20249 raft_consensus.cc:493] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.542807 20249 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.545432 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:27.547147 20014 leader_election.cc:343] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.545809 20242 tablet_bootstrap.cc:654] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.551608 20400 leader_election.cc:290] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.556666 20248 tablet_bootstrap.cc:654] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.569005 19974 raft_consensus.cc:2468] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:27.579860 20013 leader_election.cc:304] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.580839 20400 raft_consensus.cc:2804] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.580960 20249 raft_consensus.cc:515] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.581442 20400 raft_consensus.cc:697] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:27.582422 20400 consensus_queue.cc:237] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.587219 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:27.589218 20014 leader_election.cc:343] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.601928 20242 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:27.602568 20242 ts_tablet_manager.cc:1403] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.006s
I20260709 13:10:27.601553 19870 catalog_manager.cc:5697] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.611727 20344 consensus_queue.cc:1048] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.618144 20297 consensus_queue.cc:1048] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.628870 20248 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.629784 20248 ts_tablet_manager.cc:1403] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.012s
I20260709 13:10:27.631592 20344 consensus_queue.cc:1048] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.608124 20242 raft_consensus.cc:359] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.632838 20242 raft_consensus.cc:385] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.633308 20242 raft_consensus.cc:740] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.645512 20047 raft_consensus.cc:3060] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.636260 20242 consensus_queue.cc:260] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.654332 20248 raft_consensus.cc:359] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.655486 20248 raft_consensus.cc:385] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.655839 20248 raft_consensus.cc:740] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.659549 20242 ts_tablet_manager.cc:1434] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:10:27.661249 20242 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:27.660919 20297 consensus_queue.cc:1048] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.662572 20248 consensus_queue.cc:260] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.666499 20248 ts_tablet_manager.cc:1434] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:10:27.667788 20248 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.668771 19871 catalog_manager.cc:5697] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.674456 20248 tablet_bootstrap.cc:654] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.683754 20243 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.700464 20243 ts_tablet_manager.cc:1403] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.270s	user 0.037s	sys 0.036s
I20260709 13:10:27.699470 20242 tablet_bootstrap.cc:654] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.703323 20249 leader_election.cc:290] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:27.712024 20244 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:27.712714 20244 ts_tablet_manager.cc:1403] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.234s	user 0.043s	sys 0.057s
I20260709 13:10:27.714143 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:27.716732 20194 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.718778 20244 raft_consensus.cc:359] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.719586 20244 raft_consensus.cc:385] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.719904 20244 raft_consensus.cc:740] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.719959 20243 raft_consensus.cc:359] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.720718 20243 raft_consensus.cc:385] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.721037 20243 raft_consensus.cc:740] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.721938 20297 raft_consensus.cc:493] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.722349 20243 consensus_queue.cc:260] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.725607 20243 ts_tablet_manager.cc:1434] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:10:27.721037 20244 consensus_queue.cc:260] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:27.728579 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:27.740098 20244 ts_tablet_manager.cc:1434] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:10:27.745275 20248 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:27.746209 20248 ts_tablet_manager.cc:1403] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.004s
I20260709 13:10:27.750206 20248 raft_consensus.cc:359] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.751896 20248 raft_consensus.cc:385] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.752285 20248 raft_consensus.cc:740] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.753118 20248 consensus_queue.cc:260] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.751305 20194 raft_consensus.cc:2468] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:27.755944 20248 ts_tablet_manager.cc:1434] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:27.756456 20437 raft_consensus.cc:493] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.757110 20123 raft_consensus.cc:3060] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.756978 20437 raft_consensus.cc:515] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.759311 20437 leader_election.cc:290] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:27.761550 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.761896 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.763093 19973 raft_consensus.cc:2468] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:27.765677 20161 leader_election.cc:304] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:27.766541 20297 raft_consensus.cc:515] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.769706 20243 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:27.769899 20297 leader_election.cc:290] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.770977 20297 raft_consensus.cc:2804] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.767508 20244 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:27.767400 20162 leader_election.cc:343] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.771457 20297 raft_consensus.cc:493] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.783241 20439 consensus_queue.cc:1048] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.773996 20408 raft_consensus.cc:493] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.792815 20408 raft_consensus.cc:515] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.794938 20307 raft_consensus.cc:493] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.795672 20307 raft_consensus.cc:515] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.781745 20297 raft_consensus.cc:3060] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.796406 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.797458 20047 raft_consensus.cc:2468] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:27.798069 20307 leader_election.cc:290] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.798882 19940 leader_election.cc:304] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:27.795503 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.795101 20408 leader_election.cc:290] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.800549 20408 raft_consensus.cc:493] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.801000 20408 raft_consensus.cc:515] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.784101 20248 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:27.787689 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:27.803333 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:27.816334 20162 leader_election.cc:343] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.814105 20048 raft_consensus.cc:2468] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
W20260709 13:10:27.819015 20163 leader_election.cc:343] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.819725 20163 leader_election.cc:304] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.820276 20089 leader_election.cc:304] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:27.795565 20013 leader_election.cc:304] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:27.821704 20307 raft_consensus.cc:2804] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.822144 20478 raft_consensus.cc:2804] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.822333 20307 raft_consensus.cc:493] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.822818 20478 raft_consensus.cc:697] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:27.823118 20437 consensus_queue.cc:1048] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.823789 20478 consensus_queue.cc:237] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:27.825330 20437 raft_consensus.cc:2749] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.831862 20307 raft_consensus.cc:3060] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.842311 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.832859 20437 raft_consensus.cc:493] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.845773 20437 raft_consensus.cc:515] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.846833 20194 raft_consensus.cc:2468] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:27.832752 20488 raft_consensus.cc:2804] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.850458 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.854020 20244 tablet_bootstrap.cc:654] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.858285 20439 consensus_queue.cc:1048] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.859205 20437 leader_election.cc:290] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.864334 19974 raft_consensus.cc:2468] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:27.866859 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.867637 20048 raft_consensus.cc:2468] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:27.868697 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.868928 20163 leader_election.cc:304] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:27.869869 20439 raft_consensus.cc:2804] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.867822 20242 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:27.870222 20439 raft_consensus.cc:493] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.870569 20439 raft_consensus.cc:3060] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.870921 20490 consensus_queue.cc:1048] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.865676 20437 raft_consensus.cc:493] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.873669 20437 raft_consensus.cc:515] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.875813 20243 tablet_bootstrap.cc:654] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.870544 20242 ts_tablet_manager.cc:1403] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.044s
I20260709 13:10:27.878476 20439 raft_consensus.cc:515] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.880544 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:27.882791 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.891234 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:27.891574 20163 leader_election.cc:343] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.883548 20437 leader_election.cc:290] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.885514 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:27.887280 19873 catalog_manager.cc:5697] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.889578 20366 raft_consensus.cc:493] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.894088 20242 raft_consensus.cc:359] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.900995 20242 raft_consensus.cc:385] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.860966 20488 raft_consensus.cc:493] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.901321 20242 raft_consensus.cc:740] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.899499 20297 raft_consensus.cc:515] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.899956 20366 raft_consensus.cc:515] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.903797 20047 raft_consensus.cc:2468] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:27.876979 20307 raft_consensus.cc:515] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:27.906126 20242 consensus_queue.cc:260] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:27.886425 20408 leader_election.cc:290] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:27.908185 19973 raft_consensus.cc:2468] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:27.911159 20366 leader_election.cc:290] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.912174 19940 leader_election.cc:304] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:27.913532 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:27.921121 20122 raft_consensus.cc:2393] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:27.921247 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:27.924443 20162 leader_election.cc:343] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.925781 19940 leader_election.cc:343] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.905781 20488 raft_consensus.cc:3060] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.934448 20161 leader_election.cc:304] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:27.935451 20349 raft_consensus.cc:2804] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.935740 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:27.935878 20349 raft_consensus.cc:493] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.937511 20349 raft_consensus.cc:3060] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.938634 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:27.939301 20047 raft_consensus.cc:3060] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.918864 20366 raft_consensus.cc:2804] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.940532 20366 raft_consensus.cc:493] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.941028 20366 raft_consensus.cc:3060] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.947862 20349 raft_consensus.cc:515] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:27.949774 20197 raft_consensus.cc:2393] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:27.951853 20248 tablet_bootstrap.cc:654] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.957747 20242 ts_tablet_manager.cc:1434] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.072s	user 0.002s	sys 0.006s
I20260709 13:10:27.961439 20441 consensus_queue.cc:1048] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.963181 20297 leader_election.cc:290] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:27.972606 20244 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:27.973201 20244 ts_tablet_manager.cc:1403] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.206s	user 0.024s	sys 0.009s
I20260709 13:10:27.974582 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:27.975322 19938 leader_election.cc:304] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:27.976256 20408 raft_consensus.cc:3060] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.976680 20242 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:27.977545 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.935807 20307 leader_election.cc:290] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.971055 20349 leader_election.cc:290] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.980404 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.991174 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:27.992018 19971 raft_consensus.cc:3060] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.993283 20243 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:27.993722 20439 leader_election.cc:290] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:27.993855 20243 ts_tablet_manager.cc:1403] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.224s	user 0.025s	sys 0.027s
I20260709 13:10:27.992619 20124 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.003563 20047 raft_consensus.cc:2468] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:28.009943 20244 raft_consensus.cc:359] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.011559 20244 raft_consensus.cc:385] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.011850 20244 raft_consensus.cc:740] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.012621 20244 consensus_queue.cc:260] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:28.015970 20163 leader_election.cc:343] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.023682 19970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:28.029083 20408 raft_consensus.cc:2749] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.029546 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:28.024863 20089 leader_election.cc:304] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:28.030155 20049 raft_consensus.cc:3060] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.037253 20408 consensus_queue.cc:1048] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.040553 20446 raft_consensus.cc:2804] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.041262 20446 raft_consensus.cc:697] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:28.036063 20488 raft_consensus.cc:515] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.042433 19974 raft_consensus.cc:2393] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:28.042340 20446 consensus_queue.cc:237] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:28.043372 20014 consensus_peers.cc:597] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.042784 20366 raft_consensus.cc:515] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.044829 19973 raft_consensus.cc:2393] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:28.049275 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:28.050038 20047 raft_consensus.cc:2393] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:28.050947 19975 raft_consensus.cc:2468] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:28.051138 20249 consensus_queue.cc:1048] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.057111 20243 raft_consensus.cc:359] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.061564 20243 raft_consensus.cc:385] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.066289 20244 ts_tablet_manager.cc:1434] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.001s
I20260709 13:10:28.067700 20244 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:28.076812 20242 tablet_bootstrap.cc:654] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.078486 20488 leader_election.cc:290] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:28.062273 20243 raft_consensus.cc:740] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.080538 20243 consensus_queue.cc:260] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.083576 20244 tablet_bootstrap.cc:654] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.088057 20243 ts_tablet_manager.cc:1434] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:10:28.088223 19971 raft_consensus.cc:2468] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:28.090304 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
W20260709 13:10:28.091471 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 43765.2us
I20260709 13:10:28.101058 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:28.102160 20195 raft_consensus.cc:2393] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:28.107705 20161 leader_election.cc:304] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.108441 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163d17ff6a2c4c4795e2cdbe07cd15dc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:28.109644 20439 raft_consensus.cc:2804] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.110183 20243 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:28.110351 19939 leader_election.cc:304] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.110203 20439 raft_consensus.cc:697] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:28.112629 20439 consensus_queue.cc:237] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.111675 20408 raft_consensus.cc:2749] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.125161 20248 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:28.125819 20248 ts_tablet_manager.cc:1403] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.342s	user 0.016s	sys 0.005s
I20260709 13:10:28.100535 20366 leader_election.cc:290] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.134336 20161 leader_election.cc:304] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:28.135910 20349 raft_consensus.cc:2804] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.137351 20349 raft_consensus.cc:697] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:28.145848 19940 leader_election.cc:304] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:28.145740 20349 consensus_queue.cc:237] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.148238 20408 raft_consensus.cc:2749] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.150664 20243 tablet_bootstrap.cc:654] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.153266 20499 log.cc:927] Time spent T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:10:28.180351 20049 raft_consensus.cc:2468] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:28.188611 20242 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:28.189747 20242 ts_tablet_manager.cc:1403] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.009s
I20260709 13:10:28.200428 20248 raft_consensus.cc:359] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.201957 20248 raft_consensus.cc:385] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.202255 20248 raft_consensus.cc:740] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.210393 20242 raft_consensus.cc:359] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.211334 20242 raft_consensus.cc:385] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.211615 20242 raft_consensus.cc:740] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.204475 20248 consensus_queue.cc:260] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.207332 20163 leader_election.cc:304] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:28.220506 20243 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:28.221122 20243 ts_tablet_manager.cc:1403] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.013s
I20260709 13:10:28.221668 19873 catalog_manager.cc:5697] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.215875 20242 consensus_queue.cc:260] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.225003 20242 ts_tablet_manager.cc:1434] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:10:28.226275 20242 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:28.227236 20243 raft_consensus.cc:359] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.228065 20243 raft_consensus.cc:385] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.228364 20243 raft_consensus.cc:740] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.229308 20243 consensus_queue.cc:260] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.234318 20243 ts_tablet_manager.cc:1434] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:28.235551 20243 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:28.249614 20490 raft_consensus.cc:493] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.250101 20243 tablet_bootstrap.cc:654] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.243964 20496 raft_consensus.cc:2804] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.250139 20490 raft_consensus.cc:515] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.251292 20496 raft_consensus.cc:697] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:28.252550 20496 consensus_queue.cc:237] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.253836 20490 leader_election.cc:290] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.255064 20244 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:28.255710 20244 ts_tablet_manager.cc:1403] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.002s
I20260709 13:10:28.243474 20248 ts_tablet_manager.cc:1434] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.006s
I20260709 13:10:28.258451 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:28.259866 19939 leader_election.cc:343] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.261863 20242 tablet_bootstrap.cc:654] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.266083 20243 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:28.265988 20500 raft_consensus.cc:493] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.266778 20243 ts_tablet_manager.cc:1403] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.010s
I20260709 13:10:28.266692 20500 raft_consensus.cc:515] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.269343 20500 leader_election.cc:290] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:28.270507 20249 raft_consensus.cc:493] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.270687 20244 raft_consensus.cc:359] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.271055 20249 raft_consensus.cc:515] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.271481 20244 raft_consensus.cc:385] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.272121 20244 raft_consensus.cc:740] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.273090 20244 consensus_queue.cc:260] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.274660 20249 leader_election.cc:290] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.275624 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:28.270076 20243 raft_consensus.cc:359] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.276180 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:28.276473 20243 raft_consensus.cc:385] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.276638 19973 raft_consensus.cc:2393] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:28.276822 20243 raft_consensus.cc:740] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.277087 20244 ts_tablet_manager.cc:1434] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
W20260709 13:10:28.277511 20014 leader_election.cc:343] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.274631 20490 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.277911 20243 consensus_queue.cc:260] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.278328 20490 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.280359 20244 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:28.280604 20243 ts_tablet_manager.cc:1434] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:10:28.281313 20490 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.281724 20243 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:28.281985 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:28.282789 20123 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:28.275552 20248 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:28.284662 19939 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:28.286156 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:28.286865 20049 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:28.288344 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.288913 20490 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:28.289325 20490 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.289971 20490 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.290030 20408 raft_consensus.cc:493] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.290741 20408 raft_consensus.cc:515] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.291632 20243 tablet_bootstrap.cc:654] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.293277 20408 leader_election.cc:290] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:28.293780 19938 leader_election.cc:343] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.294322 19938 leader_election.cc:304] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.295456 20408 raft_consensus.cc:2749] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.296501 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.296545 20242 tablet_bootstrap.cc:492] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:28.297372 20195 raft_consensus.cc:2468] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:28.297737 20242 ts_tablet_manager.cc:1403] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.000s
I20260709 13:10:28.300613 20013 leader_election.cc:304] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.300743 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae08a3fb8914d8eb858aea9fd39e4d8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.301824 20478 raft_consensus.cc:2804] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.302021 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:28.302254 20478 raft_consensus.cc:493] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.303231 20478 raft_consensus.cc:3060] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.306178 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:28.307754 19940 leader_election.cc:343] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.312614 20249 consensus_queue.cc:1048] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.320416 20248 tablet_bootstrap.cc:654] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.326778 20478 raft_consensus.cc:515] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:28.329624 20014 consensus_peers.cc:597] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.330745 20087 leader_election.cc:304] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:28.335386 19871 catalog_manager.cc:5697] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:28.328343 19939 leader_election.cc:343] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.338229 20242 raft_consensus.cc:359] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.339576 20242 raft_consensus.cc:385] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.339912 20242 raft_consensus.cc:740] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.340592 20500 raft_consensus.cc:3060] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.341006 20242 consensus_queue.cc:260] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.340674 19939 leader_election.cc:304] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.346103 20408 raft_consensus.cc:2749] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.347055 20242 ts_tablet_manager.cc:1434] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:10:28.347798 20244 tablet_bootstrap.cc:654] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.351518 20242 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:28.348855 19871 catalog_manager.cc:5697] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.356887 19871 catalog_manager.cc:5697] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.363421 20490 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.364171 20243 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:28.364686 20243 ts_tablet_manager.cc:1403] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.023s
I20260709 13:10:28.365538 20249 raft_consensus.cc:493] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.368530 20248 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:28.368934 20490 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.369552 20248 ts_tablet_manager.cc:1403] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.005s
I20260709 13:10:28.371747 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:28.372474 20123 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.366976 20249 raft_consensus.cc:515] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.373886 20248 raft_consensus.cc:359] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.377871 20248 raft_consensus.cc:385] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.378208 20248 raft_consensus.cc:740] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.368920 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:28.384519 20478 leader_election.cc:290] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.384609 20049 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.385269 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:28.378921 20248 consensus_queue.cc:260] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.387787 20248 ts_tablet_manager.cc:1434] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:10:28.388952 20248 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:28.389032 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:28.389719 20194 raft_consensus.cc:3060] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.391245 20249 leader_election.cc:290] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.396209 20248 tablet_bootstrap.cc:654] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.396946 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:28.397058 20014 leader_election.cc:343] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.398412 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:28.399325 19973 raft_consensus.cc:2468] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:28.401258 20013 leader_election.cc:304] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:28.403801 20500 raft_consensus.cc:2749] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.405534 20478 raft_consensus.cc:2804] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.406037 20478 raft_consensus.cc:493] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.406464 20478 raft_consensus.cc:3060] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.407882 20243 raft_consensus.cc:359] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:28.406028 20014 leader_election.cc:343] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.409166 20243 raft_consensus.cc:385] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.410341 20243 raft_consensus.cc:740] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.426765 20243 consensus_queue.cc:260] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.430426 20243 ts_tablet_manager.cc:1434] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:10:28.431249 20244 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:28.431851 20242 tablet_bootstrap.cc:654] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.435014 20244 ts_tablet_manager.cc:1403] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.155s	user 0.050s	sys 0.012s
I20260709 13:10:28.443634 20243 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:28.449611 20248 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:28.450284 20248 ts_tablet_manager.cc:1403] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.016s
I20260709 13:10:28.443526 20194 raft_consensus.cc:2468] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:28.454087 20248 raft_consensus.cc:359] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.454881 20248 raft_consensus.cc:385] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.455132 20248 raft_consensus.cc:740] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.455500 20013 leader_election.cc:304] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.457827 20518 raft_consensus.cc:2804] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.458403 20518 raft_consensus.cc:697] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:28.459452 20243 tablet_bootstrap.cc:654] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.438241 20249 raft_consensus.cc:493] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.463320 20248 consensus_queue.cc:260] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.466692 20248 ts_tablet_manager.cc:1434] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:10:28.469162 20248 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:28.459331 20518 consensus_queue.cc:237] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.494956 20248 tablet_bootstrap.cc:654] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.494573 20049 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:28.476925 20249 raft_consensus.cc:515] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.500746 20242 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:28.501292 20242 ts_tablet_manager.cc:1403] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.000s
I20260709 13:10:28.501448 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.504853 20249 leader_election.cc:290] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:28.492333 20123 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:28.505111 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580e9dc6e4c24718873d74c4398812dd" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:28.506191 19972 raft_consensus.cc:2393] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:28.507206 19939 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:28.508237 20490 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.508735 20490 raft_consensus.cc:697] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:28.509663 20490 consensus_queue.cc:237] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.511725 20242 raft_consensus.cc:359] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.512585 20242 raft_consensus.cc:385] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.512879 20242 raft_consensus.cc:740] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.516891 20244 raft_consensus.cc:359] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.517867 20244 raft_consensus.cc:385] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.515691 20013 leader_election.cc:304] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:28.518159 20244 raft_consensus.cc:740] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.519676 20244 consensus_queue.cc:260] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.520012 20518 raft_consensus.cc:3060] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.522981 20242 consensus_queue.cc:260] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.525955 20242 ts_tablet_manager.cc:1434] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:10:28.529109 19873 catalog_manager.cc:5697] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.536338 20242 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:28.505961 20478 raft_consensus.cc:515] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.542057 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:28.542791 19972 raft_consensus.cc:3060] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.544431 20242 tablet_bootstrap.cc:654] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.548729 20123 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.550206 20243 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:28.550809 20243 ts_tablet_manager.cc:1403] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.024s
I20260709 13:10:28.552057 19972 raft_consensus.cc:2468] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:28.552662 20244 ts_tablet_manager.cc:1434] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:10:28.553933 20244 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:28.553972 20013 leader_election.cc:304] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:28.555230 20249 raft_consensus.cc:2804] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.556224 20249 raft_consensus.cc:697] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:28.556816 20518 raft_consensus.cc:2749] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.557343 20249 consensus_queue.cc:237] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.559275 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:28.562065 20014 leader_election.cc:343] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.563769 20349 raft_consensus.cc:493] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.564548 20349 raft_consensus.cc:515] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.565725 20243 raft_consensus.cc:359] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.566856 20349 leader_election.cc:290] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.569967 20244 tablet_bootstrap.cc:654] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.569917 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:28.562629 20248 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:28.579694 20248 ts_tablet_manager.cc:1403] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.011s
I20260709 13:10:28.580293 20496 consensus_queue.cc:1048] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.574642 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:28.587392 20248 raft_consensus.cc:359] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:28.587847 20162 leader_election.cc:343] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.588485 20248 raft_consensus.cc:385] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.588828 20242 tablet_bootstrap.cc:492] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:28.589005 20248 raft_consensus.cc:740] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.589962 20242 ts_tablet_manager.cc:1403] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.000s
I20260709 13:10:28.591245 20500 consensus_queue.cc:1048] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.594801 20242 raft_consensus.cc:359] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.595527 20242 raft_consensus.cc:385] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.590478 20248 consensus_queue.cc:260] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.595786 20242 raft_consensus.cc:740] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.603540 20248 ts_tablet_manager.cc:1434] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:10:28.603394 20242 consensus_queue.cc:260] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.605091 20248 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:28.605957 20242 ts_tablet_manager.cc:1434] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:28.607195 20242 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:28.606695 19870 catalog_manager.cc:5697] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 2, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.611577 20244 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:28.612210 20244 ts_tablet_manager.cc:1403] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.015s
I20260709 13:10:28.612730 20243 raft_consensus.cc:385] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.615298 20243 raft_consensus.cc:740] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.615175 20244 raft_consensus.cc:359] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.616200 20244 raft_consensus.cc:385] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.616743 20243 consensus_queue.cc:260] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.619386 20049 raft_consensus.cc:2468] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:28.616585 20244 raft_consensus.cc:740] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.559090 20478 leader_election.cc:290] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.619534 20243 ts_tablet_manager.cc:1434] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.004s
I20260709 13:10:28.620535 20244 consensus_queue.cc:260] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.623835 20242 tablet_bootstrap.cc:654] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.623943 20243 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:28.626487 20244 ts_tablet_manager.cc:1434] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:10:28.627560 20244 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:28.628252 20163 leader_election.cc:304] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.630754 20349 raft_consensus.cc:2804] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.631086 20349 raft_consensus.cc:493] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.634831 20349 raft_consensus.cc:3060] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.637272 20500 consensus_queue.cc:1048] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.644915 20478 raft_consensus.cc:493] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.646124 20478 raft_consensus.cc:515] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.651948 20248 tablet_bootstrap.cc:654] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.667623 19873 catalog_manager.cc:5697] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.681380 20349 raft_consensus.cc:515] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.687610 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:28.689495 20014 leader_election.cc:343] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.689692 20244 tablet_bootstrap.cc:654] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.692180 20478 leader_election.cc:290] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.694406 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:28.697134 20307 raft_consensus.cc:493] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.692412 20439 consensus_queue.cc:1048] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.696195 20496 consensus_queue.cc:1048] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.732008 20243 tablet_bootstrap.cc:654] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.720510 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:28.720145 20437 raft_consensus.cc:493] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.737330 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:28.739387 20162 leader_election.cc:343] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.735461 20307 raft_consensus.cc:515] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.740690 20049 raft_consensus.cc:3060] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.734021 19972 raft_consensus.cc:2468] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:28.742640 20013 leader_election.cc:304] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.744392 20477 raft_consensus.cc:2804] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.744802 20477 raft_consensus.cc:493] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.745360 20477 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.744731 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:28.751037 20049 raft_consensus.cc:2468] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:28.751739 20307 leader_election.cc:290] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.733604 20349 leader_election.cc:290] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.758045 20244 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:28.758704 20244 ts_tablet_manager.cc:1403] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.011s
W20260709 13:10:28.763655 20532 log.cc:927] Time spent T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:28.769580 20307 raft_consensus.cc:493] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.793262 20244 raft_consensus.cc:359] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.794121 20244 raft_consensus.cc:385] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.794448 20244 raft_consensus.cc:740] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.795143 20244 consensus_queue.cc:260] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.795428 20366 raft_consensus.cc:493] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.796321 20366 raft_consensus.cc:515] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.801054 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:28.803210 19940 leader_election.cc:343] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.804138 20366 leader_election.cc:290] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:28.775790 20437 raft_consensus.cc:515] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.808712 20437 leader_election.cc:290] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.809695 20244 ts_tablet_manager.cc:1434] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 13:10:28.784618 20349 consensus_queue.cc:1048] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:10:28.810997 20439 consensus_queue.cc:1048] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.817742 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.818576 20194 raft_consensus.cc:2468] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:28.819748 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3109762d1147289ef7abb943db28d0" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.820518 20195 raft_consensus.cc:2393] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:28.820735 20163 leader_election.cc:304] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.821661 20535 raft_consensus.cc:2804] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.822239 20535 raft_consensus.cc:697] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:28.823101 20535 consensus_queue.cc:237] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.827100 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:28.828480 20162 leader_election.cc:343] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.828536 20477 raft_consensus.cc:515] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.829591 19938 leader_election.cc:304] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:28.831053 20477 leader_election.cc:290] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:28.831228 20366 raft_consensus.cc:2804] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.831713 20366 raft_consensus.cc:493] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.832083 20366 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.832243 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:28.783474 20307 raft_consensus.cc:515] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:28.836933 20163 leader_election.cc:343] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.836971 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:28.837747 20307 leader_election.cc:290] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.837934 19973 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.837633 20163 leader_election.cc:304] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:28.845685 20243 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:28.846189 20243 ts_tablet_manager.cc:1403] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.223s	user 0.022s	sys 0.013s
I20260709 13:10:28.848886 20243 raft_consensus.cc:359] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.852358 20243 raft_consensus.cc:385] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.852591 20243 raft_consensus.cc:740] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.853821 20244 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:28.854626 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:28.856755 20242 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:28.857591 20242 ts_tablet_manager.cc:1403] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.251s	user 0.043s	sys 0.069s
I20260709 13:10:28.863412 20243 consensus_queue.cc:260] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:28.874322 20242 raft_consensus.cc:359] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.877933 20248 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:28.852981 20087 leader_election.cc:304] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:28.881752 20248 ts_tablet_manager.cc:1403] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.277s	user 0.025s	sys 0.031s
I20260709 13:10:28.882746 20244 tablet_bootstrap.cc:654] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.883476 20500 raft_consensus.cc:3060] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.883864 20242 raft_consensus.cc:385] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.884397 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:28.886759 20248 raft_consensus.cc:359] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.887790 20248 raft_consensus.cc:385] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.888167 20248 raft_consensus.cc:740] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.884445 20242 raft_consensus.cc:740] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.897511 20242 consensus_queue.cc:260] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.897814 20248 consensus_queue.cc:260] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.902812 20243 ts_tablet_manager.cc:1434] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:10:28.911947 20242 ts_tablet_manager.cc:1434] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 13:10:28.924988 20242 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:28.931269 20248 ts_tablet_manager.cc:1434] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.049s	user 0.012s	sys 0.011s
I20260709 13:10:28.913959 20488 raft_consensus.cc:493] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.911208 20014 leader_election.cc:343] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.935937 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 87172.7us
I20260709 13:10:28.926235 20408 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.928907 20439 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.944281 20243 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
W20260709 13:10:28.926964 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 84288.2us
I20260709 13:10:28.948199 20248 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:28.951483 20542 raft_consensus.cc:2749] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.947212 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.939790 20488 raft_consensus.cc:515] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:28.963842 20366 raft_consensus.cc:515] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.981575 20488 leader_election.cc:290] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:28.944507 20408 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:28.965641 20478 raft_consensus.cc:493] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.947347 20439 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:29.029166 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:29.009249 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:29.045876 20192 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.990127 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:29.046336 19975 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:28.993270 20478 raft_consensus.cc:515] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:29.009991 20535 consensus_queue.cc:1048] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:10:29.032882 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:29.049275 20478 leader_election.cc:290] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:29.048727 19873 catalog_manager.cc:5697] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.041483 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:29.050977 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:29.037320 20307 raft_consensus.cc:493] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.055028 20243 tablet_bootstrap.cc:654] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.038250 20439 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:29.055228 20163 leader_election.cc:343] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.037863 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:28.986420 20408 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:29.052062 20307 raft_consensus.cc:515] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:28.982547 20500 raft_consensus.cc:2749] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.041040 19973 raft_consensus.cc:2468] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:29.041606 20366 leader_election.cc:290] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:29.061691 20197 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
W20260709 13:10:29.058480 19940 leader_election.cc:343] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.067368 20242 tablet_bootstrap.cc:654] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.065307 20161 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
W20260709 13:10:29.073370 19940 leader_election.cc:343] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.074433 19938 leader_election.cc:343] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.075346 19938 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:29.078315 20244 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:29.078943 20244 ts_tablet_manager.cc:1403] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.253s	user 0.022s	sys 0.008s
I20260709 13:10:29.079875 20307 leader_election.cc:290] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:29.080660 20366 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.081354 20366 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.081817 20366 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.083092 20244 raft_consensus.cc:359] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.083832 20244 raft_consensus.cc:385] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:29.063542 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 65633.6us
I20260709 13:10:29.084189 20244 raft_consensus.cc:740] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.085436 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:29.087589 20244 consensus_queue.cc:260] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.091534 20124 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.095731 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:29.096711 20194 raft_consensus.cc:2468] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:29.076802 20439 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.099004 20439 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.104770 20439 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.116811 20244 ts_tablet_manager.cc:1434] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.012s
I20260709 13:10:29.122165 20123 raft_consensus.cc:1275] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:29.139631 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:29.143569 20087 leader_election.cc:304] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:29.150315 20248 tablet_bootstrap.cc:654] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.150341 20192 raft_consensus.cc:2468] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:29.153271 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:29.157220 20047 raft_consensus.cc:1275] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:29.168303 20244 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:29.174401 20439 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:29.185498 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
W20260709 13:10:29.187676 20163 leader_election.cc:343] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.190083 20439 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:29.193953 20488 consensus_queue.cc:1048] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.196789 20490 raft_consensus.cc:493] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.197585 20490 raft_consensus.cc:515] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.213013 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:29.213987 19938 leader_election.cc:304] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:29.218065 20490 leader_election.cc:290] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:29.221704 20439 consensus_queue.cc:1048] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.227380 20013 leader_election.cc:304] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:29.277957 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 126431us
W20260709 13:10:29.278564 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 109187us
W20260709 13:10:29.278776 19940 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 119798us
I20260709 13:10:29.230999 20490 raft_consensus.cc:2804] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.293010 20244 tablet_bootstrap.cc:654] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.280622 20490 raft_consensus.cc:697] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:29.307550 20122 raft_consensus.cc:3060] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.308563 20549 raft_consensus.cc:2804] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.309401 20549 raft_consensus.cc:697] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:29.310647 20549 consensus_queue.cc:237] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:29.319422 20162 consensus_peers.cc:597] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.321831 20242 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:29.322381 20242 ts_tablet_manager.cc:1403] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.406s	user 0.031s	sys 0.017s
I20260709 13:10:29.306468 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:29.274236 20366 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:29.252965 20551 consensus_queue.cc:1048] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.157s
W20260709 13:10:29.329638 20014 leader_election.cc:343] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.331403 20478 consensus_queue.cc:1048] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:10:29.353827 19975 raft_consensus.cc:2393] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:29.361171 19973 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:29.367161 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:29.369596 20248 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:29.370209 20248 ts_tablet_manager.cc:1403] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.428s	user 0.033s	sys 0.021s
I20260709 13:10:29.373268 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:29.374097 20366 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:29.382869 19939 leader_election.cc:343] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.383212 20558 consensus_queue.cc:1048] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:29.383447 19940 leader_election.cc:343] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.384262 20242 raft_consensus.cc:359] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.385826 20242 raft_consensus.cc:385] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.386220 20242 raft_consensus.cc:740] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.385361 20437 raft_consensus.cc:493] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.386790 20437 raft_consensus.cc:515] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.388338 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:29.389245 20192 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:29.383450 19939 leader_election.cc:304] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.390182 20437 leader_election.cc:290] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:29.391207 20408 raft_consensus.cc:2749] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.391393 20242 consensus_queue.cc:260] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.392596 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:29.392959 19939 leader_election.cc:343] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.393208 20123 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:29.393519 19939 leader_election.cc:304] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.395185 20162 leader_election.cc:304] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:29.395818 20555 raft_consensus.cc:2749] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.396404 20437 raft_consensus.cc:2804] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.396901 20437 raft_consensus.cc:493] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.397318 20437 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.398607 20087 leader_election.cc:304] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:29.399197 20242 ts_tablet_manager.cc:1434] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.002s
I20260709 13:10:29.400640 20554 raft_consensus.cc:2749] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.402292 20161 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:29.412302 20547 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.412932 20013 leader_election.cc:304] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.416447 20478 raft_consensus.cc:2804] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:29.416632 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 79806.6us
I20260709 13:10:29.417003 20478 raft_consensus.cc:493] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.417621 20478 raft_consensus.cc:3060] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.404649 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:29.415457 20244 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:29.418843 20244 ts_tablet_manager.cc:1403] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.276s	user 0.017s	sys 0.009s
I20260709 13:10:29.416472 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:29.406616 20551 consensus_queue.cc:1048] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.421119 19973 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:29.415794 20242 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:29.356467 20490 consensus_queue.cc:237] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:29.437047 19940 leader_election.cc:343] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.437654 19940 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:29.446455 20488 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:10:29.447235 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.452718 20518 consensus_queue.cc:1048] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.456928 20478 raft_consensus.cc:515] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:29.478196 20244 raft_consensus.cc:359] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.478996 20244 raft_consensus.cc:385] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.479276 20244 raft_consensus.cc:740] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.480165 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:29.482177 20248 raft_consensus.cc:359] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.483057 20248 raft_consensus.cc:385] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.483377 20248 raft_consensus.cc:740] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:29.484170 20014 leader_election.cc:343] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.478880 20478 leader_election.cc:290] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:29.484105 20248 consensus_queue.cc:260] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.491590 20437 raft_consensus.cc:515] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.494761 20248 ts_tablet_manager.cc:1434] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.001s
I20260709 13:10:29.496497 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:29.497627 20122 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.498250 20248 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:29.508217 20122 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:29.510397 20162 leader_election.cc:304] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:29.511852 20547 raft_consensus.cc:2804] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.512696 20547 raft_consensus.cc:697] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:29.513733 20547 consensus_queue.cc:237] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.519934 20248 tablet_bootstrap.cc:654] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.522415 20244 consensus_queue.cc:260] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.542320 20244 ts_tablet_manager.cc:1434] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 13:10:29.540014 20366 raft_consensus.cc:493] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.542620 20437 leader_election.cc:290] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:29.560971 20244 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:29.565533 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:29.566207 20197 raft_consensus.cc:3060] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.558612 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:29.569916 19973 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.550181 20366 raft_consensus.cc:515] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.615483 20242 tablet_bootstrap.cc:654] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.620637 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:29.622143 19939 leader_election.cc:343] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.622956 20366 leader_election.cc:290] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:29.624809 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:29.626307 19940 leader_election.cc:343] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.626781 19940 leader_election.cc:304] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.638664 20366 raft_consensus.cc:2749] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.637847 19872 catalog_manager.cc:5697] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:29.656536 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 75486.9us
I20260709 13:10:29.631862 20197 raft_consensus.cc:2468] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:29.674721 20437 raft_consensus.cc:493] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.677732 19973 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:29.713455 20013 leader_election.cc:304] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.715010 20243 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:29.721648 20243 ts_tablet_manager.cc:1403] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.782s	user 0.027s	sys 0.016s
I20260709 13:10:29.750833 20446 raft_consensus.cc:2749] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.752993 20551 raft_consensus.cc:2804] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.753576 20551 raft_consensus.cc:697] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:29.754395 20551 consensus_queue.cc:237] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:29.712818 20437 raft_consensus.cc:515] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:29.784466 20569 log.cc:927] Time spent T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:29.802560 20243 raft_consensus.cc:359] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:29.803534 20243 raft_consensus.cc:385] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.806067 20248 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:29.806882 20248 ts_tablet_manager.cc:1403] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.309s	user 0.019s	sys 0.005s
I20260709 13:10:29.803879 20243 raft_consensus.cc:740] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.818289 20244 tablet_bootstrap.cc:654] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.819195 20243 consensus_queue.cc:260] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:29.811702 20014 consensus_peers.cc:597] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.816694 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 103341us
I20260709 13:10:29.850698 20248 raft_consensus.cc:359] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:29.853004 20248 raft_consensus.cc:385] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.853399 20248 raft_consensus.cc:740] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.871160 20242 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:29.871738 20242 ts_tablet_manager.cc:1403] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.461s	user 0.007s	sys 0.045s
I20260709 13:10:29.875612 20437 leader_election.cc:290] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:29.876428 19940 consensus_peers.cc:597] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.879922 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:29.880839 19972 raft_consensus.cc:2468] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:29.885392 20161 leader_election.cc:304] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:29.886458 20437 raft_consensus.cc:2804] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.886950 20437 raft_consensus.cc:493] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.886117 19873 catalog_manager.cc:5697] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.889665 20242 raft_consensus.cc:359] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.890647 20242 raft_consensus.cc:385] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.890998 20242 raft_consensus.cc:740] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.887267 20437 raft_consensus.cc:3060] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.893674 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:29.895498 20162 leader_election.cc:343] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.867869 20248 consensus_queue.cc:260] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:29.907243 20243 ts_tablet_manager.cc:1434] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.185s	user 0.012s	sys 0.000s
I20260709 13:10:29.891927 20242 consensus_queue.cc:260] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.911882 20242 ts_tablet_manager.cc:1434] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.001s
I20260709 13:10:29.920910 20243 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:29.922696 20248 ts_tablet_manager.cc:1434] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.115s	user 0.011s	sys 0.001s
I20260709 13:10:29.926133 20242 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:29.940313 20248 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:29.940184 20437 raft_consensus.cc:515] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.949111 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:29.949980 19972 raft_consensus.cc:3060] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.952883 20244 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:29.953280 20244 ts_tablet_manager.cc:1403] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.398s	user 0.018s	sys 0.005s
W20260709 13:10:29.925379 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 86554.2us
I20260709 13:10:29.953913 20446 raft_consensus.cc:493] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.965723 20446 raft_consensus.cc:515] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:29.969300 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:29.960321 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:29.970132 20242 tablet_bootstrap.cc:654] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.971547 20089 leader_election.cc:343] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.971583 20162 leader_election.cc:343] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.967978 20446 leader_election.cc:290] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:29.952278 20437 leader_election.cc:290] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:29.969399 19972 raft_consensus.cc:2468] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:29.974998 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:29.976066 19974 raft_consensus.cc:2468] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:29.977576 20087 leader_election.cc:304] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:29.978235 20161 leader_election.cc:304] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:29.979646 20500 raft_consensus.cc:2804] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.980176 20500 raft_consensus.cc:493] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.980531 20500 raft_consensus.cc:3060] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.985169 20536 raft_consensus.cc:2804] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.985759 20536 raft_consensus.cc:697] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:29.986608 20536 consensus_queue.cc:237] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:29.991600 20490 consensus_queue.cc:1048] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.963698 20248 tablet_bootstrap.cc:654] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.998526 20547 raft_consensus.cc:493] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.999053 20547 raft_consensus.cc:515] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.002264 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:30.003372 20547 leader_election.cc:290] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:30.003623 20162 leader_election.cc:343] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.006014 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:30.011613 20163 leader_election.cc:343] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.012140 20163 leader_election.cc:304] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:30.011948 20549 consensus_queue.cc:1048] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.030922 20243 tablet_bootstrap.cc:654] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.035976 19871 catalog_manager.cc:5697] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.032295 20244 raft_consensus.cc:359] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.039535 20244 raft_consensus.cc:385] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.039888 20244 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.040805 20244 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.045138 20244 ts_tablet_manager.cc:1434] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:10:30.046468 20244 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.051975 20437 raft_consensus.cc:2749] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:30.053144 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 43836us
I20260709 13:10:30.053524 20244 tablet_bootstrap.cc:654] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.055974 19873 catalog_manager.cc:5697] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.057910 20248 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:30.058462 20248 ts_tablet_manager.cc:1403] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.002s
I20260709 13:10:30.061221 20248 raft_consensus.cc:359] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.061879 20248 raft_consensus.cc:385] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.062120 20248 raft_consensus.cc:740] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.063221 20500 raft_consensus.cc:515] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.065452 20248 consensus_queue.cc:260] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.083276 20242 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:30.083966 20242 ts_tablet_manager.cc:1403] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.166s	user 0.022s	sys 0.006s
I20260709 13:10:30.090813 20500 leader_election.cc:290] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:30.091675 19871 catalog_manager.cc:5697] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.093768 20244 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.095026 20243 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:30.095559 20244 ts_tablet_manager.cc:1403] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.004s
I20260709 13:10:30.096474 20248 ts_tablet_manager.cc:1434] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 13:10:30.097695 20248 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:30.099766 20242 raft_consensus.cc:359] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.100533 20242 raft_consensus.cc:385] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.100811 20242 raft_consensus.cc:740] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.101136 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
W20260709 13:10:30.105938 20089 leader_election.cc:343] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.101557 20242 consensus_queue.cc:260] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.102360 20496 consensus_queue.cc:1048] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.103699 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:30.111253 19972 raft_consensus.cc:3060] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.095631 20243 ts_tablet_manager.cc:1403] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.178s	user 0.021s	sys 0.001s
I20260709 13:10:30.116436 20248 tablet_bootstrap.cc:654] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.130736 20496 consensus_queue.cc:1048] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.131943 20244 raft_consensus.cc:359] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.137476 20243 raft_consensus.cc:359] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.137740 20244 raft_consensus.cc:385] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.138312 20243 raft_consensus.cc:385] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.138412 20244 raft_consensus.cc:740] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.138765 20243 raft_consensus.cc:740] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.139412 20244 consensus_queue.cc:260] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.141759 20244 ts_tablet_manager.cc:1434] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.046s	user 0.000s	sys 0.006s
I20260709 13:10:30.142925 20244 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.149608 20244 tablet_bootstrap.cc:654] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.156689 20243 consensus_queue.cc:260] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.151134 20242 ts_tablet_manager.cc:1434] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:10:30.168454 20244 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.169394 20244 ts_tablet_manager.cc:1403] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:10:30.169862 20242 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:30.168440 20243 ts_tablet_manager.cc:1434] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 13:10:30.180089 20243 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:30.181231 20244 raft_consensus.cc:359] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.157167 19972 raft_consensus.cc:2468] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:30.185257 20087 leader_election.cc:304] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:30.184021 20244 raft_consensus.cc:385] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.186411 20244 raft_consensus.cc:740] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.186465 20446 raft_consensus.cc:2804] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.187132 20446 raft_consensus.cc:697] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:30.187997 20446 consensus_queue.cc:237] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.187394 20244 consensus_queue.cc:260] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.194478 20585 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.195118 20585 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.198305 20243 tablet_bootstrap.cc:654] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.203289 20242 tablet_bootstrap.cc:654] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.205606 20244 ts_tablet_manager.cc:1434] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:10:30.206802 20244 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.209460 20585 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.210110 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:30.211099 20195 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:30.211264 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.212160 19972 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:30.215474 20013 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:30.218042 20248 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:30.218690 20248 ts_tablet_manager.cc:1403] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.026s
I20260709 13:10:30.221346 20585 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.225596 20244 tablet_bootstrap.cc:654] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.226652 20242 tablet_bootstrap.cc:492] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:30.227250 20242 ts_tablet_manager.cc:1403] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.008s
W20260709 13:10:30.229708 20014 consensus_peers.cc:597] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:30.230314 20242 raft_consensus.cc:359] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.231154 20242 raft_consensus.cc:385] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.231439 20242 raft_consensus.cc:740] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.222829 20248 raft_consensus.cc:359] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.233567 20248 raft_consensus.cc:385] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.233879 20248 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.234624 20248 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.232833 20242 consensus_queue.cc:260] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.237232 20244 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.237792 20242 ts_tablet_manager.cc:1434] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:30.237831 20244 ts_tablet_manager.cc:1403] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:10:30.239149 20242 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:30.241680 20244 raft_consensus.cc:359] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.242496 20244 raft_consensus.cc:385] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.242755 20244 raft_consensus.cc:740] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.243425 20244 consensus_queue.cc:260] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.245440 20244 ts_tablet_manager.cc:1434] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:10:30.248718 20242 tablet_bootstrap.cc:654] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.250344 20248 ts_tablet_manager.cc:1434] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.005s
I20260709 13:10:30.254511 20366 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.255064 20366 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.256652 20585 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.257232 20366 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:30.257589 20248 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:30.259574 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:30.260852 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:30.261273 19940 leader_election.cc:343] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.261245 20242 tablet_bootstrap.cc:492] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:30.262312 20244 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.262477 20242 ts_tablet_manager.cc:1403] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
W20260709 13:10:30.262552 19938 leader_election.cc:343] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.263381 19938 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:30.263880 20439 raft_consensus.cc:493] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.264405 20439 raft_consensus.cc:515] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.266453 20242 raft_consensus.cc:359] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.267560 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:30.271109 20408 raft_consensus.cc:2749] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.273866 20243 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:30.274556 20243 ts_tablet_manager.cc:1403] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.008s
I20260709 13:10:30.270960 20577 consensus_queue.cc:1048] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.269268 19872 catalog_manager.cc:5697] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:30.279492 20162 leader_election.cc:343] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.279670 20242 raft_consensus.cc:385] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.280215 20242 raft_consensus.cc:740] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.281133 20242 consensus_queue.cc:260] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.283390 20439 leader_election.cc:290] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.285069 20243 raft_consensus.cc:359] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.292975 20243 raft_consensus.cc:385] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.285599 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.293751 19971 raft_consensus.cc:2468] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:30.293901 20242 ts_tablet_manager.cc:1434] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.003s
I20260709 13:10:30.295047 20161 leader_election.cc:304] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:30.298098 20242 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:30.300354 20439 raft_consensus.cc:2804] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.300953 20439 raft_consensus.cc:493] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.301608 20439 raft_consensus.cc:3060] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.307896 20242 tablet_bootstrap.cc:654] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.293322 20243 raft_consensus.cc:740] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.311004 20243 consensus_queue.cc:260] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.313235 20243 ts_tablet_manager.cc:1434] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:10:30.318436 20124 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.322149 20243 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:30.328590 20439 raft_consensus.cc:515] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.273910 20248 tablet_bootstrap.cc:654] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.290369 20244 tablet_bootstrap.cc:654] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.345310 20349 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.345893 20349 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.349748 20349 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.351526 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
W20260709 13:10:30.369329 20162 leader_election.cc:343] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.352205 20439 leader_election.cc:290] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.352355 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:30.371131 19972 raft_consensus.cc:3060] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.352809 20243 tablet_bootstrap.cc:654] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.352478 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.372742 19974 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:30.374336 20161 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:30.360688 20244 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.375238 20535 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.375730 20535 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.375923 20244 ts_tablet_manager.cc:1403] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.001s
I20260709 13:10:30.376169 20535 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.378858 19972 raft_consensus.cc:2468] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:30.379542 20244 raft_consensus.cc:359] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.364460 20248 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:30.365559 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:30.362224 20242 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:30.380385 20244 raft_consensus.cc:385] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.413581 20244 raft_consensus.cc:740] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.389741 20535 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.414597 20244 consensus_queue.cc:260] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.392645 20446 raft_consensus.cc:493] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.416025 20162 leader_election.cc:343] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.415198 20248 ts_tablet_manager.cc:1403] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.158s	user 0.021s	sys 0.007s
I20260709 13:10:30.417285 20244 ts_tablet_manager.cc:1434] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:10:30.417965 20242 ts_tablet_manager.cc:1403] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.030s
I20260709 13:10:30.418843 20244 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.419703 20248 raft_consensus.cc:359] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.420559 20248 raft_consensus.cc:385] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.420861 20248 raft_consensus.cc:740] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.421082 20242 raft_consensus.cc:359] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.421871 20242 raft_consensus.cc:385] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.421657 20248 consensus_queue.cc:260] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.416417 20446 raft_consensus.cc:515] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.422180 20242 raft_consensus.cc:740] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.426023 20446 leader_election.cc:290] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:30.426751 20242 consensus_queue.cc:260] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.428856 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:30.430639 20535 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.428810 20248 ts_tablet_manager.cc:1434] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:10:30.432391 20248 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:30.382994 20161 leader_election.cc:304] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:30.435678 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 52790.4us
I20260709 13:10:30.434966 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac48363d4d4312b0a4ce40551b6a6c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:30.426795 20244 tablet_bootstrap.cc:654] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.436990 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:30.436985 20439 raft_consensus.cc:2804] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.443727 20439 raft_consensus.cc:697] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:30.444937 20439 consensus_queue.cc:237] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:30.446628 20162 leader_election.cc:343] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.437810 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:30.440069 20087 leader_election.cc:304] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:30.447945 19972 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.448945 20550 raft_consensus.cc:2749] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.455217 20048 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.459342 20408 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.459899 20408 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.461231 19972 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:30.464349 20161 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:30.465299 20439 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.429154 20242 ts_tablet_manager.cc:1434] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:10:30.466476 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:30.467015 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:30.465996 20439 raft_consensus.cc:697] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:30.467423 20242 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:30.462101 20408 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:30.468096 19938 leader_election.cc:343] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.468307 20439 consensus_queue.cc:237] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:30.468861 19940 leader_election.cc:343] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.469823 19940 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:30.471480 20366 raft_consensus.cc:2749] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.440408 20243 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:30.472275 20243 ts_tablet_manager.cc:1403] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.001s
I20260709 13:10:30.478070 20243 raft_consensus.cc:359] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.479144 20243 raft_consensus.cc:385] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.479467 20243 raft_consensus.cc:740] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.488152 20446 raft_consensus.cc:493] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.488785 20446 raft_consensus.cc:515] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.490950 20446 leader_election.cc:290] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:30.492677 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:30.474649 20248 tablet_bootstrap.cc:654] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.496829 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95d568843284ddda0eda68734cdd590" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.497675 19972 raft_consensus.cc:2393] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:30.499867 20242 tablet_bootstrap.cc:654] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.500485 20243 consensus_queue.cc:260] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.502789 20243 ts_tablet_manager.cc:1434] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:10:30.502211 19870 catalog_manager.cc:5697] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.506772 19870 catalog_manager.cc:5697] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.511152 20244 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.511837 20244 ts_tablet_manager.cc:1403] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.005s
I20260709 13:10:30.517458 20244 raft_consensus.cc:359] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.518141 20244 raft_consensus.cc:385] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.518428 20244 raft_consensus.cc:740] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.520017 20248 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:30.503895 20243 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:30.524295 20248 ts_tablet_manager.cc:1403] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.004s
I20260709 13:10:30.527082 20248 raft_consensus.cc:359] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.527805 20248 raft_consensus.cc:385] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.529762 20244 consensus_queue.cc:260] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.531467 20122 raft_consensus.cc:3060] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.531929 20244 ts_tablet_manager.cc:1434] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.001s
I20260709 13:10:30.532119 20248 raft_consensus.cc:740] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.532893 20248 consensus_queue.cc:260] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.536739 20243 tablet_bootstrap.cc:654] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.537708 20124 raft_consensus.cc:3060] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.543790 20244 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.555846 20536 consensus_queue.cc:1048] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.557734 20585 raft_consensus.cc:493] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.558456 20585 raft_consensus.cc:515] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.568454 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.569463 19971 raft_consensus.cc:2393] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:30.570341 20244 tablet_bootstrap.cc:654] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.568220 20585 leader_election.cc:290] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:30.578194 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:30.584134 20242 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:30.585144 20446 raft_consensus.cc:493] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.590404 20446 raft_consensus.cc:515] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.595925 20248 ts_tablet_manager.cc:1434] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:10:30.597039 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:30.597805 20536 raft_consensus.cc:493] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.598554 20536 raft_consensus.cc:515] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:30.600658 20446 leader_election.cc:290] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:30.602398 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:30.603206 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:30.603854 20163 leader_election.cc:343] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:30.605067 20162 leader_election.cc:343] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.605752 20162 leader_election.cc:304] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:30.607291 20535 raft_consensus.cc:2749] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.603245 20536 leader_election.cc:290] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:30.609864 20248 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:30.586156 20087 leader_election.cc:304] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:30.613140 20014 leader_election.cc:304] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:30.614158 20585 raft_consensus.cc:3060] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.613559 20242 ts_tablet_manager.cc:1403] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.009s
I20260709 13:10:30.617516 20536 consensus_queue.cc:1048] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.620750 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb0269325f84a20b8bbf06dba278dcb" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:30.630466 20585 raft_consensus.cc:2749] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.709587 20248 tablet_bootstrap.cc:654] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:30.715018 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 101883us
I20260709 13:10:30.731680 20366 raft_consensus.cc:493] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.745311 20242 raft_consensus.cc:359] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.746457 20242 raft_consensus.cc:385] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:30.746704 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:30.746779 20242 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.762212 20242 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:30.753225 20586 raft_consensus.cc:493] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.797322 20242 ts_tablet_manager.cc:1434] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.179s	user 0.010s	sys 0.000s
I20260709 13:10:30.798621 20242 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:30.799911 20535 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.800511 20535 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.801504 20244 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:30.802039 20244 ts_tablet_manager.cc:1403] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.259s	user 0.022s	sys 0.034s
I20260709 13:10:30.802670 20535 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:30.808230 20243 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:30.808948 20243 ts_tablet_manager.cc:1403] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.305s	user 0.045s	sys 0.026s
I20260709 13:10:30.747531 20366 raft_consensus.cc:515] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:30.815287 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 97498.3us
I20260709 13:10:30.819392 20087 leader_election.cc:304] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:30.846792 20244 raft_consensus.cc:359] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.847572 20244 raft_consensus.cc:385] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.792181 20586 raft_consensus.cc:515] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.847815 20244 raft_consensus.cc:740] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.863332 20244 consensus_queue.cc:260] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.882519 20446 raft_consensus.cc:2749] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.914049 20248 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:30.914853 20248 ts_tablet_manager.cc:1403] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.305s	user 0.008s	sys 0.031s
I20260709 13:10:30.904461 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:30.932930 20586 leader_election.cc:290] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:30.935189 20248 raft_consensus.cc:359] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.942279 20248 raft_consensus.cc:385] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.942775 20248 raft_consensus.cc:740] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.945431 20248 consensus_queue.cc:260] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:30.954521 20243 raft_consensus.cc:359] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.960260 20244 ts_tablet_manager.cc:1434] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.158s	user 0.022s	sys 0.043s
I20260709 13:10:30.961026 20243 raft_consensus.cc:385] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.961440 20243 raft_consensus.cc:740] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.962296 20243 consensus_queue.cc:260] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:30.940562 19973 raft_consensus.cc:2468] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:30.957135 20536 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.978909 20243 ts_tablet_manager.cc:1434] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.170s	user 0.010s	sys 0.001s
I20260709 13:10:30.984495 20244 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:30.986289 20248 ts_tablet_manager.cc:1434] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.006s
I20260709 13:10:30.990964 20123 raft_consensus.cc:3060] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.003572 20243 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:31.010794 20248 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:30.980199 20536 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.001250 20366 leader_election.cc:290] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:31.014146 20634 log.cc:927] Time spent T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:30.997323 20625 consensus_queue.cc:1048] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:10:31.032334 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.042717 20161 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.066475 20242 tablet_bootstrap.cc:654] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.032701 19974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.086092 19974 raft_consensus.cc:2468] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:31.107581 20535 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.108243 20535 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.097486 20642 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.110848 20535 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.112924 20549 raft_consensus.cc:493] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.110576 20642 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:31.116066 20642 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:31.090987 20496 raft_consensus.cc:2804] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.116750 20496 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.117085 20496 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.090586 20500 raft_consensus.cc:2749] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.113710 20549 raft_consensus.cc:515] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:31.086382 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 58213.6us
I20260709 13:10:31.100229 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.155200 20243 tablet_bootstrap.cc:654] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.156610 20248 tablet_bootstrap.cc:654] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:31.142207 20641 log.cc:927] Time spent T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:10:31.130265 20408 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.165117 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 62195.3us
I20260709 13:10:31.169272 20013 leader_election.cc:304] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.171314 20408 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.211385 20408 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.196772 20536 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.201702 20653 raft_consensus.cc:2804] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.254799 20244 tablet_bootstrap.cc:654] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.219973 20496 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.266701 20549 leader_election.cc:290] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:31.267762 20496 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.274528 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.274865 20649 consensus_queue.cc:1048] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.275442 19972 raft_consensus.cc:2468] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:31.282189 20119 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.283402 20536 consensus_queue.cc:1048] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:31.284873 20162 consensus_peers.cc:597] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:31.275461 20014 leader_election.cc:343] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.293622 20163 leader_election.cc:343] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.262058 20653 raft_consensus.cc:493] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.319378 20013 leader_election.cc:304] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.322872 20586 raft_consensus.cc:2804] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.323338 20586 raft_consensus.cc:493] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.323885 20586 raft_consensus.cc:3060] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.305704 20653 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:31.347986 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 66657.8us
I20260709 13:10:31.362025 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.364960 20408 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.365640 20408 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.370803 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.371392 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.372268 19967 raft_consensus.cc:2468] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:31.373664 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.376340 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.377693 20242 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:31.378296 20242 ts_tablet_manager.cc:1403] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.580s	user 0.023s	sys 0.012s
I20260709 13:10:31.380159 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.380940 20197 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:31.382110 20243 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:31.382732 20243 ts_tablet_manager.cc:1403] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.379s	user 0.037s	sys 0.027s
I20260709 13:10:31.383373 20408 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:31.385919 20243 raft_consensus.cc:359] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:31.386368 19939 leader_election.cc:343] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.386752 20243 raft_consensus.cc:385] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.387049 20243 raft_consensus.cc:740] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
W20260709 13:10:31.387526 19939 leader_election.cc:343] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.389089 19938 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.396761 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:31.389156 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.390725 20044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.391433 20049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.340543 20586 raft_consensus.cc:515] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:31.400995 20242 raft_consensus.cc:359] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.405072 20242 raft_consensus.cc:385] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.391709 20243 consensus_queue.cc:260] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:31.405666 20242 raft_consensus.cc:740] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.397275 20649 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.406854 20242 consensus_queue.cc:260] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.420342 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.416230 20649 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.423354 20047 raft_consensus.cc:2393] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:31.424360 20244 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:31.424883 20244 ts_tablet_manager.cc:1403] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.447s	user 0.020s	sys 0.012s
W20260709 13:10:31.424925 19940 leader_election.cc:343] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.425563 19940 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:31.404881 20642 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:31.431157 20242 ts_tablet_manager.cc:1434] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.002s
I20260709 13:10:31.392210 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.432612 20642 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.433117 20642 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.434288 20242 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:31.416723 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.436847 19969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:31.438380 19969 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.445042 20536 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.448189 20244 raft_consensus.cc:359] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.449007 20244 raft_consensus.cc:385] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.449290 20244 raft_consensus.cc:740] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
W20260709 13:10:31.450032 19938 leader_election.cc:343] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.449939 20244 consensus_queue.cc:260] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.403041 20044 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:31.452819 20243 ts_tablet_manager.cc:1434] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.002s
I20260709 13:10:31.454245 20242 tablet_bootstrap.cc:654] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.454452 20243 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:31.419624 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.467835 20649 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:31.472292 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.455395 20626 raft_consensus.cc:493] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.473174 20637 raft_consensus.cc:2749] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.473835 20626 raft_consensus.cc:515] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.475979 20626 leader_election.cc:290] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:31.478308 20014 leader_election.cc:343] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.478658 20244 ts_tablet_manager.cc:1434] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:10:31.479727 20244 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:31.483511 19940 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 58624.2us
I20260709 13:10:31.498979 20248 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:31.499661 20248 ts_tablet_manager.cc:1403] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.499s	user 0.028s	sys 0.021s
W20260709 13:10:31.494606 20163 leader_election.cc:343] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.393004 20653 raft_consensus.cc:515] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:31.505473 20163 leader_election.cc:343] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.506217 19939 leader_election.cc:343] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.500721 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.521306 19940 leader_election.cc:304] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:31.503953 20408 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.525234 20408 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.525861 20635 raft_consensus.cc:3060] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.529264 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.530028 19975 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:31.531204 20586 leader_election.cc:290] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:31.533443 20087 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:31.511126 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821119294dc4787ae9b90b24070a2fc" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:31.538975 20649 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:31.543993 20649 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e3242b28df94215893da755f099a6e2)
I20260709 13:10:31.544127 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.545691 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:31.520695 19939 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:31.547580 20637 raft_consensus.cc:2749] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.548993 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:31.544467 20649 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.550683 19973 raft_consensus.cc:2393] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
W20260709 13:10:31.553026 19938 leader_election.cc:343] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.527886 20408 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.564321 20087 leader_election.cc:304] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:31.564443 20161 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:31.565598 20630 raft_consensus.cc:3060] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.566040 20639 raft_consensus.cc:2804] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.551973 20635 raft_consensus.cc:2749] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.572892 20242 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:31.574538 20242 ts_tablet_manager.cc:1403] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.025s
I20260709 13:10:31.533634 20642 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:31.573344 20014 leader_election.cc:343] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.596685 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:31.586898 20649 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:31.601598 19940 leader_election.cc:343] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.602089 19940 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:31.573848 20639 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.605276 20628 raft_consensus.cc:2749] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.607683 20248 raft_consensus.cc:359] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.611485 20248 raft_consensus.cc:385] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.611757 20248 raft_consensus.cc:740] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.612414 20248 consensus_queue.cc:260] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.609853 20639 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.617918 20244 tablet_bootstrap.cc:654] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.616101 19968 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 2: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:31.626780 20248 ts_tablet_manager.cc:1434] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 13:10:31.625626 19969 raft_consensus.cc:2468] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:31.629652 20648 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:31.633737 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:31.634438 19973 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.641479 19973 raft_consensus.cc:2468] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:31.642637 20630 raft_consensus.cc:2749] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.642818 20248 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:31.645519 20013 leader_election.cc:304] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.646844 20632 raft_consensus.cc:2804] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.647395 20632 raft_consensus.cc:697] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:31.648329 20632 consensus_queue.cc:237] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:31.650532 20248 tablet_bootstrap.cc:654] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.656757 20649 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:31.662478 20243 tablet_bootstrap.cc:654] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.663151 20653 leader_election.cc:290] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:31.663635 20664 log.cc:927] Time spent T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:10:31.664567 20161 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:31.670025 20642 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.671221 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:31.678205 20639 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.690127 20536 raft_consensus.cc:2804] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.690927 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:31.692662 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:31.722138 20242 raft_consensus.cc:359] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:31.731703 20242 raft_consensus.cc:385] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.732115 20242 raft_consensus.cc:740] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.729744 20047 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.732955 20242 consensus_queue.cc:260] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:31.734982 20242 ts_tablet_manager.cc:1434] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.160s	user 0.007s	sys 0.001s
I20260709 13:10:31.735466 20161 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:31.737062 19970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:31.738135 19970 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.738212 20648 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.748452 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:31.752118 20639 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:31.752842 20120 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.756732 20536 raft_consensus.cc:697] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:31.757768 20536 consensus_queue.cc:237] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.758282 19870 catalog_manager.cc:5697] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.759851 20648 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:31.761416 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:31.762228 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:31.774268 19973 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.776880 20244 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
W20260709 13:10:31.777185 20163 leader_election.cc:343] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.777498 20244 ts_tablet_manager.cc:1403] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.298s	user 0.021s	sys 0.007s
I20260709 13:10:31.779060 20651 raft_consensus.cc:493] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.786262 20124 raft_consensus.cc:1240] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Rejecting Update request from peer 9e3242b28df94215893da755f099a6e2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:31.779600 20651 raft_consensus.cc:515] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:31.789259 20651 leader_election.cc:290] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:31.788545 20648 consensus_queue.cc:1059] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.793107 20244 raft_consensus.cc:359] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.793725 20244 raft_consensus.cc:385] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.794009 20244 raft_consensus.cc:740] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.795143 20118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:31.798030 20244 consensus_queue.cc:260] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:31.803596 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:31.781543 20047 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:31.797088 20198 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:31.813119 20120 raft_consensus.cc:2468] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:31.814425 19940 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:31.814395 20248 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:31.816236 20408 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:31.816804 20248 ts_tablet_manager.cc:1403] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.039s
I20260709 13:10:31.816865 20408 raft_consensus.cc:697] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
W20260709 13:10:31.818073 20014 leader_election.cc:343] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.800906 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:31.818181 20408 consensus_queue.cc:237] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.819097 20192 raft_consensus.cc:2468] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:31.819900 20248 raft_consensus.cc:359] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:31.820634 20248 raft_consensus.cc:385] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.820909 20248 raft_consensus.cc:740] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.821609 20248 consensus_queue.cc:260] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:31.821264 19967 raft_consensus.cc:2468] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:31.815176 19970 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:31.824684 19975 raft_consensus.cc:1240] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Rejecting Update request from peer 9e3242b28df94215893da755f099a6e2 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:31.824723 20013 leader_election.cc:304] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:31.828869 20087 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:31.844521 20630 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:31.849788 20630 raft_consensus.cc:697] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:31.851603 20242 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:31.854943 20244 ts_tablet_manager.cc:1434] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 13:10:31.856642 20248 ts_tablet_manager.cc:1434] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:10:31.844298 20632 raft_consensus.cc:2804] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.864173 20632 raft_consensus.cc:493] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.864591 20632 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.895071 20248 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:31.849856 19973 raft_consensus.cc:2468] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:31.851099 20630 consensus_queue.cc:237] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:31.921085 20243 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:31.921657 20243 ts_tablet_manager.cc:1403] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.467s	user 0.016s	sys 0.012s
I20260709 13:10:31.925092 20161 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:31.932364 20244 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:31.865495 20657 consensus_queue.cc:1059] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:10:31.943998 20639 raft_consensus.cc:2804] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.944635 20639 raft_consensus.cc:697] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:31.945621 20639 consensus_queue.cc:237] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:31.954559 20013 leader_election.cc:304] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:31.955302 20657 raft_consensus.cc:3055] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:31.969132 20244 tablet_bootstrap.cc:654] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.955853 20657 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:31.976675 20651 raft_consensus.cc:2804] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.010138 20242 tablet_bootstrap.cc:654] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.011126 20651 raft_consensus.cc:697] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:32.045421 20651 consensus_queue.cc:237] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.038233 20243 raft_consensus.cc:359] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.052381 20243 raft_consensus.cc:385] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.052704 20243 raft_consensus.cc:740] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.053383 20243 consensus_queue.cc:260] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.054302 19873 catalog_manager.cc:5697] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.055517 20243 ts_tablet_manager.cc:1434] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.097s	user 0.003s	sys 0.001s
I20260709 13:10:32.038412 20639 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.021768 20657 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.058401 20248 tablet_bootstrap.cc:654] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.061122 20243 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:32.045989 20632 raft_consensus.cc:515] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.070374 20637 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.091714 20637 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.065611 20639 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.103574 20244 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:32.104255 20244 ts_tablet_manager.cc:1403] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.204s	user 0.019s	sys 0.018s
I20260709 13:10:32.109764 20244 raft_consensus.cc:359] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.112149 20242 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:32.117746 20242 ts_tablet_manager.cc:1403] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.273s	user 0.028s	sys 0.022s
I20260709 13:10:32.112406 20244 raft_consensus.cc:385] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.118700 20244 raft_consensus.cc:740] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.119609 20244 consensus_queue.cc:260] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.111982 20637 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:32.121954 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:32.122690 20657 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.124792 19939 leader_election.cc:343] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.115332 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:32.126201 20198 raft_consensus.cc:2468] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:32.130175 20639 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:32.131119 20632 leader_election.cc:290] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:32.138551 20118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:32.139562 20632 consensus_queue.cc:1048] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.131726 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:32.132223 19938 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:32.122171 20244 ts_tablet_manager.cc:1434] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:32.136948 20243 tablet_bootstrap.cc:654] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:32.142508 20014 leader_election.cc:343] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.143823 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:32.144670 20198 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.151912 20243 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:32.148228 20642 raft_consensus.cc:2804] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.152508 20244 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:32.153191 20243 ts_tablet_manager.cc:1403] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.004s
I20260709 13:10:32.152812 20642 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.154892 20642 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.167860 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:32.172283 20244 tablet_bootstrap.cc:654] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.180563 20198 raft_consensus.cc:2468] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:32.181989 20013 leader_election.cc:304] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:32.183465 20632 raft_consensus.cc:2804] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.184278 20248 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:32.184772 20248 ts_tablet_manager.cc:1403] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.290s	user 0.012s	sys 0.011s
I20260709 13:10:32.183934 20632 raft_consensus.cc:697] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:32.185706 20632 consensus_queue.cc:237] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.187503 20248 raft_consensus.cc:359] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.187927 20349 raft_consensus.cc:493] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.188263 20248 raft_consensus.cc:385] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.188580 20248 raft_consensus.cc:740] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.188434 20349 raft_consensus.cc:515] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.185467 20243 raft_consensus.cc:359] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.190739 20243 raft_consensus.cc:385] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.191123 20243 raft_consensus.cc:740] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.194474 20243 consensus_queue.cc:260] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.193847 20248 consensus_queue.cc:260] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.197229 20242 raft_consensus.cc:359] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.198242 20242 raft_consensus.cc:385] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.198609 20242 raft_consensus.cc:740] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.199412 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:32.199725 20242 consensus_queue.cc:260] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:32.201171 20163 leader_election.cc:343] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.195466 20349 leader_election.cc:290] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:32.203130 20242 ts_tablet_manager.cc:1434] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:10:32.204470 20242 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
W20260709 13:10:32.195748 20162 leader_election.cc:343] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.207230 20243 ts_tablet_manager.cc:1434] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.003s
I20260709 13:10:32.214514 20243 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:32.225009 20642 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.227293 20248 ts_tablet_manager.cc:1434] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:10:32.228601 20248 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:32.228016 19967 raft_consensus.cc:2393] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate e49ff5dc8abb43e5af05c0ef94a90941 in this term.
I20260709 13:10:32.242887 19872 catalog_manager.cc:5697] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 2, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.245975 20679 raft_consensus.cc:493] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.256805 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:32.256961 20679 raft_consensus.cc:515] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.257602 20195 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.258843 20161 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:32.229904 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:32.246810 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:32.260996 20500 raft_consensus.cc:493] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.247201 20642 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:32.249135 20243 tablet_bootstrap.cc:654] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.250043 20248 tablet_bootstrap.cc:654] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.259487 20679 leader_election.cc:290] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:32.247596 20048 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.268471 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:32.269363 20042 raft_consensus.cc:2468] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:32.273478 20242 tablet_bootstrap.cc:654] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.272876 20163 leader_election.cc:304] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:32.261533 20500 raft_consensus.cc:515] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.283535 20535 raft_consensus.cc:2804] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.284096 20535 raft_consensus.cc:493] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.284451 20535 raft_consensus.cc:3060] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:32.277380 19939 leader_election.cc:343] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.286819 20500 leader_election.cc:290] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:32.292121 20195 raft_consensus.cc:2468] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:32.292559 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:32.292824 20162 leader_election.cc:343] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.293334 20162 leader_election.cc:304] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:32.294915 20644 raft_consensus.cc:2749] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.292812 20679 raft_consensus.cc:2749] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.296873 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:32.297294 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb50b2a2fa2b492aa6f523acc8ff6cb8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:32.298095 19973 raft_consensus.cc:2393] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:32.299736 20087 leader_election.cc:304] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:32.302054 19938 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:32.301970 20500 raft_consensus.cc:3060] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:32.305148 20162 leader_election.cc:343] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.306272 20637 raft_consensus.cc:2804] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.306975 20637 raft_consensus.cc:697] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:32.308182 20637 consensus_queue.cc:237] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.311445 20577 consensus_queue.cc:1048] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.313436 19871 catalog_manager.cc:5697] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 2, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.351570 20657 consensus_queue.cc:1048] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.367924 20248 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:32.368651 20248 ts_tablet_manager.cc:1403] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.013s
I20260709 13:10:32.337613 20535 raft_consensus.cc:515] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.384754 20535 leader_election.cc:290] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:32.386116 20244 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:32.386780 20244 ts_tablet_manager.cc:1403] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.238s	user 0.014s	sys 0.030s
I20260709 13:10:32.388244 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:32.389891 20243 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:32.390545 20243 ts_tablet_manager.cc:1403] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.017s
W20260709 13:10:32.393525 20162 leader_election.cc:343] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.395392 20242 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:32.396087 20242 ts_tablet_manager.cc:1403] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.025s
I20260709 13:10:32.395819 20657 consensus_queue.cc:1048] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.398151 20243 raft_consensus.cc:359] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.398888 20243 raft_consensus.cc:385] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.399163 20243 raft_consensus.cc:740] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.411330 20244 raft_consensus.cc:359] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.413583 20244 raft_consensus.cc:385] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.407840 20248 raft_consensus.cc:359] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.414484 20248 raft_consensus.cc:385] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.415153 20244 raft_consensus.cc:740] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.415982 20244 consensus_queue.cc:260] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.417284 20242 raft_consensus.cc:359] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.417959 20242 raft_consensus.cc:385] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.418392 20242 raft_consensus.cc:740] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.419116 20242 consensus_queue.cc:260] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.414870 20248 raft_consensus.cc:740] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.422478 20248 consensus_queue.cc:260] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.424499 20195 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:32.411908 20500 raft_consensus.cc:2749] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.431663 20043 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:32.438333 20642 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.398869 20635 raft_consensus.cc:493] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.414196 20243 consensus_queue.cc:260] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.445346 20248 ts_tablet_manager.cc:1434] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.076s	user 0.002s	sys 0.006s
I20260709 13:10:32.445976 20637 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:32.446362 20635 raft_consensus.cc:515] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.482540 20635 leader_election.cc:290] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:32.484902 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:32.488662 19940 leader_election.cc:343] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.473305 20657 consensus_queue.cc:1048] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.493645 20248 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:32.464063 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:32.502084 20042 raft_consensus.cc:3060] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.476845 20242 ts_tablet_manager.cc:1434] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.003s
I20260709 13:10:32.487327 19870 catalog_manager.cc:5697] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.509879 20535 raft_consensus.cc:493] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.510735 20535 raft_consensus.cc:515] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.520287 20535 leader_election.cc:290] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:32.523483 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:32.525524 20162 leader_election.cc:343] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.526087 20042 raft_consensus.cc:2468] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:32.533427 20244 ts_tablet_manager.cc:1434] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.001s
I20260709 13:10:32.543079 20577 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.566807 20577 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.568177 20042 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.570010 20577 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:32.548380 20242 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:32.553620 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:32.501022 20243 ts_tablet_manager.cc:1434] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 13:10:32.580282 20630 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.580927 20630 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.581619 20243 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:32.583122 20242 tablet_bootstrap.cc:654] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.584897 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:32.583158 20630 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:32.585774 19967 raft_consensus.cc:2468] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:32.563664 20632 consensus_queue.cc:1048] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.573628 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:32.587016 20087 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:32.546111 20248 tablet_bootstrap.cc:654] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.588986 20630 raft_consensus.cc:2804] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.589620 20630 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.590070 20630 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.594118 20243 tablet_bootstrap.cc:654] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.599287 20163 leader_election.cc:304] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:32.600795 19938 leader_election.cc:343] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.614529 19938 leader_election.cc:304] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:32.606488 19872 catalog_manager.cc:5697] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.638800 20244 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:32.617993 20644 raft_consensus.cc:2804] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.638485 20701 raft_consensus.cc:2749] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.651108 20248 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:32.651592 20248 ts_tablet_manager.cc:1403] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.009s
I20260709 13:10:32.640779 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:32.672407 20198 raft_consensus.cc:1275] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:32.650213 20644 raft_consensus.cc:697] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:32.675295 20687 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.700096 20687 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.701898 20248 raft_consensus.cc:359] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.702999 20248 raft_consensus.cc:385] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.703076 20687 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:32.705894 20248 raft_consensus.cc:740] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.712123 20644 consensus_queue.cc:237] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.707934 20248 consensus_queue.cc:260] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:32.731771 20248 ts_tablet_manager.cc:1434] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.004s
I20260709 13:10:32.739513 20242 tablet_bootstrap.cc:492] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:32.740335 20242 ts_tablet_manager.cc:1403] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.198s	user 0.020s	sys 0.007s
W20260709 13:10:32.782618 20163 leader_election.cc:343] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.784058 20163 leader_election.cc:304] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
W20260709 13:10:32.786542 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 107945us
I20260709 13:10:32.788213 20496 raft_consensus.cc:2749] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.747901 20631 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:10:32.804236 20243 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:32.805055 20243 ts_tablet_manager.cc:1403] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.019s
I20260709 13:10:32.811755 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:32.812539 19973 raft_consensus.cc:2468] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:32.817593 20244 tablet_bootstrap.cc:654] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.788128 20628 consensus_queue.cc:1048] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:10:32.790488 20714 consensus_queue.cc:1048] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:10:32.830255 20161 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
W20260709 13:10:32.849171 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 55473.6us
I20260709 13:10:32.851882 20630 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:32.854130 20630 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:32.854892 20242 raft_consensus.cc:359] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.855747 20242 raft_consensus.cc:385] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.856024 20242 raft_consensus.cc:740] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.847661 20496 raft_consensus.cc:2804] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.861661 20243 raft_consensus.cc:359] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.870330 20243 raft_consensus.cc:385] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.870790 20243 raft_consensus.cc:740] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.858271 20242 consensus_queue.cc:260] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:32.878854 20242 ts_tablet_manager.cc:1434] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.001s
I20260709 13:10:32.871713 20243 consensus_queue.cc:260] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:32.882282 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 51088.9us
I20260709 13:10:32.874039 20496 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.925371 20408 raft_consensus.cc:493] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.933540 20243 ts_tablet_manager.cc:1434] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.010s
I20260709 13:10:32.928840 20496 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.938416 20408 raft_consensus.cc:515] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:32.945729 20408 leader_election.cc:290] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:32.948922 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:32.949800 20248 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:32.953439 20013 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:32.956313 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:32.963410 20243 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:32.975914 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:32.977308 20120 raft_consensus.cc:2393] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:32.979730 20243 tablet_bootstrap.cc:654] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.982568 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:32.984762 20632 raft_consensus.cc:2749] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.990628 20242 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
W20260709 13:10:32.994815 19940 leader_election.cc:343] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.003021 20248 tablet_bootstrap.cc:654] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.029927 20242 tablet_bootstrap.cc:654] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.031121 20496 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.032357 20192 raft_consensus.cc:2393] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:33.063462 20244 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: No bootstrap required, opened a new log
I20260709 13:10:33.064127 20244 ts_tablet_manager.cc:1403] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.443s	user 0.023s	sys 0.027s
I20260709 13:10:33.068559 20244 raft_consensus.cc:359] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:33.023854 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 59856.3us
I20260709 13:10:33.069977 20244 raft_consensus.cc:385] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.073146 20244 raft_consensus.cc:740] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.068742 19873 catalog_manager.cc:5697] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.080195 19873 catalog_manager.cc:5697] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.074436 20244 consensus_queue.cc:260] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.048168 20644 consensus_queue.cc:1048] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:10:33.106837 20244 ts_tablet_manager.cc:1434] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.006s
I20260709 13:10:33.108451 20243 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:33.109056 20243 ts_tablet_manager.cc:1403] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.011s
W20260709 13:10:33.109851 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 125541us
I20260709 13:10:33.115665 20242 tablet_bootstrap.cc:492] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:33.122778 20242 ts_tablet_manager.cc:1403] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.005s
I20260709 13:10:33.123179 20243 raft_consensus.cc:359] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.125635 20243 raft_consensus.cc:385] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.125929 20243 raft_consensus.cc:740] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.126456 20243 consensus_queue.cc:260] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.133101 20242 raft_consensus.cc:359] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.133448 20496 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:33.133208 20087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 302150us
I20260709 13:10:33.140384 20242 raft_consensus.cc:385] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.140733 20242 raft_consensus.cc:740] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.142570 20243 ts_tablet_manager.cc:1434] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:10:33.145908 20242 consensus_queue.cc:260] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.151295 19967 raft_consensus.cc:1275] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.151475 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:33.152513 20192 raft_consensus.cc:2393] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:33.153813 20242 ts_tablet_manager.cc:1434] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:10:33.154991 20242 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:33.159765 20248 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:33.160374 20248 ts_tablet_manager.cc:1403] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.211s	user 0.018s	sys 0.013s
I20260709 13:10:33.162670 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:33.163578 20119 raft_consensus.cc:2393] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:33.165503 20242 tablet_bootstrap.cc:654] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.167443 20243 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:33.172618 19975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:33.173336 19975 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.184010 20243 tablet_bootstrap.cc:654] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.184604 20248 raft_consensus.cc:359] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.185439 20248 raft_consensus.cc:385] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.185772 20248 raft_consensus.cc:740] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.186463 20248 consensus_queue.cc:260] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.193073 20724 consensus_queue.cc:1048] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.197257 20248 ts_tablet_manager.cc:1434] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:10:33.198527 20248 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: Bootstrap starting.
I20260709 13:10:33.213135 20679 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b112290c0b6e4aa08967a0350cf4b215)
I20260709 13:10:33.214093 20679 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.217188 20243 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:33.217816 20243 ts_tablet_manager.cc:1403] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.001s
I20260709 13:10:33.218362 20248 tablet_bootstrap.cc:654] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.220208 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:33.221505 20243 raft_consensus.cc:359] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.222210 20242 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:33.222743 20242 ts_tablet_manager.cc:1403] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.004s
I20260709 13:10:33.229457 20243 raft_consensus.cc:385] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.229777 20243 raft_consensus.cc:740] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.232434 20243 consensus_queue.cc:260] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:33.233022 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 88883.1us
I20260709 13:10:33.235929 20161 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:33.236539 20124 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.236855 20737 raft_consensus.cc:2749] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.233817 20719 raft_consensus.cc:493] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.242693 20719 raft_consensus.cc:515] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.243577 20628 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.244158 20628 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:33.245064 20719 leader_election.cc:290] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:33.240844 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:33.250110 20628 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:33.250648 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:33.247562 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:33.251716 20047 raft_consensus.cc:2468] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:33.241096 19872 catalog_manager.cc:5697] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 1 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.253151 19940 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:33.254158 20628 raft_consensus.cc:2804] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.254626 20628 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.255014 20628 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.247884 20242 raft_consensus.cc:359] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.256227 20242 raft_consensus.cc:385] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.256537 20242 raft_consensus.cc:740] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.257498 20242 consensus_queue.cc:260] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.257838 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:33.258695 19968 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
I20260709 13:10:33.260459 20727 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.261036 20727 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.261322 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:33.263410 20727 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:33.265655 20161 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:33.267478 20242 ts_tablet_manager.cc:1434] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:10:33.268379 20123 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.246661 20679 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:33.269649 20243 ts_tablet_manager.cc:1434] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 13:10:33.250927 19975 raft_consensus.cc:2468] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:33.277449 20118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:33.279897 20717 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.286778 20737 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.296541 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:33.330826 20087 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:33.337759 20243 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:33.341944 20242 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:33.345048 20720 raft_consensus.cc:2804] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.345631 20720 raft_consensus.cc:697] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:33.346546 20720 consensus_queue.cc:237] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.344852 20193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9882d3537dc4f1487e6f5784c2b999a" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:33.357331 20653 consensus_queue.cc:1048] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.360809 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:33.389168 19968 raft_consensus.cc:2468] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:33.390462 20577 consensus_queue.cc:1048] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.390856 20087 leader_election.cc:304] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:33.363955 20731 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.392534 20731 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b112290c0b6e4aa08967a0350cf4b215)
I20260709 13:10:33.392974 20731 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.342190 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:33.373085 20248 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: No bootstrap required, opened a new log
I20260709 13:10:33.394147 20248 ts_tablet_manager.cc:1403] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: Time spent bootstrapping tablet: real 0.196s	user 0.031s	sys 0.018s
I20260709 13:10:33.395364 20626 raft_consensus.cc:2749] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:33.343442 19939 leader_election.cc:343] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:33.323076 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 57527.9us
I20260709 13:10:33.328604 20737 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.399711 20737 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:33.400334 20194 raft_consensus.cc:2468] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:33.396564 19939 leader_election.cc:304] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:33.403473 20408 raft_consensus.cc:2749] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:33.408131 19939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 67602.1us
W20260709 13:10:33.413751 19939 leader_election.cc:343] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.417259 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:33.418162 20047 raft_consensus.cc:2468] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:33.419644 20243 tablet_bootstrap.cc:654] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.432662 20013 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:33.444985 20408 consensus_queue.cc:1048] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.448367 20248 raft_consensus.cc:359] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.450562 20248 raft_consensus.cc:385] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.450253 20163 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:33.450866 20248 raft_consensus.cc:740] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.448364 20735 raft_consensus.cc:2804] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.453641 20735 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.454007 20735 raft_consensus.cc:3060] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.469813 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:33.475258 19968 raft_consensus.cc:2468] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:33.470760 20644 raft_consensus.cc:2804] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.480525 20644 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.480906 20644 raft_consensus.cc:3060] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.481691 20731 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.487187 20737 raft_consensus.cc:493] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.487444 20628 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:33.492724 20248 consensus_queue.cc:260] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.529277 20248 ts_tablet_manager.cc:1434] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.000s
I20260709 13:10:33.496850 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:33.538018 20043 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.539754 20735 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.500387 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:33.490178 20628 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:33.523509 20745 log.cc:927] Time spent T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:33.532176 20701 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.487917 20737 raft_consensus.cc:515] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.560698 20191 raft_consensus.cc:1240] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Rejecting Update request from peer b112290c0b6e4aa08967a0350cf4b215 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.553154 20195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:33.560750 20731 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:33.558760 20701 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.574932 20719 consensus_queue.cc:1059] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:33.576354 19939 leader_election.cc:343] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.577616 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:33.578152 20242 tablet_bootstrap.cc:654] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.575774 20701 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
W20260709 13:10:33.614213 19939 leader_election.cc:343] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.624343 20735 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:33.643321 20243 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:33.643880 20243 ts_tablet_manager.cc:1403] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.317s	user 0.009s	sys 0.015s
I20260709 13:10:33.656071 20721 raft_consensus.cc:493] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.656127 20193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:33.657755 20193 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 0.
I20260709 13:10:33.656836 20721 raft_consensus.cc:515] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:33.640844 19939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 47824us
I20260709 13:10:33.639843 20644 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.663182 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:33.666918 20014 leader_election.cc:343] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.668566 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:33.669382 19971 raft_consensus.cc:3060] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.664435 20120 raft_consensus.cc:3060] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:33.696987 20755 log.cc:927] Time spent T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:33.697249 20195 raft_consensus.cc:2393] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:33.750805 20043 raft_consensus.cc:2468] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:33.752375 20242 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:33.752916 20242 ts_tablet_manager.cc:1403] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.419s	user 0.019s	sys 0.020s
I20260709 13:10:33.755138 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:33.755700 20242 raft_consensus.cc:359] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.756572 20242 raft_consensus.cc:385] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.756878 20242 raft_consensus.cc:740] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.757722 20242 consensus_queue.cc:260] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.758600 19940 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:33.760006 20756 raft_consensus.cc:2804] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.760298 20242 ts_tablet_manager.cc:1434] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:33.760555 20756 raft_consensus.cc:697] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:33.761426 20242 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:33.762986 19938 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:33.761411 20756 consensus_queue.cc:237] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:33.763442 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:33.764611 20628 raft_consensus.cc:2804] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.765121 20628 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.765509 20628 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.768518 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:33.769367 20197 raft_consensus.cc:2468] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:33.774820 20242 tablet_bootstrap.cc:654] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.705967 20721 leader_election.cc:290] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:33.783634 20013 leader_election.cc:304] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:33.804149 20243 raft_consensus.cc:359] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.804986 20243 raft_consensus.cc:385] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.805263 20243 raft_consensus.cc:740] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.799569 19971 raft_consensus.cc:2468] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:33.806035 20243 consensus_queue.cc:260] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.806958 20733 raft_consensus.cc:2804] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.820228 20733 raft_consensus.cc:493] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.820693 20733 raft_consensus.cc:3060] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.817937 20632 raft_consensus.cc:493] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.824086 20632 raft_consensus.cc:515] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.815198 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:33.831213 20013 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:33.832479 20651 raft_consensus.cc:2804] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:33.832594 20754 log.cc:927] Time spent T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: Append to log took a long time: real 0.218s	user 0.008s	sys 0.003s
I20260709 13:10:33.862221 20243 ts_tablet_manager.cc:1434] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.218s	user 0.008s	sys 0.002s
I20260709 13:10:33.866364 20651 raft_consensus.cc:697] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:33.865694 20636 raft_consensus.cc:3055] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.879920 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:33.880316 20644 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:33.880627 19966 raft_consensus.cc:2468] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 0.
I20260709 13:10:33.835239 20628 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.889099 20243 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:33.901402 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:33.904091 20161 leader_election.cc:304] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:33.907930 19973 raft_consensus.cc:2393] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:33.877545 20636 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:33.928964 20628 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
W20260709 13:10:33.937455 20163 leader_election.cc:343] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.879588 20651 consensus_queue.cc:237] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:33.943521 20242 tablet_bootstrap.cc:492] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:33.944152 20242 ts_tablet_manager.cc:1403] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.018s
I20260709 13:10:33.948529 20636 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:33.949752 20636 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.915251 20718 raft_consensus.cc:2804] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:33.965942 20089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 47022.3us
I20260709 13:10:33.964326 20718 raft_consensus.cc:493] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.969086 20718 raft_consensus.cc:3060] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.966034 20242 raft_consensus.cc:359] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.928987 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:33.978197 20242 raft_consensus.cc:385] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.981508 20242 raft_consensus.cc:740] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.980180 20163 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:33.985141 20193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:33.985916 20535 raft_consensus.cc:2749] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.985935 20193 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.989137 20733 raft_consensus.cc:515] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:33.990705 20737 leader_election.cc:290] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:33.991534 20733 leader_election.cc:290] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:33.993381 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:33.994426 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:33.995054 19966 raft_consensus.cc:2468] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:33.976329 20162 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:33.998035 20639 raft_consensus.cc:2749] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.999022 20013 leader_election.cc:304] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:34.000015 20652 raft_consensus.cc:2804] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.000422 20652 raft_consensus.cc:493] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.000733 20652 raft_consensus.cc:3060] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.002748 20243 tablet_bootstrap.cc:654] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.003573 20632 leader_election.cc:290] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:34.009140 20550 consensus_queue.cc:1048] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.019421 20242 consensus_queue.cc:260] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.020925 20122 raft_consensus.cc:3060] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.021440 20242 ts_tablet_manager.cc:1434] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:10:34.027582 20652 raft_consensus.cc:515] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:34.039587 20242 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:34.045694 20191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:34.049006 20720 raft_consensus.cc:493] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.062796 20718 raft_consensus.cc:515] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:34.068225 20193 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 1.
I20260709 13:10:34.105475 20644 consensus_queue.cc:1048] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.106007 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:34.095079 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123c09eb9fb4796a206bad4baa67b05" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:34.117475 20652 leader_election.cc:290] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:34.117975 20122 raft_consensus.cc:2468] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:34.114894 20197 raft_consensus.cc:3060] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.123687 20243 tablet_bootstrap.cc:492] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:34.124377 20243 ts_tablet_manager.cc:1403] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.250s	user 0.020s	sys 0.025s
I20260709 13:10:34.134939 20191 raft_consensus.cc:2393] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:34.099291 20720 raft_consensus.cc:515] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
W20260709 13:10:34.129798 19939 leader_election.cc:343] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.149153 20197 raft_consensus.cc:2468] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:34.144249 20718 leader_election.cc:290] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:34.150753 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:34.151561 19968 raft_consensus.cc:3060] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.155663 20720 leader_election.cc:290] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:34.144116 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:34.165997 19938 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:34.167011 20408 raft_consensus.cc:2804] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.167541 20408 raft_consensus.cc:697] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:34.167608 20013 leader_election.cc:304] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:34.168452 20408 consensus_queue.cc:237] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:34.166025 20243 raft_consensus.cc:359] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.169730 20243 raft_consensus.cc:385] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.170054 20243 raft_consensus.cc:740] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.170835 20243 consensus_queue.cc:260] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.172619 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:34.173529 20043 raft_consensus.cc:2393] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 1: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
W20260709 13:10:34.108752 20089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 66151.7us
I20260709 13:10:34.179275 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:34.183007 20194 raft_consensus.cc:2468] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:34.186661 20243 ts_tablet_manager.cc:1434] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 13:10:34.186996 20163 leader_election.cc:304] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:34.189015 20243 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: Bootstrap starting.
I20260709 13:10:34.194074 19968 raft_consensus.cc:2468] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:34.175475 20632 raft_consensus.cc:2804] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.209442 20632 raft_consensus.cc:697] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:34.210430 20632 consensus_queue.cc:237] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.187824 20087 leader_election.cc:304] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:34.215318 20717 raft_consensus.cc:2804] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.199448 20242 tablet_bootstrap.cc:654] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.206477 20736 raft_consensus.cc:2749] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.236181 20013 leader_election.cc:304] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:34.237362 20768 raft_consensus.cc:2804] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.196316 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d2c82b22aa4ac9802e9161cc6c6c23" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:34.237876 20768 raft_consensus.cc:697] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:34.238834 20768 consensus_queue.cc:237] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:34.239821 20197 raft_consensus.cc:2393] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 1: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:34.225329 20717 raft_consensus.cc:493] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.257733 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:34.258589 20043 raft_consensus.cc:2468] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 0.
I20260709 13:10:34.265635 20243 tablet_bootstrap.cc:654] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.245564 20771 consensus_queue.cc:1048] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:10:34.251354 20717 raft_consensus.cc:3060] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.297801 20242 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:34.303362 19872 catalog_manager.cc:5697] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.303407 20242 ts_tablet_manager.cc:1403] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.268s	user 0.025s	sys 0.000s
I20260709 13:10:34.310717 19871 catalog_manager.cc:5697] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } }
I20260709 13:10:34.323179 20242 raft_consensus.cc:359] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.324087 20242 raft_consensus.cc:385] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.324366 20242 raft_consensus.cc:740] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.305927 19872 catalog_manager.cc:5697] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.327409 19872 catalog_manager.cc:5697] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.331595 20756 consensus_queue.cc:1048] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:34.333381 19939 consensus_peers.cc:597] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.327539 20717 raft_consensus.cc:515] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.335896 20717 leader_election.cc:290] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:34.336896 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:34.337302 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afe0f7aca434ac08f951c456f44801d" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:34.337572 20042 raft_consensus.cc:3060] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.337922 20192 raft_consensus.cc:3060] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.342231 20243 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: No bootstrap required, opened a new log
I20260709 13:10:34.342769 20243 ts_tablet_manager.cc:1403] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.002s
I20260709 13:10:34.348407 20042 raft_consensus.cc:2468] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:34.349725 20089 leader_election.cc:304] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:34.353717 20192 raft_consensus.cc:2468] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:34.355072 20243 raft_consensus.cc:359] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.355777 20243 raft_consensus.cc:385] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.356078 20243 raft_consensus.cc:740] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.356851 20243 consensus_queue.cc:260] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.355125 20720 raft_consensus.cc:2804] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.358399 20243 ts_tablet_manager.cc:1434] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:34.358505 20720 raft_consensus.cc:697] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:34.359375 20720 consensus_queue.cc:237] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:34.364576 20242 consensus_queue.cc:260] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.368090 20242 ts_tablet_manager.cc:1434] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 13:10:34.369221 20242 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:34.395304 20717 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.395936 20717 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.397989 20717 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:34.399502 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:34.402457 19969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:34.404214 20087 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:34.410591 20717 raft_consensus.cc:2749] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.416990 20768 consensus_queue.cc:1048] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.418766 19873 catalog_manager.cc:5697] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.423840 19873 catalog_manager.cc:5697] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 0 to 1, leader changed from <none> to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.440472 20242 tablet_bootstrap.cc:654] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.520589 20242 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:34.521081 20242 ts_tablet_manager.cc:1403] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.003s
I20260709 13:10:34.523850 20242 raft_consensus.cc:359] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:34.524571 20242 raft_consensus.cc:385] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:34.535518 19921 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:34.524842 20242 raft_consensus.cc:740] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.539168 20242 consensus_queue.cc:260] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:34.544902 20632 consensus_queue.cc:1048] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.549893 20242 ts_tablet_manager.cc:1434] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:10:34.551087 20242 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: Bootstrap starting.
I20260709 13:10:34.563948 20242 tablet_bootstrap.cc:654] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.621526 19870 catalog_manager.cc:5697] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.648607 20764 consensus_queue.cc:1048] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.648893 20242 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: No bootstrap required, opened a new log
I20260709 13:10:34.649744 20242 ts_tablet_manager.cc:1403] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: Time spent bootstrapping tablet: real 0.099s	user 0.034s	sys 0.021s
I20260709 13:10:34.653081 20242 raft_consensus.cc:359] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.653386 20651 consensus_queue.cc:1048] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.653896 20242 raft_consensus.cc:385] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.654449 20242 raft_consensus.cc:740] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.655169 20242 consensus_queue.cc:260] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.657423 20242 ts_tablet_manager.cc:1434] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:34.677867 20651 consensus_queue.cc:1048] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.682489 20124 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.732792 20408 consensus_queue.cc:1048] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.756650 20550 consensus_queue.cc:1048] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.776144 20730 consensus_queue.cc:1048] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.786090 20577 raft_consensus.cc:493] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.786633 20577 raft_consensus.cc:515] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.788844 20577 leader_election.cc:290] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:34.790347 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:34.791033 20119 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:34.792694 20014 leader_election.cc:304] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:34.794999 19969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:34.795691 19969 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 0.
I20260709 13:10:34.797632 20577 raft_consensus.cc:2804] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.798069 20577 raft_consensus.cc:493] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.798403 20577 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.818470 20651 consensus_queue.cc:1048] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.824934 20577 raft_consensus.cc:515] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.827981 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:34.828663 19971 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.832401 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:34.833359 20119 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.845446 20632 consensus_queue.cc:1048] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.878816 20119 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:34.880985 20014 leader_election.cc:304] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:34.881834 20632 raft_consensus.cc:2804] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.882401 20632 raft_consensus.cc:697] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:34.883255 20632 consensus_queue.cc:237] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:34.884810 20577 leader_election.cc:290] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 1 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:34.888839 20124 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.893702 19971 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:34.937472 19870 catalog_manager.cc:5697] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 0 to 1, leader changed from <none> to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 1 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.160524 20408 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b112290c0b6e4aa08967a0350cf4b215)
I20260709 13:10:35.161120 20408 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:35.162972 20408 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:35.163846 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:35.164058 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:35.164675 20124 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:35.164937 20192 raft_consensus.cc:2393] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 3: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:35.165740 19939 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:35.166656 20408 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.167069 20408 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b112290c0b6e4aa08967a0350cf4b215)
I20260709 13:10:35.167352 20408 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.174773 20408 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:35.177440 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:35.177893 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:35.178654 20192 raft_consensus.cc:2393] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 3: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:35.178859 20408 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:35.183957 20124 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:35.185281 19939 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:35.186049 20408 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:35.186740 20408 raft_consensus.cc:697] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:35.187536 20408 consensus_queue.cc:237] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:35.200384 19870 catalog_manager.cc:5697] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 2 to 3, leader changed from b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.337630 20651 consensus_queue.cc:1048] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.354022 20632 consensus_queue.cc:1048] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.611686 20124 raft_consensus.cc:1275] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.612993 20811 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.623293 20198 raft_consensus.cc:1275] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.624833 20813 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:35.983752 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 52645.8us
W20260709 13:10:36.017778 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 107616us
I20260709 13:10:36.552644 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
W20260709 13:10:36.560372 20161 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:36.579051 20161 consensus_peers.cc:597] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.579785 20161 consensus_peers.cc:597] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.614964 20013 consensus_peers.cc:597] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.623893 20087 consensus_peers.cc:597] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.658219 20161 consensus_peers.cc:597] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.672240 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:36.674063 11576 tablet_replica.cc:333] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
W20260709 13:10:36.674554 20013 consensus_peers.cc:597] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.675952 20013 consensus_peers.cc:597] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.677448 11576 raft_consensus.cc:2243] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.678361 11576 raft_consensus.cc:2272] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.681844 11576 tablet_replica.cc:333] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.682754 11576 raft_consensus.cc:2243] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.683255 11576 raft_consensus.cc:2272] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.686488 11576 tablet_replica.cc:333] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.687327 11576 raft_consensus.cc:2243] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.688537 11576 raft_consensus.cc:2272] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.691188 11576 tablet_replica.cc:333] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.691854 11576 raft_consensus.cc:2243] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.692433 11576 raft_consensus.cc:2272] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.695602 11576 tablet_replica.cc:333] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.696527 11576 raft_consensus.cc:2243] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.697095 11576 raft_consensus.cc:2272] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.701364 11576 tablet_replica.cc:333] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.702310 11576 raft_consensus.cc:2243] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.702872 11576 raft_consensus.cc:2272] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.705777 11576 tablet_replica.cc:333] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.706509 11576 raft_consensus.cc:2243] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.707346 11576 raft_consensus.cc:2272] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.710595 11576 tablet_replica.cc:333] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.711409 11576 raft_consensus.cc:2243] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.712093 11576 raft_consensus.cc:2272] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.715584 11576 tablet_replica.cc:333] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.716245 11576 raft_consensus.cc:2243] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.717252 11576 raft_consensus.cc:2272] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.721748 11576 tablet_replica.cc:333] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.722719 11576 raft_consensus.cc:2243] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:36.723649 20087 consensus_peers.cc:597] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.724316 11576 raft_consensus.cc:2272] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.728229 11576 tablet_replica.cc:333] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.729141 11576 raft_consensus.cc:2243] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.729789 11576 raft_consensus.cc:2272] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.733047 20013 consensus_peers.cc:597] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.734056 11576 tablet_replica.cc:333] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.735176 11576 raft_consensus.cc:2243] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.736523 11576 raft_consensus.cc:2272] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.742219 11576 tablet_replica.cc:333] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.743083 11576 raft_consensus.cc:2243] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.743650 11576 raft_consensus.cc:2272] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.746567 11576 tablet_replica.cc:333] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.747188 11576 raft_consensus.cc:2243] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.747627 11576 raft_consensus.cc:2272] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.750114 11576 tablet_replica.cc:333] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.750818 11576 raft_consensus.cc:2243] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.751320 11576 raft_consensus.cc:2272] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.753901 11576 tablet_replica.cc:333] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.754575 11576 raft_consensus.cc:2243] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.755074 11576 raft_consensus.cc:2272] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.757887 11576 tablet_replica.cc:333] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.758656 11576 raft_consensus.cc:2243] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.759398 11576 raft_consensus.cc:2272] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.762802 11576 tablet_replica.cc:333] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.763509 11576 raft_consensus.cc:2243] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.764088 11576 raft_consensus.cc:2272] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.766793 11576 tablet_replica.cc:333] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.767501 11576 raft_consensus.cc:2243] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.768311 11576 raft_consensus.cc:2272] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.771610 11576 tablet_replica.cc:333] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.772388 11576 raft_consensus.cc:2243] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:36.772811 20013 consensus_peers.cc:597] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.773510 11576 raft_consensus.cc:2272] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.776213 11576 tablet_replica.cc:333] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.776845 11576 raft_consensus.cc:2243] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.777899 11576 raft_consensus.cc:2272] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.781050 11576 tablet_replica.cc:333] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
W20260709 13:10:36.781369 20013 consensus_peers.cc:597] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.781705 11576 raft_consensus.cc:2243] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.782405 11576 raft_consensus.cc:2272] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.784821 11576 tablet_replica.cc:333] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.785596 11576 raft_consensus.cc:2243] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.786247 11576 raft_consensus.cc:2272] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.789932 11576 tablet_replica.cc:333] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.790706 11576 raft_consensus.cc:2243] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.791294 11576 raft_consensus.cc:2272] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.793367 20161 consensus_peers.cc:597] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.794363 11576 tablet_replica.cc:333] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.795107 11576 raft_consensus.cc:2243] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.795699 11576 raft_consensus.cc:2272] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.799165 11576 tablet_replica.cc:333] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.800098 11576 raft_consensus.cc:2243] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.800698 11576 raft_consensus.cc:2272] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.801546 20087 consensus_peers.cc:597] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.803393 11576 tablet_replica.cc:333] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.804236 11576 raft_consensus.cc:2243] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.804754 11576 raft_consensus.cc:2272] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.809024 11576 tablet_replica.cc:333] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.809921 11576 raft_consensus.cc:2243] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.811439 11576 raft_consensus.cc:2272] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.815127 11576 tablet_replica.cc:333] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.815999 11576 raft_consensus.cc:2243] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.816705 11576 raft_consensus.cc:2272] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.819988 11576 tablet_replica.cc:333] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.820744 11576 raft_consensus.cc:2243] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.821762 11576 raft_consensus.cc:2272] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.824759 11576 tablet_replica.cc:333] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.825434 11576 raft_consensus.cc:2243] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.826772 11576 raft_consensus.cc:2272] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.829334 11576 tablet_replica.cc:333] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.829946 11576 raft_consensus.cc:2243] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.830463 11576 raft_consensus.cc:2272] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.832561 11576 tablet_replica.cc:333] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.833170 11576 raft_consensus.cc:2243] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.833674 11576 raft_consensus.cc:2272] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.835739 11576 tablet_replica.cc:333] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.836366 11576 raft_consensus.cc:2243] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.836853 11576 raft_consensus.cc:2272] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.839845 11576 tablet_replica.cc:333] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.840695 11576 raft_consensus.cc:2243] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.841226 11576 raft_consensus.cc:2272] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.844308 11576 tablet_replica.cc:333] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
W20260709 13:10:36.843876 20161 consensus_peers.cc:597] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.845206 11576 raft_consensus.cc:2243] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.845845 11576 raft_consensus.cc:2272] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.848753 11576 tablet_replica.cc:333] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.849464 11576 raft_consensus.cc:2243] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.850054 11576 raft_consensus.cc:2272] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.853085 11576 tablet_replica.cc:333] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
W20260709 13:10:36.853513 20013 consensus_peers.cc:597] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.853826 11576 raft_consensus.cc:2243] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.854501 11576 raft_consensus.cc:2272] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.855644 20161 consensus_peers.cc:597] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.857879 11576 tablet_replica.cc:333] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.858765 11576 raft_consensus.cc:2243] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.859359 11576 raft_consensus.cc:2272] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.861374 20161 consensus_peers.cc:597] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.862187 11576 tablet_replica.cc:333] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.862743 11576 raft_consensus.cc:2243] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.863510 11576 raft_consensus.cc:2272] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.865629 11576 tablet_replica.cc:333] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.866191 11576 raft_consensus.cc:2243] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.867054 11576 raft_consensus.cc:2272] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.869396 11576 tablet_replica.cc:333] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.869992 11576 raft_consensus.cc:2243] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.871109 11576 raft_consensus.cc:2272] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.873994 11576 tablet_replica.cc:333] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.874691 11576 raft_consensus.cc:2243] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.875823 11576 raft_consensus.cc:2272] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.876155 20161 consensus_peers.cc:597] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.878952 11576 tablet_replica.cc:333] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.879832 11576 raft_consensus.cc:2243] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.880461 11576 raft_consensus.cc:2272] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.883458 11576 tablet_replica.cc:333] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: stopping tablet replica
I20260709 13:10:36.884086 11576 raft_consensus.cc:2243] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.884639 11576 raft_consensus.cc:2272] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.910338 20013 consensus_peers.cc:597] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.919365 20087 consensus_peers.cc:597] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.922386 20161 consensus_peers.cc:597] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.929111 20087 consensus_peers.cc:597] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.933391 20161 consensus_peers.cc:597] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.938660 20013 consensus_peers.cc:597] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.939616 20161 consensus_peers.cc:597] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.948256 20013 consensus_peers.cc:597] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.953043 20013 consensus_peers.cc:597] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.982360 20013 consensus_peers.cc:597] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.982839 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
W20260709 13:10:37.023571 20087 consensus_peers.cc:597] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.076258 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.085989 20834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.089591 20835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.091477 20837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.096385 11576 server_base.cc:1061] running on GCE node
W20260709 13:10:37.096840 20013 consensus_peers.cc:597] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.099833 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.100270 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.100505 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602637100464 us; error 0 us; skew 500 ppm
I20260709 13:10:37.101378 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.110059 11576 webserver.cc:533] Webserver started at http://127.11.78.1:37789/ using document root <none> and password file <none>
I20260709 13:10:37.110837 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.111104 11576 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:37.116588 11576 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
W20260709 13:10:37.123711 20161 consensus_peers.cc:597] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.129490 20843 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.130753 11576 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:10:37.131287 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-smzk"
I20260709 13:10:37.132117 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.156738 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.159081 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.162282 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:10:37.164752 20013 consensus_peers.cc:597] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.169849 20850 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:10:37.482673 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:10:37.483057 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.314s	user 0.004s	sys 0.005s
I20260709 13:10:37.483399 11576 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:10:37.491726 20850 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.532181 20850 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.533329 20850 tablet_bootstrap.cc:492] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.534029 20850 ts_tablet_manager.cc:1403] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.016s
I20260709 13:10:37.537256 20850 raft_consensus.cc:359] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.538225 20850 raft_consensus.cc:740] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.539044 20850 consensus_queue.cc:260] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.542102 20850 ts_tablet_manager.cc:1434] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:37.542973 20850 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.561115 20850 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.562352 20850 tablet_bootstrap.cc:492] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.563090 20850 ts_tablet_manager.cc:1403] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:37.566429 20850 raft_consensus.cc:359] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.567128 20850 raft_consensus.cc:740] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.567826 20850 consensus_queue.cc:260] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.569962 20850 ts_tablet_manager.cc:1434] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:37.570797 20850 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.592119 20850 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.593912 20850 tablet_bootstrap.cc:492] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.594681 20850 ts_tablet_manager.cc:1403] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:10:37.597566 20850 raft_consensus.cc:359] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.598237 20850 raft_consensus.cc:740] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.598954 20850 consensus_queue.cc:260] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.600787 20850 ts_tablet_manager.cc:1434] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:37.601626 20850 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.617491 20850 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.619095 20850 tablet_bootstrap.cc:492] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.619840 20850 ts_tablet_manager.cc:1403] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:10:37.622455 20850 raft_consensus.cc:359] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.623811 20850 raft_consensus.cc:740] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.624495 20850 consensus_queue.cc:260] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.626703 20850 ts_tablet_manager.cc:1434] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:10:37.627581 20850 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.642160 20850 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.643088 20850 tablet_bootstrap.cc:492] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.643680 20850 ts_tablet_manager.cc:1403] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:10:37.646086 20850 raft_consensus.cc:359] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.646809 20850 raft_consensus.cc:740] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.647493 20850 consensus_queue.cc:260] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.649437 20850 ts_tablet_manager.cc:1434] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:10:37.650190 20850 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.670641 20850 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.671610 20850 tablet_bootstrap.cc:492] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.672300 20850 ts_tablet_manager.cc:1403] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:10:37.675235 20850 raft_consensus.cc:359] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.675981 20850 raft_consensus.cc:740] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.676795 20850 consensus_queue.cc:260] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.679040 20850 ts_tablet_manager.cc:1434] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:37.679968 20850 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.699951 20831 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.700735 20831 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.703190 20831 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.704147 20850 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.705257 20850 tablet_bootstrap.cc:492] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.705976 20850 ts_tablet_manager.cc:1403] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:10:37.708736 20850 raft_consensus.cc:359] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.709482 20850 raft_consensus.cc:740] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.710242 20850 consensus_queue.cc:260] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.712410 20191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:37.712486 20850 ts_tablet_manager.cc:1434] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:10:37.723994 20087 leader_election.cc:336] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.724677 20087 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.725443 20831 raft_consensus.cc:2749] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:37.728832 20850 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.757091 20850 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.758133 20850 tablet_bootstrap.cc:492] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.758811 20850 ts_tablet_manager.cc:1403] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.012s
I20260709 13:10:37.761592 20850 raft_consensus.cc:359] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.762391 20850 raft_consensus.cc:740] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.763176 20850 consensus_queue.cc:260] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.765381 20850 ts_tablet_manager.cc:1434] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:37.766265 20850 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.770802 11576 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:10:37.771333 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.288s	user 0.278s	sys 0.005s
I20260709 13:10:37.789215 20850 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.790498 20850 tablet_bootstrap.cc:492] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.791390 20850 ts_tablet_manager.cc:1403] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.005s
I20260709 13:10:37.794279 20850 raft_consensus.cc:359] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.795110 20850 raft_consensus.cc:740] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.795948 20850 consensus_queue.cc:260] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.798312 20850 ts_tablet_manager.cc:1434] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:37.799242 20850 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.807922 20830 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.809033 20830 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.818141 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:37.822093 20850 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.823292 20850 tablet_bootstrap.cc:492] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.824139 20850 ts_tablet_manager.cc:1403] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:10:37.826915 20850 raft_consensus.cc:359] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.827684 20850 raft_consensus.cc:740] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.828580 20850 consensus_queue.cc:260] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.828972 20830 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.831316 20850 ts_tablet_manager.cc:1434] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:37.832288 20850 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:37.837918 20161 leader_election.cc:336] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.841104 20161 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.846814 20644 raft_consensus.cc:2749] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.862277 20644 raft_consensus.cc:493] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.862797 20644 raft_consensus.cc:515] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.864262 20850 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.864863 20644 leader_election.cc:290] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.865748 20850 tablet_bootstrap.cc:492] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.867005 20850 ts_tablet_manager.cc:1403] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.016s
I20260709 13:10:37.867058 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:37.871735 20850 raft_consensus.cc:359] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.872922 20850 raft_consensus.cc:740] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
W20260709 13:10:37.873346 20161 leader_election.cc:336] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.873865 20161 leader_election.cc:304] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.874429 20850 consensus_queue.cc:260] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.875974 20644 raft_consensus.cc:2749] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.878182 20850 ts_tablet_manager.cc:1434] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:10:37.879436 20850 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.889325 20644 raft_consensus.cc:493] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.889959 20644 raft_consensus.cc:515] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.891855 20644 leader_election.cc:290] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:37.893440 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:37.896364 20824 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.897013 20824 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.898977 20824 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:37.900132 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:37.907089 20161 leader_election.cc:336] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.907543 20161 leader_election.cc:304] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
W20260709 13:10:37.909067 20087 leader_election.cc:336] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.909283 20644 raft_consensus.cc:2749] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.909312 20850 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.912743 20850 tablet_bootstrap.cc:492] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.909644 20087 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.913975 20850 ts_tablet_manager.cc:1403] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.007s
I20260709 13:10:37.915244 20831 raft_consensus.cc:2749] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.918309 20850 raft_consensus.cc:359] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.919395 20850 raft_consensus.cc:740] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.920497 20850 consensus_queue.cc:260] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.921375 20853 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.922129 20853 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:37.923936 20850 ts_tablet_manager.cc:1434] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:10:37.924424 20853 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:37.927027 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:37.928224 20124 raft_consensus.cc:2468] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:37.925516 20850 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:37.927088 20831 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.929507 20831 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:37.928215 20013 leader_election.cc:336] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.931805 20831 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.935382 20014 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.936374 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:37.936867 20853 raft_consensus.cc:2804] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:37.940852 20087 leader_election.cc:336] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:37.940925 20853 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.941977 20831 raft_consensus.cc:493] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.942646 20087 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:37.943555 20853 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.943197 20831 raft_consensus.cc:515] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.946652 20831 leader_election.cc:290] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.948252 20824 raft_consensus.cc:2749] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.949844 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:37.951406 20196 raft_consensus.cc:2468] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:37.956024 20831 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.956703 20831 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.959334 20831 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.963868 20850 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.964943 20850 tablet_bootstrap.cc:492] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:37.965623 20850 ts_tablet_manager.cc:1403] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.005s
I20260709 13:10:37.955739 20087 leader_election.cc:304] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:37.968770 20850 raft_consensus.cc:359] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.969596 20850 raft_consensus.cc:740] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.970367 20850 consensus_queue.cc:260] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:37.971827 20824 raft_consensus.cc:2804] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.972347 20824 raft_consensus.cc:493] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.972354 20191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:37.972824 20824 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.981595 20824 raft_consensus.cc:515] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.981909 20822 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.982910 20822 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:37.983783 20824 leader_election.cc:290] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.987227 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:37.987962 20122 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 3.
I20260709 13:10:37.989374 20822 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:37.991284 20162 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:37.993043 20830 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:37.993392 20830 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:37.993829 20830 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:37.995549 20087 leader_election.cc:336] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.001538 20644 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.002095 20644 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.003405 20850 ts_tablet_manager.cc:1434] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:10:38.004017 20644 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.004573 20850 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.008965 20853 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.010088 20822 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.010746 20822 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:38.014319 20161 leader_election.cc:336] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.015112 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:38.015148 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3ac05b81ea4c3c83799ea30724a707" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.017011 20196 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.017581 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.018275 20124 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:38.020831 20013 leader_election.cc:336] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.025333 20087 leader_election.cc:336] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.025962 20087 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.025830 20822 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.028174 20124 raft_consensus.cc:2468] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:38.028174 20853 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:38.030284 20830 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.031566 20831 raft_consensus.cc:2749] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.032737 20161 leader_election.cc:336] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.034925 20161 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.035800 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:38.036178 20644 raft_consensus.cc:2749] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.039922 20087 leader_election.cc:336] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.041522 20014 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.045056 20829 raft_consensus.cc:2804] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.044957 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.045785 20124 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:38.049824 20161 leader_election.cc:336] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.050374 20161 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.051443 20830 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.055233 20124 raft_consensus.cc:2468] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 4.
I20260709 13:10:38.056401 20162 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.057343 20829 raft_consensus.cc:697] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.058378 20829 consensus_queue.cc:237] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.060962 20850 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.063391 20644 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.083483 20196 raft_consensus.cc:2468] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:38.065472 20830 raft_consensus.cc:2749] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.069696 20850 tablet_bootstrap.cc:492] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:38.085337 20850 ts_tablet_manager.cc:1403] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.011s
I20260709 13:10:38.090515 20850 raft_consensus.cc:359] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.091666 20850 raft_consensus.cc:740] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.077714 20901 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.093773 20087 leader_election.cc:304] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.092748 20830 raft_consensus.cc:2804] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:38.095103 20830 raft_consensus.cc:697] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 4 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:38.095672 20824 raft_consensus.cc:2804] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.093664 20901 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:38.077383 20161 leader_election.cc:336] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.099668 20644 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.098202 20850 consensus_queue.cc:260] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.096606 20824 raft_consensus.cc:697] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:38.116142 20850 ts_tablet_manager.cc:1434] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:10:38.117934 20850 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.121475 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:38.122287 20122 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:38.123698 20162 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.126296 19871 catalog_manager.cc:5697] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 2 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.137436 20644 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.138275 20822 raft_consensus.cc:2804] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.138942 20901 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.139097 20632 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.113309 20830 consensus_queue.cc:237] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.144449 20632 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.154234 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.161602 20831 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.162257 20831 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.166029 20191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.166594 20191 raft_consensus.cc:2468] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
I20260709 13:10:38.167878 20087 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.168889 20910 raft_consensus.cc:2804] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.169485 20910 raft_consensus.cc:493] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.171015 20910 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.171263 20831 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.175800 20644 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.176391 20644 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:38.178347 20087 leader_election.cc:336] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.142387 20822 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.158025 20896 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.183231 20912 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.154448 20824 consensus_queue.cc:237] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.194653 20822 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.199572 20632 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:38.204071 20852 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.204231 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:38.206018 20852 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.208876 20852 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.210850 20121 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:38.213732 20901 raft_consensus.cc:493] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.214414 20901 raft_consensus.cc:515] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:38.214870 20013 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.217685 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:38.215775 20087 leader_election.cc:336] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.201282 20896 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.221784 20043 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 1.
W20260709 13:10:38.220716 20013 leader_election.cc:336] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.222218 20196 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:38.223932 20901 leader_election.cc:290] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.220912 20912 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.227248 20912 leader_election.cc:290] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.228421 20896 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.229066 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:38.232349 20161 leader_election.cc:336] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.234417 20014 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.235749 20644 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.242508 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:38.243649 20043 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
I20260709 13:10:38.243877 20822 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.247128 20013 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.254783 20632 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.255223 20632 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.255632 20632 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.232349 20121 raft_consensus.cc:2468] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 1.
I20260709 13:10:38.247605 20901 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.246222 20852 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.252292 20853 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.262351 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:38.263170 20901 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.266535 20901 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.269228 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.269897 20122 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.265240 20852 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.271977 20852 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.269255 20853 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.272881 20089 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
W20260709 13:10:38.273757 20089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 48706us
I20260709 13:10:38.273420 20910 raft_consensus.cc:515] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.274305 20853 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:38.275435 20824 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.275835 20824 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.275887 20910 leader_election.cc:290] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.276244 20824 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.278710 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:38.279551 20119 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:38.288513 20014 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.296128 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:38.300338 19870 catalog_manager.cc:5697] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.291488 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.299880 20904 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.297724 20853 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.336649 20122 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
W20260709 13:10:38.340163 20087 leader_election.cc:336] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.340946 20087 leader_election.cc:336] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.332790 20192 raft_consensus.cc:2468] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:38.339990 20162 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.337152 20904 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.344251 20904 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.344553 20911 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.345288 20911 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.343844 20162 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.337998 20822 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.374377 20913 raft_consensus.cc:2804] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.374943 20913 raft_consensus.cc:493] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.375301 20913 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:38.376143 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 50028.4us
I20260709 13:10:38.376999 20163 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:38.378368 20918 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.378960 20918 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.379339 20918 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.375474 20901 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.353286 20912 raft_consensus.cc:2804] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.339991 20853 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.352622 20911 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.398881 20850 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.405957 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.406615 20905 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.407104 20197 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
W20260709 13:10:38.411365 20013 leader_election.cc:336] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.415539 20853 leader_election.cc:290] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.410547 20824 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.400501 20912 raft_consensus.cc:697] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:38.421545 20850 tablet_bootstrap.cc:492] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:38.421178 20904 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.425094 20632 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.407749 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c021951a7255405393cb29fc326c0791" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.434963 20850 ts_tablet_manager.cc:1403] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.318s	user 0.029s	sys 0.030s
I20260709 13:10:38.437234 20632 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:38.439136 20161 leader_election.cc:336] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.440362 20161 leader_election.cc:336] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.440867 20161 leader_election.cc:304] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.444244 20047 raft_consensus.cc:2393] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 3: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
W20260709 13:10:38.444629 20161 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.445281 20161 leader_election.cc:336] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.440828 20192 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.432130 20905 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.455288 20905 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.457090 20924 raft_consensus.cc:2749] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.458572 20912 consensus_queue.cc:237] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.461370 20901 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:38.477623 20087 leader_election.cc:336] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.478219 19872 catalog_manager.cc:5697] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 3 to 4, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 4 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.479012 20850 raft_consensus.cc:359] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.480409 20850 raft_consensus.cc:740] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.481487 20850 consensus_queue.cc:260] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.486574 20850 ts_tablet_manager.cc:1434] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:10:38.487576 20850 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.482520 20913 raft_consensus.cc:515] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.489194 20824 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.483883 20918 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.492466 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b550827c3d4286a9fa6f1a30de0033" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.489388 20192 raft_consensus.cc:2468] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:38.493211 20904 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:38.493824 20122 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.501258 20087 leader_election.cc:304] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.502043 20918 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:38.507519 20910 raft_consensus.cc:2804] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.509028 20910 raft_consensus.cc:697] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:38.509428 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:38.510147 20910 consensus_queue.cc:237] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.492775 20913 leader_election.cc:290] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.510766 20048 raft_consensus.cc:2393] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b112290c0b6e4aa08967a0350cf4b215 in current term 2: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:38.494995 20089 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.518322 20824 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:38.500569 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 76740.3us
I20260709 13:10:38.525595 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:38.536240 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.537016 20042 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 3: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:38.537307 20119 raft_consensus.cc:2393] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 2: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
I20260709 13:10:38.524091 20122 raft_consensus.cc:2468] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
I20260709 13:10:38.528772 20089 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.540518 20162 leader_election.cc:304] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.541491 20929 raft_consensus.cc:2749] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.541711 20930 raft_consensus.cc:2804] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.542450 20930 raft_consensus.cc:697] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:38.544286 20930 consensus_queue.cc:237] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:38.535360 20161 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.535957 20013 leader_election.cc:304] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
W20260709 13:10:38.546804 20161 leader_election.cc:336] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.538659 20120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:38.547540 20013 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:38.551338 20911 raft_consensus.cc:2804] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.551775 20911 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.552196 20911 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.547371 20936 raft_consensus.cc:2804] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.556692 20936 raft_consensus.cc:493] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.557282 20936 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.560791 20824 raft_consensus.cc:2749] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.567183 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.567263 20163 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.568131 20192 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:38.572239 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.580683 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:38.581494 20196 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 1.
I20260709 13:10:38.582580 20122 raft_consensus.cc:1275] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:38.595736 20013 leader_election.cc:336] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.598385 20013 leader_election.cc:336] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.601775 20904 consensus_queue.cc:1048] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.611063 20013 leader_election.cc:304] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:38.616959 20632 raft_consensus.cc:2804] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.617461 20632 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.617921 20632 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.573428 20918 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.619463 20013 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:38.626675 20934 raft_consensus.cc:2804] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.627135 20934 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:38.627493 20934 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.636754 20120 raft_consensus.cc:2468] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 3.
I20260709 13:10:38.638316 20632 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.644101 20632 leader_election.cc:290] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.639144 20936 raft_consensus.cc:515] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.647982 20014 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:38.649180 20905 raft_consensus.cc:2804] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.649740 20905 raft_consensus.cc:697] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.650645 20905 consensus_queue.cc:237] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.653227 20192 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 3: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:38.574306 20911 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.659557 20911 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.659988 20934 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.665818 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.666497 20192 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:38.666517 20013 leader_election.cc:336] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.667176 20013 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.678246 20904 raft_consensus.cc:2749] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.678510 20013 leader_election.cc:336] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.681020 20192 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
W20260709 13:10:38.681609 20013 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.682372 20013 leader_election.cc:336] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.685113 20936 leader_election.cc:290] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:38.691303 20013 leader_election.cc:336] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.692791 20013 consensus_peers.cc:597] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.695495 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049e74a7f6364769958bf3682e89a7da" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.696189 20192 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.696894 20013 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.697491 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.697980 20904 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.698247 20196 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.699157 20013 leader_election.cc:304] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:38.699926 20934 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:38.701961 20933 raft_consensus.cc:2804] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.707867 19870 catalog_manager.cc:5697] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:38.703100 20013 leader_election.cc:336] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.705170 20122 raft_consensus.cc:1275] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 4 FOLLOWER]: Refusing update from remote peer 9e3242b28df94215893da755f099a6e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:38.702953 20191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:38.711457 20933 raft_consensus.cc:697] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.711616 20191 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.712579 20933 consensus_queue.cc:237] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.714344 20930 consensus_queue.cc:1048] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:38.725826 20013 leader_election.cc:336] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:38.726521 20013 leader_election.cc:336] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.731216 20196 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
W20260709 13:10:38.733292 20013 leader_election.cc:336] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:38.737505 20196 raft_consensus.cc:1275] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.738044 20013 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.741021 20824 consensus_queue.cc:1048] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.741698 20934 raft_consensus.cc:2804] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.742304 20934 raft_consensus.cc:697] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.743386 20934 consensus_queue.cc:237] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:38.744441 20161 consensus_peers.cc:597] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:38.746601 20087 consensus_peers.cc:597] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.748853 19872 catalog_manager.cc:5697] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 2 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.750936 19872 catalog_manager.cc:5697] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 2 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.775460 20850 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.709329 20192 raft_consensus.cc:2468] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:38.776659 20850 tablet_bootstrap.cc:492] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:38.777431 20850 ts_tablet_manager.cc:1403] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.290s	user 0.017s	sys 0.003s
I20260709 13:10:38.780431 20850 raft_consensus.cc:359] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.781003 20191 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:38.781245 20850 raft_consensus.cc:740] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.789351 20013 leader_election.cc:304] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.790208 20905 raft_consensus.cc:2804] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.790639 20013 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:38.790921 20905 raft_consensus.cc:697] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.791926 20905 consensus_queue.cc:237] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.792292 20850 consensus_queue.cc:260] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.794627 20850 ts_tablet_manager.cc:1434] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:38.795586 20850 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.798588 19870 catalog_manager.cc:5697] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 2 to 3, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 3 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.804442 20904 raft_consensus.cc:2804] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.805099 20904 raft_consensus.cc:697] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:38.806008 20904 consensus_queue.cc:237] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:38.834445 20850 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.835440 20850 tablet_bootstrap.cc:492] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:38.836305 20850 ts_tablet_manager.cc:1403] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.009s
I20260709 13:10:38.839757 20850 raft_consensus.cc:359] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.840454 20850 raft_consensus.cc:740] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.841461 20850 consensus_queue.cc:260] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:38.851807 20850 ts_tablet_manager.cc:1434] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:10:38.853374 20850 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.885154 19870 catalog_manager.cc:5697] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 2 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.888705 19870 catalog_manager.cc:5697] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 2 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.892832 19870 catalog_manager.cc:5697] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 2 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.892911 20850 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.896638 20850 tablet_bootstrap.cc:492] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:38.896236 19870 catalog_manager.cc:5697] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 1 to 2, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 2 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.897570 20850 ts_tablet_manager.cc:1403] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.017s
I20260709 13:10:38.902447 20850 raft_consensus.cc:359] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.903285 20850 raft_consensus.cc:740] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.904356 20850 consensus_queue.cc:260] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:38.923653 20850 ts_tablet_manager.cc:1434] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:10:38.924738 20850 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:38.946424 20855 raft_consensus.cc:493] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.947221 20855 raft_consensus.cc:515] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:38.978624 20161 consensus_peers.cc:597] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.985205 20855 leader_election.cc:290] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:38.998821 20850 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.005708 20855 raft_consensus.cc:493] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.007701 20850 tablet_bootstrap.cc:492] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:39.007189 20855 raft_consensus.cc:515] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:39.008615 20850 ts_tablet_manager.cc:1403] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.016s
I20260709 13:10:39.011368 20855 leader_election.cc:290] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:39.022157 20850 raft_consensus.cc:359] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.028234 20850 raft_consensus.cc:740] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.030511 20850 consensus_queue.cc:260] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.035367 20850 ts_tablet_manager.cc:1434] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:10:39.036242 20850 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:39.052201 20161 consensus_peers.cc:597] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.052745 20161 consensus_peers.cc:597] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.059214 20123 raft_consensus.cc:1275] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer 9e3242b28df94215893da755f099a6e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.063491 20918 consensus_queue.cc:1048] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.073047 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:42127
I20260709 13:10:39.077106 20850 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.079077 20850 tablet_bootstrap.cc:492] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:39.073160 20977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:42127 every 8 connection(s)
I20260709 13:10:39.079759 20850 ts_tablet_manager.cc:1403] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.011s
I20260709 13:10:39.086513 20850 raft_consensus.cc:359] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.087502 20850 raft_consensus.cc:740] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.088477 20850 consensus_queue.cc:260] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.092289 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:39.095456 20122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.112284 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f32ec9cdc7b42a8807ae68a8b3db7b8" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.113188 20850 ts_tablet_manager.cc:1434] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:10:39.114254 20850 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:39.101776 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:39.125550 20196 raft_consensus.cc:1275] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.127650 20855 raft_consensus.cc:493] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.128319 20855 raft_consensus.cc:515] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:39.134171 20121 raft_consensus.cc:1275] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.146387 20824 consensus_queue.cc:1048] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:39.149931 20855 leader_election.cc:290] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:39.160815 20933 consensus_queue.cc:1048] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.155742 20855 raft_consensus.cc:493] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.171059 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:39.172194 20855 raft_consensus.cc:515] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.201717 20855 leader_election.cc:290] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:39.172763 20845 leader_election.cc:304] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:39.206303 20855 raft_consensus.cc:2749] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.207494 20121 raft_consensus.cc:1275] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer 9e3242b28df94215893da755f099a6e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.207829 20845 leader_election.cc:304] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:39.224601 20855 raft_consensus.cc:2749] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.246085 20855 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.273732 20118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.271232 20855 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:39.382505 20850 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.422320 20850 tablet_bootstrap.cc:492] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:39.423269 20850 ts_tablet_manager.cc:1403] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.309s	user 0.032s	sys 0.002s
I20260709 13:10:39.382594 20930 consensus_queue.cc:1048] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:10:39.429234 20996 raft_consensus.cc:493] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.450492 20855 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:39.455096 20994 raft_consensus.cc:493] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.516256 20850 raft_consensus.cc:359] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.518029 20850 raft_consensus.cc:740] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
W20260709 13:10:39.496656 20987 log.cc:927] Time spent T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:10:39.471752 20996 raft_consensus.cc:515] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:39.523837 20191 raft_consensus.cc:1275] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.482342 20855 raft_consensus.cc:493] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.525472 20855 raft_consensus.cc:515] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:39.541020 20850 consensus_queue.cc:260] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.577541 20850 ts_tablet_manager.cc:1434] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.154s	user 0.010s	sys 0.000s
I20260709 13:10:39.515463 20998 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.581905 20850 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:39.568506 20014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 121610us
I20260709 13:10:39.566797 20994 raft_consensus.cc:515] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
W20260709 13:10:39.614913 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 186687us
I20260709 13:10:39.594491 20996 leader_election.cc:290] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:39.602837 20855 leader_election.cc:290] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:39.591367 20998 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:39.644508 20994 leader_election.cc:290] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:39.637425 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.655220 20996 raft_consensus.cc:493] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.656957 21000 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.713515 20996 raft_consensus.cc:515] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.728783 20994 raft_consensus.cc:493] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.729369 20855 raft_consensus.cc:493] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.713845 21000 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:39.768294 20121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.745503 20196 raft_consensus.cc:1275] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.801518 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:39.802908 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 66421.9us
I20260709 13:10:39.761734 20994 raft_consensus.cc:515] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:39.763991 20855 raft_consensus.cc:515] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:39.852814 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac09267db943769573413621ec2923" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
W20260709 13:10:39.856055 20163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 51402us
I20260709 13:10:39.862619 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c908cda42a1b4577845ec65410d29f6f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:39.791447 21003 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:10:39.869374 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:39.874728 20195 raft_consensus.cc:1275] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.869812 20998 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:39.873535 20996 leader_election.cc:290] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:39.887805 21023 consensus_queue.cc:1048] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:39.896920 20902 raft_consensus.cc:3060] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.906107 20193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:39.907203 20193 raft_consensus.cc:2393] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 2: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:39.910074 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96254c9e0b6a4f8e828190935026cf4b" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:39.899904 20196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d813cf323225419f955c3efdae688a83" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:39.913193 20994 leader_election.cc:290] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:39.903434 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:39.912330 20893 raft_consensus.cc:3060] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.916013 21000 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:39.917907 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5716bb9307734152b1901998813a44eb" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:39.934931 20899 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.940470 20855 leader_election.cc:290] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:39.901752 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:39.958541 20198 raft_consensus.cc:1275] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.960251 20844 leader_election.cc:304] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.001745 20855 raft_consensus.cc:2749] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.990854 20893 raft_consensus.cc:1275] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:40.013535 20891 raft_consensus.cc:3060] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.018994 20123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:40.020730 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:40.020771 20013 consensus_peers.cc:597] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.021883 20894 raft_consensus.cc:3060] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.024101 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c577376c4e4f414c9e6b3b717c9dea3c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
W20260709 13:10:40.022572 20013 consensus_peers.cc:597] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.025610 20844 leader_election.cc:304] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:40.027568 21000 raft_consensus.cc:2749] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.028193 20194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e9f15408e44661bc3aaf3d74fbba55" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:40.030083 20899 raft_consensus.cc:1275] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.034974 20192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:40.035799 20192 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 3: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:40.042006 20845 leader_election.cc:304] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.046033 21000 raft_consensus.cc:2749] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.049149 20845 leader_election.cc:304] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.057008 20855 raft_consensus.cc:493] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.057587 20855 raft_consensus.cc:515] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.057816 20895 raft_consensus.cc:3060] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:40.007133 20089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 229668us
I20260709 13:10:40.085165 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.086207 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96d6093e3af49e2b8fd8e162a7277a7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.073342 20855 leader_election.cc:290] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:40.091301 20894 raft_consensus.cc:1275] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:40.093248 20161 consensus_peers.cc:597] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.046154 20013 consensus_peers.cc:597] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.083045 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
W20260709 13:10:40.093958 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 47963.2us
I20260709 13:10:40.093120 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.095695 20042 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e49ff5dc8abb43e5af05c0ef94a90941 in current term 3: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
W20260709 13:10:40.095742 20013 consensus_peers.cc:597] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.096860 20013 consensus_peers.cc:597] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.097890 20013 consensus_peers.cc:597] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:40.099859 20013 consensus_peers.cc:597] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.101914 21026 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.103345 21026 consensus_queue.cc:1048] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:40.104226 20161 consensus_peers.cc:597] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.079589 20850 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.109134 20933 consensus_queue.cc:1048] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.109342 21005 consensus_queue.cc:1048] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:40.114653 20013 consensus_peers.cc:597] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.135577 20850 tablet_bootstrap.cc:492] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.137676 20850 ts_tablet_manager.cc:1403] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.556s	user 0.020s	sys 0.008s
W20260709 13:10:40.140025 20161 consensus_peers.cc:597] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.143360 20161 consensus_peers.cc:597] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.154454 20161 consensus_peers.cc:597] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.156976 20087 consensus_peers.cc:597] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.161875 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40d47d506d494e96cc28c3474730f7" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.163511 20850 raft_consensus.cc:359] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.169953 20850 raft_consensus.cc:740] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.177275 20850 consensus_queue.cc:260] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.202471 20850 ts_tablet_manager.cc:1434] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:10:40.206831 20850 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.209612 21000 raft_consensus.cc:2749] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.240952 20846 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
W20260709 13:10:40.242111 20846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 56680.5us
I20260709 13:10:40.251339 20855 raft_consensus.cc:2749] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.277034 20936 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.280388 20936 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
W20260709 13:10:40.329298 21041 log.cc:927] Time spent T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:40.296826 20846 leader_election.cc:304] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.344487 20855 raft_consensus.cc:2749] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.351662 20910 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.353847 20013 consensus_peers.cc:597] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.366510 20846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 77947.5us
I20260709 13:10:40.379065 20846 leader_election.cc:304] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.360731 20910 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.389546 20910 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:40.390002 20936 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:40.393180 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.394851 20042 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:40.396405 20855 raft_consensus.cc:2749] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.396975 20846 leader_election.cc:304] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:40.405023 20855 raft_consensus.cc:2749] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.403108 20089 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:40.405323 20911 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.408216 20911 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.410909 20911 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
W20260709 13:10:40.412964 20013 consensus_peers.cc:597] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.416353 21029 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.416901 21029 raft_consensus.cc:493] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.424746 21029 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.433890 20999 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.434689 20999 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.436687 20850 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.437525 20850 tablet_bootstrap.cc:492] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.437731 20999 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:40.438622 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b112290c0b6e4aa08967a0350cf4b215" is_pre_election: true
I20260709 13:10:40.437975 20850 ts_tablet_manager.cc:1403] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.013s
I20260709 13:10:40.425294 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2" is_pre_election: true
I20260709 13:10:40.447825 20198 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 3.
I20260709 13:10:40.450150 20846 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:40.427189 20893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:40.451977 20893 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 2.
I20260709 13:10:40.454301 21029 raft_consensus.cc:515] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.457427 21029 leader_election.cc:290] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:40.462081 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:40.464394 20042 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:40.472379 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 46363.7us
W20260709 13:10:40.483260 20013 consensus_peers.cc:597] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.485697 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" is_pre_election: true
I20260709 13:10:40.486413 20048 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 3.
I20260709 13:10:40.483713 20855 raft_consensus.cc:2749] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.489929 20119 raft_consensus.cc:2393] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 3: Already voted for candidate b112290c0b6e4aa08967a0350cf4b215 in this term.
W20260709 13:10:40.490950 20846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.2:35489, user_credentials={real_user=slave}} blocked reactor thread for 46243.3us
I20260709 13:10:40.491922 20846 leader_election.cc:304] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.491699 20850 raft_consensus.cc:359] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.492621 20850 raft_consensus.cc:740] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.493054 21000 raft_consensus.cc:2749] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.485368 20013 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:40.493327 20850 consensus_queue.cc:260] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.493932 20895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:40.493335 20846 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca
I20260709 13:10:40.495325 21003 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.495829 21003 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.496248 21003 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.496624 20846 leader_election.cc:304] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e49ff5dc8abb43e5af05c0ef94a90941; no voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:40.498139 20855 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.499524 21000 raft_consensus.cc:2749] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.505600 20163 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:40.506135 21003 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.506803 20999 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.507469 20855 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.507896 20999 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.511386 20999 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.511770 20850 ts_tablet_manager.cc:1434] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:10:40.512806 20850 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.509123 21003 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 4 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:40.522219 20999 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.522871 20895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:40.529897 20999 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 election: Requested vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:40.535130 20893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b4623789f6400a90a64898d6bc2bd8" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:40.536396 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:40.537401 20048 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 4: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:40.538125 21029 consensus_queue.cc:1048] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.545195 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:40.546157 20190 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af9bb61060db4eff9bfe238bbcbea9ca in current term 4: Already voted for candidate 9e3242b28df94215893da755f099a6e2 in this term.
I20260709 13:10:40.548619 20895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:40.549342 20895 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.551293 20042 raft_consensus.cc:2468] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 3.
I20260709 13:10:40.557029 20895 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af9bb61060db4eff9bfe238bbcbea9ca in term 4.
W20260709 13:10:40.558434 20013 leader_election.cc:343] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.569772 20013 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:40.570240 20850 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.571483 20089 leader_election.cc:304] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:40.572304 20934 raft_consensus.cc:2749] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.572474 21029 raft_consensus.cc:2804] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.574784 20013 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 9e3242b28df94215893da755f099a6e2
I20260709 13:10:40.575279 21029 raft_consensus.cc:697] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:40.576349 21029 consensus_queue.cc:237] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.576771 21001 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:40.577422 21001 raft_consensus.cc:697] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 LEADER]: Becoming Leader. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:40.573155 20850 tablet_bootstrap.cc:492] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.578714 20850 ts_tablet_manager.cc:1403] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.008s
I20260709 13:10:40.578301 21001 consensus_queue.cc:237] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.581468 20893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" is_pre_election: true
I20260709 13:10:40.582417 20893 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 4: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
I20260709 13:10:40.583985 20850 raft_consensus.cc:359] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.584811 20850 raft_consensus.cc:740] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.585518 20850 consensus_queue.cc:260] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.591347 20850 ts_tablet_manager.cc:1434] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:10:40.593384 20850 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.604962 20893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
I20260709 13:10:40.605970 20893 raft_consensus.cc:2393] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e3242b28df94215893da755f099a6e2 in current term 4: Already voted for candidate af9bb61060db4eff9bfe238bbcbea9ca in this term.
W20260709 13:10:40.611768 20161 consensus_peers.cc:597] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.613874 20981 heartbeater.cc:344] Connected to a master server at 127.11.78.62:45221
I20260709 13:10:40.614455 20981 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:40.615540 20981 heartbeater.cc:507] Master 127.11.78.62:45221 requested a full tablet report, sending...
I20260709 13:10:40.623875 20161 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:40.625634 20999 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.629463 19872 catalog_manager.cc:5697] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 3, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:40.653054 20087 leader_election.cc:343] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:40.655359 20087 consensus_peers.cc:597] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.656023 20087 leader_election.cc:343] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.660997 19871 catalog_manager.cc:5697] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca reported cstate change: term changed from 2 to 4, leader changed from e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1) to af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2). New cstate: current_term: 4 leader_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.685520 20850 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.687089 20850 tablet_bootstrap.cc:492] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.693423 20850 ts_tablet_manager.cc:1403] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.030s
W20260709 13:10:40.695519 20087 consensus_peers.cc:597] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.696573 20850 raft_consensus.cc:359] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.704167 19870 ts_manager.cc:194] Re-registered known tserver with Master: e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:40.697249 20850 raft_consensus.cc:740] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.708587 20891 raft_consensus.cc:3060] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.708988 20850 consensus_queue.cc:260] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:40.712255 20850 ts_tablet_manager.cc:1434] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:10:40.713229 20850 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.773914 20850 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.775556 20850 tablet_bootstrap.cc:492] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.776280 20850 ts_tablet_manager.cc:1403] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.007s
I20260709 13:10:40.782667 20850 raft_consensus.cc:359] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.783432 20850 raft_consensus.cc:740] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.784176 20850 consensus_queue.cc:260] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.786504 20850 ts_tablet_manager.cc:1434] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:40.787352 20850 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.804589 20850 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.805748 20850 tablet_bootstrap.cc:492] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.806502 20850 ts_tablet_manager.cc:1403] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:10:40.808096 19870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52434
I20260709 13:10:40.809379 20850 raft_consensus.cc:359] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.810029 20850 raft_consensus.cc:740] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.810722 20850 consensus_queue.cc:260] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.812775 20850 ts_tablet_manager.cc:1434] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:40.813465 20850 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.814424 20981 heartbeater.cc:499] Master 127.11.78.62:45221 was elected leader, sending a full tablet report...
I20260709 13:10:40.878316 20850 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.879849 20850 tablet_bootstrap.cc:492] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.880743 20850 ts_tablet_manager.cc:1403] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.040s
I20260709 13:10:40.885177 20850 raft_consensus.cc:359] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.886068 20850 raft_consensus.cc:740] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.886788 20850 consensus_queue.cc:260] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.889037 20850 ts_tablet_manager.cc:1434] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:40.889945 20850 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.918090 20850 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.919100 20850 tablet_bootstrap.cc:492] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.919785 20850 ts_tablet_manager.cc:1403] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.012s
I20260709 13:10:40.922482 20850 raft_consensus.cc:359] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.923502 20850 raft_consensus.cc:740] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.924551 20850 consensus_queue.cc:260] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:40.927099 20850 ts_tablet_manager.cc:1434] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:40.931643 20850 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:40.975786 20850 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.976847 20850 tablet_bootstrap.cc:492] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:40.977628 20850 ts_tablet_manager.cc:1403] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.003s
I20260709 13:10:40.980331 20850 raft_consensus.cc:359] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.981031 20850 raft_consensus.cc:740] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.981786 20850 consensus_queue.cc:260] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:40.984086 20850 ts_tablet_manager.cc:1434] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:40.984825 20891 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.995560 20850 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
W20260709 13:10:41.030156 20087 consensus_peers.cc:597] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.042407 20850 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.045024 20850 tablet_bootstrap.cc:492] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.046430 20850 ts_tablet_manager.cc:1403] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.001s
I20260709 13:10:41.051472 20850 raft_consensus.cc:359] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.052212 20850 raft_consensus.cc:740] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.053045 20850 consensus_queue.cc:260] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.058260 20850 ts_tablet_manager.cc:1434] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:41.059566 20850 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.074355 20198 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:41.076556 21049 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.077461 20850 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.078568 20850 tablet_bootstrap.cc:492] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.079221 20850 ts_tablet_manager.cc:1403] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:10:41.081619 20850 raft_consensus.cc:359] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.082129 20850 raft_consensus.cc:740] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.082731 20850 consensus_queue.cc:260] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.084986 20850 ts_tablet_manager.cc:1434] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.086439 20850 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.099421 20891 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Refusing update from remote peer af9bb61060db4eff9bfe238bbcbea9ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:41.101261 21049 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.103924 20850 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.104923 20850 tablet_bootstrap.cc:492] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.105599 20850 ts_tablet_manager.cc:1403] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:10:41.108183 20850 raft_consensus.cc:359] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.109091 20850 raft_consensus.cc:740] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.109849 20850 consensus_queue.cc:260] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.111855 20850 ts_tablet_manager.cc:1434] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:41.112612 20850 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.124608 20893 raft_consensus.cc:3060] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.189844 20850 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.190814 20850 tablet_bootstrap.cc:492] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.191679 20850 ts_tablet_manager.cc:1403] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.039s
I20260709 13:10:41.195354 20850 raft_consensus.cc:359] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.196259 20850 raft_consensus.cc:740] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.196960 20850 consensus_queue.cc:260] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.198860 20850 ts_tablet_manager.cc:1434] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:41.199571 20850 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.207739 20042 raft_consensus.cc:1275] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.210244 21010 consensus_queue.cc:1048] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.213382 20850 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.214879 20850 tablet_bootstrap.cc:492] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.216018 20850 ts_tablet_manager.cc:1403] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:10:41.219381 20850 raft_consensus.cc:359] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.220327 20850 raft_consensus.cc:740] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.221452 20850 consensus_queue.cc:260] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.224134 20850 ts_tablet_manager.cc:1434] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:41.225888 20850 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.265434 20850 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.266556 20850 tablet_bootstrap.cc:492] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.267397 20850 ts_tablet_manager.cc:1403] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.009s
I20260709 13:10:41.270500 20850 raft_consensus.cc:359] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.271312 20850 raft_consensus.cc:740] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.272171 20850 consensus_queue.cc:260] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.276057 20850 ts_tablet_manager.cc:1434] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:10:41.277458 20850 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.301517 20850 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.302997 20850 tablet_bootstrap.cc:492] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.303783 20850 ts_tablet_manager.cc:1403] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 13:10:41.306667 20850 raft_consensus.cc:359] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.307498 20850 raft_consensus.cc:740] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.308561 20850 consensus_queue.cc:260] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:41.311198 20850 ts_tablet_manager.cc:1434] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:41.313011 20850 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.337251 20850 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.338410 20850 tablet_bootstrap.cc:492] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.339246 20850 ts_tablet_manager.cc:1403] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 13:10:41.342178 20850 raft_consensus.cc:359] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.342895 20850 raft_consensus.cc:740] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.343683 20850 consensus_queue.cc:260] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.346099 20850 ts_tablet_manager.cc:1434] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:41.347450 20850 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.372670 20850 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.373565 20850 tablet_bootstrap.cc:492] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.374197 20850 ts_tablet_manager.cc:1403] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:10:41.376682 20850 raft_consensus.cc:359] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.377229 20850 raft_consensus.cc:740] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.377884 20850 consensus_queue.cc:260] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.380208 20850 ts_tablet_manager.cc:1434] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.382145 20850 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.400396 20850 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.401269 20850 tablet_bootstrap.cc:492] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.401899 20850 ts_tablet_manager.cc:1403] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:10:41.403704 20850 raft_consensus.cc:359] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.404273 20850 raft_consensus.cc:740] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.404822 20850 consensus_queue.cc:260] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.407065 20850 ts_tablet_manager.cc:1434] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:41.408281 20850 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.429865 20850 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.430991 20850 tablet_bootstrap.cc:492] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.431684 20850 ts_tablet_manager.cc:1403] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:10:41.434103 20850 raft_consensus.cc:359] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.434760 20850 raft_consensus.cc:740] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.435484 20850 consensus_queue.cc:260] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.438005 20850 ts_tablet_manager.cc:1434] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.438934 20850 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.456619 20850 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.458247 20850 tablet_bootstrap.cc:492] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.459056 20850 ts_tablet_manager.cc:1403] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:41.462182 20850 raft_consensus.cc:359] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.463024 20850 raft_consensus.cc:740] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.463845 20850 consensus_queue.cc:260] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.465785 20850 ts_tablet_manager.cc:1434] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:41.467033 20850 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.483891 20850 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.485136 20850 tablet_bootstrap.cc:492] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.485930 20850 ts_tablet_manager.cc:1403] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:10:41.488859 20850 raft_consensus.cc:359] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.489472 20850 raft_consensus.cc:740] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.490217 20850 consensus_queue.cc:260] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.492672 20850 ts_tablet_manager.cc:1434] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.494253 20850 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.511106 20891 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.512395 20850 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.513459 20850 tablet_bootstrap.cc:492] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.514087 20850 ts_tablet_manager.cc:1403] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:10:41.516966 20850 raft_consensus.cc:359] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.517619 20850 raft_consensus.cc:740] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.518256 20850 consensus_queue.cc:260] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:41.520253 20850 ts_tablet_manager.cc:1434] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.521080 20850 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap starting.
I20260709 13:10:41.553253 20850 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.554229 20850 tablet_bootstrap.cc:492] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Bootstrap complete.
I20260709 13:10:41.554914 20850 ts_tablet_manager.cc:1403] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.008s
I20260709 13:10:41.557727 20850 raft_consensus.cc:359] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.558393 20850 raft_consensus.cc:740] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.558987 20850 consensus_queue.cc:260] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:41.561136 20850 ts_tablet_manager.cc:1434] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.576857 20894 raft_consensus.cc:3060] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.788604 20894 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:46.034396 20162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 49174.7us
I20260709 13:10:49.251863 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.312467 20190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:49102
I20260709 13:10:49.313539 20190 raft_consensus.cc:606] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:49.318241 20190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:49102
I20260709 13:10:49.318956 20190 raft_consensus.cc:606] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:49.321695 20190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0e701ffff44788247b6796c34378b"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
mode: GRACEFUL
new_leader_uuid: "b112290c0b6e4aa08967a0350cf4b215"
 from {username='slave'} at 127.0.0.1:49102
I20260709 13:10:49.322753 20190 raft_consensus.cc:606] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Received request to transfer leadership to TS b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:49.327237 20190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:49102
I20260709 13:10:49.327775 20190 raft_consensus.cc:606] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:49.345966 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:49.346549 20042 raft_consensus.cc:606] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:49.348304 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:49.349989 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:49.377408 21128 raft_consensus.cc:993] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.378093 21128 raft_consensus.cc:1081] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.379873 20899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50602
I20260709 13:10:49.380453 20899 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.380820 20899 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.388312 20899 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.391052 20899 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:49.392235 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:49.392143 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c50d6c7464403bb75d1dbbcc2bcecd" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:49.393183 20042 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.393383 20190 raft_consensus.cc:3055] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.393867 20190 raft_consensus.cc:740] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:49.394999 20190 consensus_queue.cc:260] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.396719 20190 raft_consensus.cc:3060] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.401077 20042 raft_consensus.cc:2468] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.402638 20846 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:49.404170 20190 raft_consensus.cc:2468] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.404933 21130 raft_consensus.cc:2804] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.406469 21130 raft_consensus.cc:697] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:49.407611 21130 consensus_queue.cc:237] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.419126 19872 catalog_manager.cc:5697] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.479694 21122 raft_consensus.cc:993] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: : Instructing follower b112290c0b6e4aa08967a0350cf4b215 to start an election
I20260709 13:10:49.480283 21128 raft_consensus.cc:1081] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Signalling peer b112290c0b6e4aa08967a0350cf4b215 to start an election
I20260709 13:10:49.482131 20124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c0e701ffff44788247b6796c34378b"
dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
 from {username='slave'} at 127.0.0.1:52112
I20260709 13:10:49.482693 20124 raft_consensus.cc:493] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.483060 20124 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.490144 20124 raft_consensus.cc:515] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:49.492389 20124 leader_election.cc:290] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:49.493598 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:49.494277 20190 raft_consensus.cc:3055] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.494352 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0e701ffff44788247b6796c34378b" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:49.494978 20042 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.494738 20190 raft_consensus.cc:740] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:49.496217 20190 consensus_queue.cc:260] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:49.497629 20190 raft_consensus.cc:3060] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.502995 20042 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:49.504467 20089 leader_election.cc:304] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:49.505430 21125 raft_consensus.cc:2804] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.505718 20190 raft_consensus.cc:2468] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:49.506048 21125 raft_consensus.cc:697] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:49.507112 21125 consensus_queue.cc:237] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:49.518138 19872 catalog_manager.cc:5697] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 2, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.624624 21122 raft_consensus.cc:993] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.625193 21122 raft_consensus.cc:1081] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.627152 20899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50602
I20260709 13:10:49.627774 20899 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.628248 20899 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.635356 21138 raft_consensus.cc:993] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.635999 21138 raft_consensus.cc:1081] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.635564 20899 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.638816 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:49.639567 20899 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:49.641060 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:49.641743 20190 raft_consensus.cc:3055] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.642030 20190 raft_consensus.cc:740] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:49.640558 20902 raft_consensus.cc:493] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.643088 20190 consensus_queue.cc:260] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.644707 20190 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.645757 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e2711a72b24afe97685d3b68ca9465" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:49.646405 20042 raft_consensus.cc:3060] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.650177 20902 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.654521 20042 raft_consensus.cc:2468] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.656082 20846 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:49.656997 21130 raft_consensus.cc:2804] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.657543 21130 raft_consensus.cc:697] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:49.657639 20190 raft_consensus.cc:2468] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.658535 21130 consensus_queue.cc:237] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:49.658869 20902 raft_consensus.cc:515] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:49.661800 20902 leader_election.cc:290] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:49.662514 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:49.663280 20124 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.662518 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7feca13708f480e844a83b8c1828d1c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:49.664865 20042 raft_consensus.cc:3055] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.665230 20042 raft_consensus.cc:740] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:49.666160 20042 consensus_queue.cc:260] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:49.667416 20042 raft_consensus.cc:3060] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.671556 20124 raft_consensus.cc:2468] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.671169 19872 catalog_manager.cc:5697] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.672252 20042 raft_consensus.cc:2468] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.673128 20845 leader_election.cc:304] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:49.674057 21130 raft_consensus.cc:2804] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.674631 21130 raft_consensus.cc:697] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:49.675573 21130 consensus_queue.cc:237] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:49.695842 19872 catalog_manager.cc:5697] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.783607 21122 raft_consensus.cc:993] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.784317 21121 raft_consensus.cc:1081] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:49.786564 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50602
I20260709 13:10:49.787235 20902 raft_consensus.cc:493] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.787613 20902 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.794445 20902 raft_consensus.cc:515] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:49.796590 20902 leader_election.cc:290] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:49.797406 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:49.797823 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2716c2c5bb624410a935d9f5de12ea96" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:49.798065 20124 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.798521 20190 raft_consensus.cc:3055] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.798892 20190 raft_consensus.cc:740] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:49.799795 20190 consensus_queue.cc:260] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:49.801266 20190 raft_consensus.cc:3060] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.805052 20124 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.806320 20845 leader_election.cc:304] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:49.807469 21130 raft_consensus.cc:2804] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.807621 20190 raft_consensus.cc:2468] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:49.807974 21130 raft_consensus.cc:697] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:49.808975 21130 consensus_queue.cc:237] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:49.821802 19872 catalog_manager.cc:5697] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.899472 20190 raft_consensus.cc:1275] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.901008 21130 consensus_queue.cc:1048] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.915290 20042 raft_consensus.cc:1275] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.919888 21131 consensus_queue.cc:1048] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.027237 20042 raft_consensus.cc:1275] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.028643 21125 consensus_queue.cc:1048] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.044541 20190 raft_consensus.cc:1275] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.046164 21119 consensus_queue.cc:1048] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.058485 20042 raft_consensus.cc:1275] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.059978 21131 consensus_queue.cc:1048] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.066031 20190 raft_consensus.cc:1275] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.067840 21131 consensus_queue.cc:1048] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.087808 20043 raft_consensus.cc:1275] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.093446 21130 consensus_queue.cc:1048] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.115161 20124 raft_consensus.cc:1275] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.127038 21146 consensus_queue.cc:1048] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:50.245401 20014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 82875.4us
I20260709 13:10:50.262552 20198 raft_consensus.cc:1275] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.263949 21146 consensus_queue.cc:1048] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.278358 20124 raft_consensus.cc:1275] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.279877 21146 consensus_queue.cc:1048] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.351166 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.406548 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.448505 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f30be759394f459819ccb2558de4b3"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:50.449214 20048 raft_consensus.cc:606] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:50.452615 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "9e3242b28df94215893da755f099a6e2"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:50.453205 20042 raft_consensus.cc:606] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS 9e3242b28df94215893da755f099a6e2
I20260709 13:10:50.456728 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "b112290c0b6e4aa08967a0350cf4b215"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:50.457314 20042 raft_consensus.cc:606] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS b112290c0b6e4aa08967a0350cf4b215
I20260709 13:10:50.460233 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:50.460774 20042 raft_consensus.cc:606] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:50.464286 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:50.464761 20042 raft_consensus.cc:606] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:50.466033 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:50.468034 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:50.544202 21158 raft_consensus.cc:993] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.545054 21157 raft_consensus.cc:1081] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.547061 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:50.547854 20902 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.548254 20902 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.556286 20902 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.559791 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:50.560525 20042 raft_consensus.cc:3055] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:50.560863 20042 raft_consensus.cc:740] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:50.561344 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc59f19c65354a2882be0da8f9b88764" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:50.562103 20190 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.561754 20042 consensus_queue.cc:260] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.562719 20902 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 5 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:50.563072 20042 raft_consensus.cc:3060] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.577219 20042 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 5.
I20260709 13:10:50.577080 20190 raft_consensus.cc:2468] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 5.
I20260709 13:10:50.579766 20844 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:50.580762 21130 raft_consensus.cc:2804] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:50.581286 21130 raft_consensus.cc:697] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 5 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:50.582238 21130 consensus_queue.cc:237] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.590107 21123 raft_consensus.cc:993] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower b112290c0b6e4aa08967a0350cf4b215 to start an election
I20260709 13:10:50.590731 21123 raft_consensus.cc:1081] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer b112290c0b6e4aa08967a0350cf4b215 to start an election
I20260709 13:10:50.592996 20124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f"
dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
 from {username='slave'} at 127.0.0.1:52104
I20260709 13:10:50.593611 20124 raft_consensus.cc:493] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.594038 20124 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.600580 19871 catalog_manager.cc:5697] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 4 to 5, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 5 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.601579 21123 raft_consensus.cc:993] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.601660 20124 raft_consensus.cc:515] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.602437 21157 raft_consensus.cc:1081] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.604677 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:50.605407 20902 raft_consensus.cc:493] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.605444 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:50.608568 20042 raft_consensus.cc:3055] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.608883 20042 raft_consensus.cc:740] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:50.609634 20042 consensus_queue.cc:260] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.607555 20124 leader_election.cc:290] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:50.607740 20190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e25a4e35244733b59abb26b98e197f" candidate_uuid: "b112290c0b6e4aa08967a0350cf4b215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:50.611989 20190 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.610777 20902 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.610821 20042 raft_consensus.cc:3060] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.618831 20190 raft_consensus.cc:2468] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:50.622465 20087 leader_election.cc:304] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, b112290c0b6e4aa08967a0350cf4b215; no voters: 
I20260709 13:10:50.622854 20042 raft_consensus.cc:2468] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b112290c0b6e4aa08967a0350cf4b215 in term 2.
I20260709 13:10:50.623612 21151 raft_consensus.cc:2804] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.624172 21151 raft_consensus.cc:697] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Becoming Leader. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:50.625147 21151 consensus_queue.cc:237] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.627377 20902 raft_consensus.cc:515] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:50.630152 20902 leader_election.cc:290] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:50.630875 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:50.631620 20042 raft_consensus.cc:3055] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.631959 20042 raft_consensus.cc:740] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:50.632248 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec431714e0b74545b9e734e354354f2c" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:50.632913 20124 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.633092 20042 consensus_queue.cc:260] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:50.634639 20042 raft_consensus.cc:3060] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.638304 19871 catalog_manager.cc:5697] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b112290c0b6e4aa08967a0350cf4b215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.641721 20124 raft_consensus.cc:2468] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:50.643039 20845 leader_election.cc:304] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:50.643172 20042 raft_consensus.cc:2468] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:50.644106 21130 raft_consensus.cc:2804] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.644711 21130 raft_consensus.cc:697] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:50.645493 21130 consensus_queue.cc:237] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:50.656701 19871 catalog_manager.cc:5697] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.694854 21157 raft_consensus.cc:993] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.696208 21123 raft_consensus.cc:1081] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:50.698338 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f30be759394f459819ccb2558de4b3"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:50.699070 20902 raft_consensus.cc:493] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.699529 20902 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.705783 20902 raft_consensus.cc:515] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.708071 20902 leader_election.cc:290] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:50.708256 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:50.708999 20198 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.709236 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f30be759394f459819ccb2558de4b3" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:50.709867 20042 raft_consensus.cc:3055] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.710186 20042 raft_consensus.cc:740] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:50.710947 20042 consensus_queue.cc:260] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.712267 20042 raft_consensus.cc:3060] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.717233 20198 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:50.718710 20844 leader_election.cc:304] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:50.719064 20042 raft_consensus.cc:2468] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:50.719682 21130 raft_consensus.cc:2804] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.720410 21130 raft_consensus.cc:697] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:50.721405 21130 consensus_queue.cc:237] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:50.732728 19871 catalog_manager.cc:5697] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 2 to 3, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.909405 21123 raft_consensus.cc:993] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower 9e3242b28df94215893da755f099a6e2 to start an election
I20260709 13:10:50.909947 21123 raft_consensus.cc:1081] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer 9e3242b28df94215893da755f099a6e2 to start an election
I20260709 13:10:50.911664 20198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
 from {username='slave'} at 127.0.0.1:38530
I20260709 13:10:50.912366 20198 raft_consensus.cc:493] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.912743 20198 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.921468 20198 raft_consensus.cc:515] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.925099 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:50.925812 20042 raft_consensus.cc:3055] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.926182 20042 raft_consensus.cc:740] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:50.926213 20198 leader_election.cc:290] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:50.927117 20042 consensus_queue.cc:260] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.928681 20042 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.929543 20124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a1f4669e774779972fe3fd39706aef" candidate_uuid: "9e3242b28df94215893da755f099a6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:50.930282 20124 raft_consensus.cc:3060] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.937299 20042 raft_consensus.cc:2468] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
I20260709 13:10:50.939869 20163 leader_election.cc:304] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, af9bb61060db4eff9bfe238bbcbea9ca; no voters: 
I20260709 13:10:50.940795 21128 raft_consensus.cc:2804] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.941641 21128 raft_consensus.cc:697] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Becoming Leader. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:50.942668 21128 consensus_queue.cc:237] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } }
I20260709 13:10:50.945809 20124 raft_consensus.cc:2468] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e3242b28df94215893da755f099a6e2 in term 2.
I20260709 13:10:50.961476 19871 catalog_manager.cc:5697] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to 9e3242b28df94215893da755f099a6e2 (127.11.78.4). New cstate: current_term: 2 leader_uuid: "9e3242b28df94215893da755f099a6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.992806 20198 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:50.994310 21146 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:51.005739 20042 raft_consensus.cc:1275] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 5 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:51.012387 21131 consensus_queue.cc:1048] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:51.049573 20124 raft_consensus.cc:1275] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.051200 21131 consensus_queue.cc:1048] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.067191 20048 raft_consensus.cc:1275] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.069851 21130 consensus_queue.cc:1048] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.137643 20198 raft_consensus.cc:1275] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.139284 21119 consensus_queue.cc:1048] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.153041 20048 raft_consensus.cc:1275] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer b112290c0b6e4aa08967a0350cf4b215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.155194 21119 consensus_queue.cc:1048] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.180191 20042 raft_consensus.cc:1275] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:51.181875 21130 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.195067 20198 raft_consensus.cc:1275] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:51.196746 21131 consensus_queue.cc:1048] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.398595 20048 raft_consensus.cc:1275] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer 9e3242b28df94215893da755f099a6e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.400111 21128 consensus_queue.cc:1048] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.411854 20119 raft_consensus.cc:1275] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer 9e3242b28df94215893da755f099a6e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.422204 21184 consensus_queue.cc:1048] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:10:51.470288 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.516737 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.564607 20197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47"
dest_uuid: "9e3242b28df94215893da755f099a6e2"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:49102
I20260709 13:10:51.565416 20197 raft_consensus.cc:606] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.568747 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f3013974914421182c82eaf339e22cc"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:51.569681 20048 raft_consensus.cc:606] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.573153 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:51.573825 20048 raft_consensus.cc:606] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.578563 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:51.579291 20048 raft_consensus.cc:606] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.581960 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd2390af31254060951179e822c53383"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:51.582527 20048 raft_consensus.cc:606] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.613770 20119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552"
dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:52542
I20260709 13:10:51.614425 20119 raft_consensus.cc:606] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:51.615939 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:51.617619 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:51.664422 21123 raft_consensus.cc:993] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.665068 21157 raft_consensus.cc:1081] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.666929 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd2390af31254060951179e822c53383"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:51.667590 20902 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.667984 20902 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.674628 20902 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.676582 20902 leader_election.cc:290] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:51.677495 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:51.677939 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2390af31254060951179e822c53383" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:51.678238 20197 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.678643 20048 raft_consensus.cc:3055] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.678954 20048 raft_consensus.cc:740] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:51.679721 20048 consensus_queue.cc:260] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.680805 20048 raft_consensus.cc:3060] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.686370 20197 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:51.687881 20048 raft_consensus.cc:2468] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:51.688462 20844 leader_election.cc:304] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:51.689817 21146 raft_consensus.cc:2804] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:51.690335 21146 raft_consensus.cc:697] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:51.691259 21146 consensus_queue.cc:237] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.704509 19870 catalog_manager.cc:5697] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 2 to 3, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.800385 21179 raft_consensus.cc:993] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.801009 21119 raft_consensus.cc:1081] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.802619 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50612
I20260709 13:10:51.803112 20902 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.803409 20902 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.808456 20902 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.809974 20902 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:51.811128 20197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:51.811497 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd1831330c34053b8dc72271c19c552" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:51.812103 20119 raft_consensus.cc:3055] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.812410 20119 raft_consensus.cc:740] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b112290c0b6e4aa08967a0350cf4b215, State: Running, Role: LEADER
I20260709 13:10:51.812772 20197 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.813238 20119 consensus_queue.cc:260] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.814386 20119 raft_consensus.cc:3060] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.822106 20197 raft_consensus.cc:2468] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:51.823004 20198 raft_consensus.cc:1240] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Rejecting Update request from peer b112290c0b6e4aa08967a0350cf4b215 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:51.823491 20844 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:51.823915 20119 raft_consensus.cc:2468] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:51.825089 21146 raft_consensus.cc:2804] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:51.825611 21146 raft_consensus.cc:697] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:51.826383 21146 consensus_queue.cc:237] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.835850 19870 catalog_manager.cc:5697] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.888592 21157 raft_consensus.cc:993] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.889168 21123 raft_consensus.cc:1081] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.890816 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f3013974914421182c82eaf339e22cc"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:51.891404 20902 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.891706 20902 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.897282 20902 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.898730 20902 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Requested vote from peers 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
I20260709 13:10:51.899760 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:51.900125 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3013974914421182c82eaf339e22cc" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:51.900586 20198 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.900658 20048 raft_consensus.cc:3055] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.901098 20048 raft_consensus.cc:740] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:51.901999 20048 consensus_queue.cc:260] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.903337 20048 raft_consensus.cc:3060] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.908639 20198 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:51.909950 20844 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e3242b28df94215893da755f099a6e2, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:51.910883 21146 raft_consensus.cc:2804] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:51.910987 20048 raft_consensus.cc:2468] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:51.911558 21146 raft_consensus.cc:697] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:51.913381 21146 consensus_queue.cc:237] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:51.923941 19870 catalog_manager.cc:5697] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 2 to 3, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.950321 21157 raft_consensus.cc:993] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.950881 21157 raft_consensus.cc:1081] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.952940 20902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:51.953439 20902 raft_consensus.cc:493] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.953805 20902 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.961714 20902 raft_consensus.cc:515] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.963874 20902 leader_election.cc:290] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:51.965158 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:51.965835 20048 raft_consensus.cc:3055] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.965730 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965320aa73c0442fab090a329cb3f3d4" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:51.966409 20048 raft_consensus.cc:740] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:51.966718 20119 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.967298 20048 consensus_queue.cc:260] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.968713 20048 raft_consensus.cc:3060] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.969168 21184 raft_consensus.cc:993] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.969745 21184 raft_consensus.cc:1081] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:51.971870 20893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50602
I20260709 13:10:51.972448 20893 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.972828 20893 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.974647 20119 raft_consensus.cc:2468] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:51.976197 20048 raft_consensus.cc:2468] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:51.976251 20845 leader_election.cc:304] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:51.977413 21146 raft_consensus.cc:2804] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:51.977960 21146 raft_consensus.cc:697] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:51.978968 21146 consensus_queue.cc:237] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.983261 20893 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.986945 20893 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Requested vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), 9e3242b28df94215893da755f099a6e2 (127.11.78.4:46123)
I20260709 13:10:51.988379 20198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e3242b28df94215893da755f099a6e2"
I20260709 13:10:51.989135 20198 raft_consensus.cc:3055] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.989468 20198 raft_consensus.cc:740] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e3242b28df94215893da755f099a6e2, State: Running, Role: LEADER
I20260709 13:10:51.990227 20198 consensus_queue.cc:260] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:51.991573 20198 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.991771 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159ac08d09bd48f1a2d00965fb182e47" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:51.992586 20119 raft_consensus.cc:3060] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.000929 20119 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
I20260709 13:10:52.002238 20845 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:52.048602 19871 catalog_manager.cc:5697] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.049897 21131 raft_consensus.cc:2804] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.050531 21131 raft_consensus.cc:697] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:52.051584 21131 consensus_queue.cc:237] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:52.053119 20198 raft_consensus.cc:2468] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 3.
W20260709 13:10:52.061959 20845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 59823us
I20260709 13:10:52.151867 20198 raft_consensus.cc:1275] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:52.155800 20014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:45445, user_credentials={real_user=slave}} blocked reactor thread for 65618.3us
W20260709 13:10:52.156785 20161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:42127, user_credentials={real_user=slave}} blocked reactor thread for 71559us
I20260709 13:10:52.157420 21131 consensus_queue.cc:1048] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:10:52.165747 20013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.4:46123, user_credentials={real_user=slave}} blocked reactor thread for 82001.3us
I20260709 13:10:52.177599 19871 catalog_manager.cc:5697] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 2 to 3, leader changed from 9e3242b28df94215893da755f099a6e2 (127.11.78.4) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.179535 21123 raft_consensus.cc:993] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:52.182536 21123 raft_consensus.cc:1081] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:52.185163 20893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:52.185802 20893 raft_consensus.cc:493] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.186206 20893 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.199302 20893 raft_consensus.cc:515] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:52.201650 20893 leader_election.cc:290] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:52.202749 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:52.203462 20119 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.203277 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fbcef945e3478d827ecd923ce8d57f" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:52.204380 20048 raft_consensus.cc:3055] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:52.204705 20048 raft_consensus.cc:740] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:52.205458 20048 consensus_queue.cc:260] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:52.207648 20048 raft_consensus.cc:3060] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.211570 20042 raft_consensus.cc:1275] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.214731 21130 consensus_queue.cc:1048] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.218955 20048 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:52.220535 20846 leader_election.cc:304] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:52.221475 21130 raft_consensus.cc:2804] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:52.222239 21130 raft_consensus.cc:697] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:52.222625 20195 raft_consensus.cc:1275] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.224555 21205 consensus_queue.cc:1048] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.225844 21130 consensus_queue.cc:237] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:52.239156 20119 raft_consensus.cc:2468] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:52.254261 20119 raft_consensus.cc:1275] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.256666 21130 consensus_queue.cc:1048] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.271737 19870 catalog_manager.cc:5697] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.371038 20195 raft_consensus.cc:1275] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.372359 21130 consensus_queue.cc:1048] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.382689 20048 raft_consensus.cc:1275] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.384130 21130 consensus_queue.cc:1048] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.392997 20119 raft_consensus.cc:1275] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.394687 21131 consensus_queue.cc:1048] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:52.425902 20048 raft_consensus.cc:1275] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.428475 21146 consensus_queue.cc:1048] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:52.486896 20197 raft_consensus.cc:1275] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.488422 21131 consensus_queue.cc:1048] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.499522 20119 raft_consensus.cc:1275] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.501307 21146 consensus_queue.cc:1048] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.618567 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:52.654845 20119 raft_consensus.cc:1275] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.657346 21202 consensus_queue.cc:1048] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.663362 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:52.674343 20042 raft_consensus.cc:1275] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:52.679801 21146 consensus_queue.cc:1048] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.739166 20048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74"
dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
mode: GRACEFUL
new_leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:10:52.740037 20048 raft_consensus.cc:606] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Received request to transfer leadership to TS e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:52.741766 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:52.743945 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:53.146785 21123 raft_consensus.cc:993] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: : Instructing follower e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:53.147251 21123 raft_consensus.cc:1081] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Signalling peer e49ff5dc8abb43e5af05c0ef94a90941 to start an election
I20260709 13:10:53.149132 20893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74"
dest_uuid: "e49ff5dc8abb43e5af05c0ef94a90941"
 from {username='slave'} at 127.0.0.1:50586
I20260709 13:10:53.149833 20893 raft_consensus.cc:493] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.150239 20893 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.158517 20893 raft_consensus.cc:515] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:53.160933 20893 leader_election.cc:290] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Requested vote from peers af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489), b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445)
I20260709 13:10:53.162451 20119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b112290c0b6e4aa08967a0350cf4b215"
I20260709 13:10:53.162629 20048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d7d14edd7844d3ac28ac51635a1a74" candidate_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af9bb61060db4eff9bfe238bbcbea9ca"
I20260709 13:10:53.163208 20119 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.163410 20048 raft_consensus.cc:3055] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.163911 20048 raft_consensus.cc:740] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af9bb61060db4eff9bfe238bbcbea9ca, State: Running, Role: LEADER
I20260709 13:10:53.164633 20048 consensus_queue.cc:260] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:53.165851 20048 raft_consensus.cc:3060] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.171710 20119 raft_consensus.cc:2468] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:53.175941 20048 raft_consensus.cc:2468] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49ff5dc8abb43e5af05c0ef94a90941 in term 2.
I20260709 13:10:53.174830 20845 leader_election.cc:304] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941; no voters: 
I20260709 13:10:53.180204 21131 raft_consensus.cc:2804] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.181159 21131 raft_consensus.cc:697] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Becoming Leader. State: Replica: e49ff5dc8abb43e5af05c0ef94a90941, State: Running, Role: LEADER
I20260709 13:10:53.182093 21131 consensus_queue.cc:237] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } }
I20260709 13:10:53.193708 19870 catalog_manager.cc:5697] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 reported cstate change: term changed from 1 to 2, leader changed from af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2) to e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.656440 20124 raft_consensus.cc:1275] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:53.658748 21131 consensus_queue.cc:1048] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.680258 20042 raft_consensus.cc:1275] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Refusing update from remote peer e49ff5dc8abb43e5af05c0ef94a90941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:53.684996 21131 consensus_queue.cc:1048] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.745070 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:53.786700 11576 tablet_server.cc:179] TabletServer@127.11.78.1:42127 shutting down...
W20260709 13:10:53.796425 20087 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 196 similar messages]
W20260709 13:10:53.800439 20087 consensus_peers.cc:597] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:53.807904 20087 consensus_peers.cc:597] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:53.826515 20087 consensus_peers.cc:597] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.839397 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:53.840353 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.841338 11576 raft_consensus.cc:2243] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.841965 11576 raft_consensus.cc:2272] T f7888f5f6364427b9a0d647763feb39f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.844892 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.845492 11576 raft_consensus.cc:2243] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.846237 11576 raft_consensus.cc:2272] T 05e2711a72b24afe97685d3b68ca9465 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.848954 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.849601 11576 raft_consensus.cc:2243] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.850095 11576 raft_consensus.cc:2272] T efe4e3a9b96d4af1ad4db55958206dd9 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.851341 20087 consensus_peers.cc:597] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.852382 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.853168 11576 raft_consensus.cc:2243] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.853950 11576 raft_consensus.cc:2272] T 2716c2c5bb624410a935d9f5de12ea96 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.856691 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.857577 11576 raft_consensus.cc:2243] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.859100 11576 raft_consensus.cc:2272] T 1da0f3e9b2604f71afd4792bd89d38ca P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.862811 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.863663 11576 raft_consensus.cc:2243] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.864190 11576 raft_consensus.cc:2272] T 580e9dc6e4c24718873d74c4398812dd P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.867177 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.867803 11576 raft_consensus.cc:2243] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.868736 11576 raft_consensus.cc:2272] T ec431714e0b74545b9e734e354354f2c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.871320 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.872088 11576 raft_consensus.cc:2243] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.873001 11576 raft_consensus.cc:2272] T 965320aa73c0442fab090a329cb3f3d4 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.873093 20013 consensus_peers.cc:597] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.875582 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.876300 11576 raft_consensus.cc:2243] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.877091 11576 raft_consensus.cc:2272] T cd2390af31254060951179e822c53383 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.879396 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.880100 11576 raft_consensus.cc:2243] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.880569 11576 raft_consensus.cc:2272] T 163d17ff6a2c4c4795e2cdbe07cd15dc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.882959 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.883571 11576 raft_consensus.cc:2243] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.883996 11576 raft_consensus.cc:2272] T a5d2c82b22aa4ac9802e9161cc6c6c23 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.886020 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.886595 11576 raft_consensus.cc:2243] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.886996 11576 raft_consensus.cc:2272] T 882ba423a74c496d8a4d5dba170a5748 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.889394 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.890197 11576 raft_consensus.cc:2243] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.890663 11576 raft_consensus.cc:2272] T f34249aa09174ce3b90e9cbf1bfebb62 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.893563 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.894273 11576 raft_consensus.cc:2243] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.895126 11576 raft_consensus.cc:2272] T 8f3013974914421182c82eaf339e22cc P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.897045 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.897511 11576 raft_consensus.cc:2243] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.897967 11576 raft_consensus.cc:2272] T 049e74a7f6364769958bf3682e89a7da P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.900323 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.901079 11576 raft_consensus.cc:2243] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.902099 11576 raft_consensus.cc:2272] T a5d7d14edd7844d3ac28ac51635a1a74 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.904999 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.905609 11576 raft_consensus.cc:2243] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.906090 11576 raft_consensus.cc:2272] T 96b550827c3d4286a9fa6f1a30de0033 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.908243 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.908849 11576 raft_consensus.cc:2243] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.909248 11576 raft_consensus.cc:2272] T dfc07241f7bb4356a03e4bb862681665 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.911432 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.911975 11576 raft_consensus.cc:2243] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.912489 11576 raft_consensus.cc:2272] T ca40d47d506d494e96cc28c3474730f7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.914683 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.915217 11576 raft_consensus.cc:2243] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.915653 11576 raft_consensus.cc:2272] T c021951a7255405393cb29fc326c0791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.917637 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.918174 11576 raft_consensus.cc:2243] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.919020 11576 raft_consensus.cc:2272] T 159ac08d09bd48f1a2d00965fb182e47 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.921053 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.921617 11576 raft_consensus.cc:2243] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.922055 11576 raft_consensus.cc:2272] T 0b3ac05b81ea4c3c83799ea30724a707 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.924401 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.925055 11576 raft_consensus.cc:2243] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.925834 11576 raft_consensus.cc:2272] T 90fbcef945e3478d827ecd923ce8d57f P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.928303 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.928936 11576 raft_consensus.cc:2243] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.929411 11576 raft_consensus.cc:2272] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.932145 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.932778 11576 raft_consensus.cc:2243] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.933295 11576 raft_consensus.cc:2272] T dae08a3fb8914d8eb858aea9fd39e4d8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.935557 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.936259 11576 raft_consensus.cc:2243] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.936815 11576 raft_consensus.cc:2272] T b95d568843284ddda0eda68734cdd590 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.939792 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.940439 11576 raft_consensus.cc:2243] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.940969 11576 raft_consensus.cc:2272] T 2f32b127d2f647c8b07a07d61f643bdf P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.943843 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.944631 11576 raft_consensus.cc:2243] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:53.944679 20013 consensus_peers.cc:597] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.945255 11576 raft_consensus.cc:2272] T f0b4623789f6400a90a64898d6bc2bd8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.948560 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.949331 11576 raft_consensus.cc:2243] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.949805 11576 raft_consensus.cc:2272] T 96254c9e0b6a4f8e828190935026cf4b P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.952267 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.952886 11576 raft_consensus.cc:2243] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.953320 11576 raft_consensus.cc:2272] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.955693 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.956375 11576 raft_consensus.cc:2243] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.956867 11576 raft_consensus.cc:2272] T e96d6093e3af49e2b8fd8e162a7277a7 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.957535 20013 consensus_peers.cc:597] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.959208 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.959847 11576 raft_consensus.cc:2243] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.960336 11576 raft_consensus.cc:2272] T 1ca23f3e5d7849b78fc9a0c03c170791 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.962584 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.963148 11576 raft_consensus.cc:2243] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.963575 11576 raft_consensus.cc:2272] T c908cda42a1b4577845ec65410d29f6f P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.966369 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.967031 11576 raft_consensus.cc:2243] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.967871 11576 raft_consensus.cc:2272] T 50c50d6c7464403bb75d1dbbcc2bcecd P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.970295 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.970988 11576 raft_consensus.cc:2243] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.971479 11576 raft_consensus.cc:2272] T d0e9f15408e44661bc3aaf3d74fbba55 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.973964 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.974464 11576 raft_consensus.cc:2243] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.974941 11576 raft_consensus.cc:2272] T 5716bb9307734152b1901998813a44eb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.977444 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.978291 11576 raft_consensus.cc:2243] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.979070 11576 raft_consensus.cc:2272] T 63ac09267db943769573413621ec2923 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.980317 20161 consensus_peers.cc:597] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.981460 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.982033 11576 raft_consensus.cc:2243] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.982530 11576 raft_consensus.cc:2272] T 8821119294dc4787ae9b90b24070a2fc P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.985466 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.986294 11576 raft_consensus.cc:2243] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:53.986982 20087 consensus_peers.cc:597] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.987236 11576 raft_consensus.cc:2272] T fcd1831330c34053b8dc72271c19c552 P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.989521 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.990005 11576 raft_consensus.cc:2243] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.990782 11576 raft_consensus.cc:2272] T d7feca13708f480e844a83b8c1828d1c P e49ff5dc8abb43e5af05c0ef94a90941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.992643 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.993393 11576 raft_consensus.cc:2243] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.993806 11576 raft_consensus.cc:2272] T a213a8358e61477cac2ad10e043ba2bb P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.996392 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:53.996948 11576 raft_consensus.cc:2243] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.997387 11576 raft_consensus.cc:2272] T d813cf323225419f955c3efdae688a83 P e49ff5dc8abb43e5af05c0ef94a90941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.999960 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:54.000685 11576 raft_consensus.cc:2243] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.001647 11576 raft_consensus.cc:2272] T 15f30be759394f459819ccb2558de4b3 P e49ff5dc8abb43e5af05c0ef94a90941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.004536 11576 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:54.004973 20013 consensus_peers.cc:597] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.005223 11576 raft_consensus.cc:2243] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.006306 11576 raft_consensus.cc:2272] T dc59f19c65354a2882be0da8f9b88764 P e49ff5dc8abb43e5af05c0ef94a90941 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.008831 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:54.009322 11576 raft_consensus.cc:2243] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.009835 11576 raft_consensus.cc:2272] T c577376c4e4f414c9e6b3b717c9dea3c P e49ff5dc8abb43e5af05c0ef94a90941 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.019423 20013 consensus_peers.cc:597] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.022781 20013 consensus_peers.cc:597] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.033991 20161 consensus_peers.cc:597] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.061797 20161 consensus_peers.cc:597] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.084676 11576 tablet_server.cc:196] TabletServer@127.11.78.1:42127 shutdown complete.
W20260709 13:10:54.103750 20013 consensus_peers.cc:597] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.130909 20013 consensus_peers.cc:597] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.134403 20161 consensus_peers.cc:597] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.134953 20161 consensus_peers.cc:597] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.137661 20161 consensus_peers.cc:597] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.142827 20013 consensus_peers.cc:597] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.144798 20161 consensus_peers.cc:597] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.160132 20161 consensus_peers.cc:597] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.180964 20087 consensus_peers.cc:597] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.186983 20161 consensus_peers.cc:597] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.188160 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:10:54.211709 20163 consensus_peers.cc:597] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.221344 20013 consensus_peers.cc:597] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.232856 20087 consensus_peers.cc:597] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.233659 20087 consensus_peers.cc:597] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.264690 20089 consensus_peers.cc:597] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.266047 20013 consensus_peers.cc:597] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.279112 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:54.282195 11576 tablet_replica.cc:333] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.283205 11576 raft_consensus.cc:2243] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.284365 11576 raft_consensus.cc:2272] T a5d2c82b22aa4ac9802e9161cc6c6c23 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.287444 11576 tablet_replica.cc:333] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
W20260709 13:10:54.288196 20161 consensus_peers.cc:597] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.288407 11576 raft_consensus.cc:2243] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.289580 11576 raft_consensus.cc:2272] T 5716bb9307734152b1901998813a44eb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.290040 20089 consensus_peers.cc:597] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.292451 11576 tablet_replica.cc:333] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.293282 11576 raft_consensus.cc:2243] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.293761 11576 raft_consensus.cc:2272] T 1afe0f7aca434ac08f951c456f44801d P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.296128 11576 tablet_replica.cc:333] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
W20260709 13:10:54.296783 20089 consensus_peers.cc:597] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.296993 11576 raft_consensus.cc:2243] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.297920 11576 raft_consensus.cc:2272] T 63ac09267db943769573413621ec2923 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.299894 11576 tablet_replica.cc:333] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.300550 11576 raft_consensus.cc:2243] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.300976 11576 raft_consensus.cc:2272] T 50c50d6c7464403bb75d1dbbcc2bcecd P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.302863 11576 tablet_replica.cc:333] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.303443 11576 raft_consensus.cc:2243] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.304272 11576 raft_consensus.cc:2272] T e123c09eb9fb4796a206bad4baa67b05 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.306274 11576 tablet_replica.cc:333] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.306947 11576 raft_consensus.cc:2243] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.307374 11576 raft_consensus.cc:2272] T d3e25a4e35244733b59abb26b98e197f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.309919 11576 tablet_replica.cc:333] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.310684 11576 raft_consensus.cc:2243] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.311115 11576 raft_consensus.cc:2272] T a5d7d14edd7844d3ac28ac51635a1a74 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.311703 20013 consensus_peers.cc:597] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.314450 11576 tablet_replica.cc:333] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.315240 11576 raft_consensus.cc:2243] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.315752 11576 raft_consensus.cc:2272] T dc59f19c65354a2882be0da8f9b88764 P af9bb61060db4eff9bfe238bbcbea9ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.318687 11576 tablet_replica.cc:333] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.319430 11576 raft_consensus.cc:2243] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.320515 11576 raft_consensus.cc:2272] T adb0269325f84a20b8bbf06dba278dcb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.320673 20089 consensus_peers.cc:597] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.322966 11576 tablet_replica.cc:333] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.323652 11576 raft_consensus.cc:2243] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.324139 11576 raft_consensus.cc:2272] T c908cda42a1b4577845ec65410d29f6f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.326046 11576 tablet_replica.cc:333] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.326617 11576 raft_consensus.cc:2243] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.327059 11576 raft_consensus.cc:2272] T 5bac48363d4d4312b0a4ce40551b6a6c P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.329118 11576 tablet_replica.cc:333] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.329689 11576 raft_consensus.cc:2243] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.330108 11576 raft_consensus.cc:2272] T ec431714e0b74545b9e734e354354f2c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.332417 11576 tablet_replica.cc:333] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.333015 11576 raft_consensus.cc:2243] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.333998 11576 raft_consensus.cc:2272] T e96d6093e3af49e2b8fd8e162a7277a7 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.336558 11576 tablet_replica.cc:333] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.337092 11576 raft_consensus.cc:2243] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.337450 11576 raft_consensus.cc:2272] T 580e9dc6e4c24718873d74c4398812dd P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.339478 11576 tablet_replica.cc:333] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.340019 11576 raft_consensus.cc:2243] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.340480 11576 raft_consensus.cc:2272] T 43c0e701ffff44788247b6796c34378b P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.342582 11576 tablet_replica.cc:333] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.343315 11576 raft_consensus.cc:2243] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.343807 11576 raft_consensus.cc:2272] T f7888f5f6364427b9a0d647763feb39f P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.346351 11576 tablet_replica.cc:333] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.347059 11576 raft_consensus.cc:2243] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:54.347200 20161 consensus_peers.cc:597] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 -> Peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Couldn't send request to peer e49ff5dc8abb43e5af05c0ef94a90941. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.347635 11576 raft_consensus.cc:2272] T 05e2711a72b24afe97685d3b68ca9465 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.349967 11576 tablet_replica.cc:333] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.350807 11576 raft_consensus.cc:2243] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.351349 11576 raft_consensus.cc:2272] T 928d42c4bfd54d59bdda6b75cfd037db P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.353938 11576 tablet_replica.cc:333] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.354632 11576 raft_consensus.cc:2243] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.354991 11576 raft_consensus.cc:2272] T 90fbcef945e3478d827ecd923ce8d57f P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.356768 11576 tablet_replica.cc:333] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.357266 11576 raft_consensus.cc:2243] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.358028 11576 raft_consensus.cc:2272] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.359989 11576 tablet_replica.cc:333] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.360594 11576 raft_consensus.cc:2243] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.361003 11576 raft_consensus.cc:2272] T 69a1f4669e774779972fe3fd39706aef P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.362793 11576 tablet_replica.cc:333] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.363510 11576 raft_consensus.cc:2243] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.363994 11576 raft_consensus.cc:2272] T 1da0f3e9b2604f71afd4792bd89d38ca P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.366027 11576 tablet_replica.cc:333] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.366562 11576 raft_consensus.cc:2243] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.367344 11576 raft_consensus.cc:2272] T ca40d47d506d494e96cc28c3474730f7 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.369258 11576 tablet_replica.cc:333] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.369823 11576 raft_consensus.cc:2243] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.370782 11576 raft_consensus.cc:2272] T efe4e3a9b96d4af1ad4db55958206dd9 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.373114 11576 tablet_replica.cc:333] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.373836 11576 raft_consensus.cc:2243] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.374336 11576 raft_consensus.cc:2272] T d7feca13708f480e844a83b8c1828d1c P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.377046 11576 tablet_replica.cc:333] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.377801 11576 raft_consensus.cc:2243] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:54.378448 20163 consensus_peers.cc:597] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.378894 11576 raft_consensus.cc:2272] T a213a8358e61477cac2ad10e043ba2bb P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.382028 11576 tablet_replica.cc:333] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.382768 11576 raft_consensus.cc:2243] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.383297 11576 raft_consensus.cc:2272] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.384995 20089 consensus_peers.cc:597] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.385882 11576 tablet_replica.cc:333] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.386530 11576 raft_consensus.cc:2243] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.386960 11576 raft_consensus.cc:2272] T 77cd3c2ff5d348dd9b5baa2b04163b97 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.389443 11576 tablet_replica.cc:333] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.390041 11576 raft_consensus.cc:2243] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.390581 11576 raft_consensus.cc:2272] T f0b4623789f6400a90a64898d6bc2bd8 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.392925 11576 tablet_replica.cc:333] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.393604 11576 raft_consensus.cc:2243] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.394101 11576 raft_consensus.cc:2272] T 96254c9e0b6a4f8e828190935026cf4b P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.394624 20163 consensus_peers.cc:597] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.396849 11576 tablet_replica.cc:333] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.397593 11576 raft_consensus.cc:2243] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.398182 11576 raft_consensus.cc:2272] T eac9c02fc91043da80c23156c017b264 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.401072 11576 tablet_replica.cc:333] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.401762 11576 raft_consensus.cc:2243] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.402757 11576 raft_consensus.cc:2272] T 2f32b127d2f647c8b07a07d61f643bdf P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.402861 20163 consensus_peers.cc:597] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.405371 11576 tablet_replica.cc:333] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.411142 11576 raft_consensus.cc:2243] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.412755 11576 raft_consensus.cc:2272] T 882ba423a74c496d8a4d5dba170a5748 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.415669 11576 tablet_replica.cc:333] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.416424 11576 raft_consensus.cc:2243] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.416988 11576 raft_consensus.cc:2272] T ae3c66d6c878411e93702c52bee230c1 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.419818 11576 tablet_replica.cc:333] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.420504 11576 raft_consensus.cc:2243] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.420982 11576 raft_consensus.cc:2272] T 15f30be759394f459819ccb2558de4b3 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.423620 11576 tablet_replica.cc:333] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.424309 11576 raft_consensus.cc:2243] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.425256 11576 raft_consensus.cc:2272] T 049e74a7f6364769958bf3682e89a7da P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.427898 11576 tablet_replica.cc:333] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.428519 11576 raft_consensus.cc:2243] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.429114 11576 raft_consensus.cc:2272] T 8f3013974914421182c82eaf339e22cc P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.431851 11576 tablet_replica.cc:333] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.432658 11576 raft_consensus.cc:2243] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.433251 11576 raft_consensus.cc:2272] T 163d17ff6a2c4c4795e2cdbe07cd15dc P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.435305 11576 tablet_replica.cc:333] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.435922 11576 raft_consensus.cc:2243] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.436990 11576 raft_consensus.cc:2272] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.440265 11576 tablet_replica.cc:333] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.440991 11576 raft_consensus.cc:2243] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.441567 11576 raft_consensus.cc:2272] T e9882d3537dc4f1487e6f5784c2b999a P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.444555 11576 tablet_replica.cc:333] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.445266 11576 raft_consensus.cc:2243] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.452884 11576 raft_consensus.cc:2272] T 4b3109762d1147289ef7abb943db28d0 P af9bb61060db4eff9bfe238bbcbea9ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.455595 11576 tablet_replica.cc:333] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.456717 11576 raft_consensus.cc:2243] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.457158 11576 raft_consensus.cc:2272] T cd2390af31254060951179e822c53383 P af9bb61060db4eff9bfe238bbcbea9ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.459492 11576 tablet_replica.cc:333] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca: stopping tablet replica
I20260709 13:10:54.460121 11576 raft_consensus.cc:2243] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.460574 11576 raft_consensus.cc:2272] T 965320aa73c0442fab090a329cb3f3d4 P af9bb61060db4eff9bfe238bbcbea9ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.469913 20163 consensus_peers.cc:597] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.511111 20163 consensus_peers.cc:597] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.527201 20163 consensus_peers.cc:597] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.545794 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
W20260709 13:10:54.579301 20089 consensus_peers.cc:597] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.611531 20089 consensus_peers.cc:597] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.645412 20089 consensus_peers.cc:597] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.647713 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
W20260709 13:10:54.678468 20163 consensus_peers.cc:597] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.683540 20162 consensus_peers.cc:597] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.702284 20162 consensus_peers.cc:597] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.706453 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:54.707466 11576 tablet_replica.cc:333] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.708312 11576 raft_consensus.cc:2243] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.708907 11576 raft_consensus.cc:2272] T 63ac09267db943769573413621ec2923 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.711963 11576 tablet_replica.cc:333] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.712721 11576 raft_consensus.cc:2243] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.713785 11576 raft_consensus.cc:2272] T 1afe0f7aca434ac08f951c456f44801d P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.714146 20089 consensus_peers.cc:597] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.716185 11576 tablet_replica.cc:333] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.716961 11576 raft_consensus.cc:2243] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.717468 11576 raft_consensus.cc:2272] T 96b550827c3d4286a9fa6f1a30de0033 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.719627 11576 tablet_replica.cc:333] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.720274 11576 raft_consensus.cc:2243] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.720697 11576 raft_consensus.cc:2272] T a5d7d14edd7844d3ac28ac51635a1a74 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.722628 11576 tablet_replica.cc:333] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.723228 11576 raft_consensus.cc:2243] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.723635 11576 raft_consensus.cc:2272] T fcd1831330c34053b8dc72271c19c552 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.725831 11576 tablet_replica.cc:333] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.726559 11576 raft_consensus.cc:2243] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.727121 11576 raft_consensus.cc:2272] T 8821119294dc4787ae9b90b24070a2fc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.729970 11576 tablet_replica.cc:333] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.730834 11576 raft_consensus.cc:2243] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.731375 11576 raft_consensus.cc:2272] T e123c09eb9fb4796a206bad4baa67b05 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.733003 20162 consensus_peers.cc:597] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.733989 11576 tablet_replica.cc:333] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.734782 11576 raft_consensus.cc:2243] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.735742 11576 raft_consensus.cc:2272] T d3e25a4e35244733b59abb26b98e197f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.738197 11576 tablet_replica.cc:333] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.738950 11576 raft_consensus.cc:2243] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.739519 11576 raft_consensus.cc:2272] T c577376c4e4f414c9e6b3b717c9dea3c P b112290c0b6e4aa08967a0350cf4b215 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.746289 11576 tablet_replica.cc:333] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.747126 11576 raft_consensus.cc:2243] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.747653 11576 raft_consensus.cc:2272] T adb0269325f84a20b8bbf06dba278dcb P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.750123 11576 tablet_replica.cc:333] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.750685 11576 raft_consensus.cc:2243] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.751166 11576 raft_consensus.cc:2272] T ec431714e0b74545b9e734e354354f2c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.757692 20089 consensus_peers.cc:597] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 -> Peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Couldn't send request to peer af9bb61060db4eff9bfe238bbcbea9ca. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.758405 11576 tablet_replica.cc:333] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.759403 11576 raft_consensus.cc:2243] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.759878 11576 raft_consensus.cc:2272] T 2716c2c5bb624410a935d9f5de12ea96 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.762072 11576 tablet_replica.cc:333] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.762639 11576 raft_consensus.cc:2243] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.763140 11576 raft_consensus.cc:2272] T e96d6093e3af49e2b8fd8e162a7277a7 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.765614 11576 tablet_replica.cc:333] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.766150 11576 raft_consensus.cc:2243] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.766580 11576 raft_consensus.cc:2272] T e9882d3537dc4f1487e6f5784c2b999a P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.768465 11576 tablet_replica.cc:333] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.769057 11576 raft_consensus.cc:2243] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.769582 11576 raft_consensus.cc:2272] T 4b3109762d1147289ef7abb943db28d0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.772204 11576 tablet_replica.cc:333] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.773048 11576 raft_consensus.cc:2243] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.773504 11576 raft_consensus.cc:2272] T 90fbcef945e3478d827ecd923ce8d57f P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.775367 11576 tablet_replica.cc:333] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.775931 11576 raft_consensus.cc:2243] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.776407 11576 raft_consensus.cc:2272] T cb50b2a2fa2b492aa6f523acc8ff6cb8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.778419 11576 tablet_replica.cc:333] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.779161 11576 raft_consensus.cc:2243] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.779633 11576 raft_consensus.cc:2272] T 69a1f4669e774779972fe3fd39706aef P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.781584 11576 tablet_replica.cc:333] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.782153 11576 raft_consensus.cc:2243] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.782553 11576 raft_consensus.cc:2272] T b95d568843284ddda0eda68734cdd590 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.784345 11576 tablet_replica.cc:333] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.784874 11576 raft_consensus.cc:2243] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.785334 11576 raft_consensus.cc:2272] T dae08a3fb8914d8eb858aea9fd39e4d8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.787581 11576 tablet_replica.cc:333] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.788231 11576 raft_consensus.cc:2243] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.788727 11576 raft_consensus.cc:2272] T 159ac08d09bd48f1a2d00965fb182e47 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.790614 20162 consensus_peers.cc:597] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.790688 11576 tablet_replica.cc:333] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.791458 11576 raft_consensus.cc:2243] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.792280 11576 raft_consensus.cc:2272] T 0b3ac05b81ea4c3c83799ea30724a707 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.794202 11576 tablet_replica.cc:333] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.794786 11576 raft_consensus.cc:2243] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.795218 11576 raft_consensus.cc:2272] T d0e9f15408e44661bc3aaf3d74fbba55 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.797191 11576 tablet_replica.cc:333] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.797739 11576 raft_consensus.cc:2243] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.798776 11576 raft_consensus.cc:2272] T 928d42c4bfd54d59bdda6b75cfd037db P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.801131 11576 tablet_replica.cc:333] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.801698 11576 raft_consensus.cc:2243] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.802126 11576 raft_consensus.cc:2272] T 882ba423a74c496d8a4d5dba170a5748 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.804483 11576 tablet_replica.cc:333] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.805056 11576 raft_consensus.cc:2243] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.805878 11576 raft_consensus.cc:2272] T c021951a7255405393cb29fc326c0791 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.807343 20162 consensus_peers.cc:597] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.807909 11576 tablet_replica.cc:333] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.808554 11576 raft_consensus.cc:2243] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.809013 11576 raft_consensus.cc:2272] T ca40d47d506d494e96cc28c3474730f7 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.812547 11576 tablet_replica.cc:333] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.813402 11576 raft_consensus.cc:2243] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.814472 11576 raft_consensus.cc:2272] T dfc07241f7bb4356a03e4bb862681665 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.817173 11576 tablet_replica.cc:333] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.817921 11576 raft_consensus.cc:2243] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.818970 11576 raft_consensus.cc:2272] T d813cf323225419f955c3efdae688a83 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.821970 11576 tablet_replica.cc:333] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.822826 11576 raft_consensus.cc:2243] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.823411 11576 raft_consensus.cc:2272] T a213a8358e61477cac2ad10e043ba2bb P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.825862 11576 tablet_replica.cc:333] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.826514 11576 raft_consensus.cc:2243] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.827006 11576 raft_consensus.cc:2272] T d7feca13708f480e844a83b8c1828d1c P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.829536 11576 tablet_replica.cc:333] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.830294 11576 raft_consensus.cc:2243] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.831261 11576 raft_consensus.cc:2272] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.833917 11576 tablet_replica.cc:333] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.834627 11576 raft_consensus.cc:2243] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.835395 11576 raft_consensus.cc:2272] T 77cd3c2ff5d348dd9b5baa2b04163b97 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.837390 11576 tablet_replica.cc:333] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.837918 11576 raft_consensus.cc:2243] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.838624 11576 raft_consensus.cc:2272] T 43c0e701ffff44788247b6796c34378b P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.840458 11576 tablet_replica.cc:333] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.840960 11576 raft_consensus.cc:2243] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.841713 11576 raft_consensus.cc:2272] T f0b4623789f6400a90a64898d6bc2bd8 P b112290c0b6e4aa08967a0350cf4b215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.843988 11576 tablet_replica.cc:333] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.844595 11576 raft_consensus.cc:2243] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.845047 11576 raft_consensus.cc:2272] T 5bac48363d4d4312b0a4ce40551b6a6c P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.847090 11576 tablet_replica.cc:333] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.847611 11576 raft_consensus.cc:2243] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.848439 11576 raft_consensus.cc:2272] T c908cda42a1b4577845ec65410d29f6f P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.850637 11576 tablet_replica.cc:333] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.851238 11576 raft_consensus.cc:2243] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.851711 11576 raft_consensus.cc:2272] T 1ca23f3e5d7849b78fc9a0c03c170791 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:54.853760 20162 consensus_peers.cc:597] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.853941 11576 tablet_replica.cc:333] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.854784 11576 raft_consensus.cc:2243] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.855891 11576 raft_consensus.cc:2272] T 163d17ff6a2c4c4795e2cdbe07cd15dc P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.858577 11576 tablet_replica.cc:333] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.859339 11576 raft_consensus.cc:2243] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.859925 11576 raft_consensus.cc:2272] T 8f32ec9cdc7b42a8807ae68a8b3db7b8 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.862517 11576 tablet_replica.cc:333] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.863075 11576 raft_consensus.cc:2243] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.864117 11576 raft_consensus.cc:2272] T f34249aa09174ce3b90e9cbf1bfebb62 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.866801 11576 tablet_replica.cc:333] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.867516 11576 raft_consensus.cc:2243] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.868132 11576 raft_consensus.cc:2272] T ae3c66d6c878411e93702c52bee230c1 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.870463 11576 tablet_replica.cc:333] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.870971 11576 raft_consensus.cc:2243] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.871431 11576 raft_consensus.cc:2272] T 965320aa73c0442fab090a329cb3f3d4 P b112290c0b6e4aa08967a0350cf4b215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.873466 11576 tablet_replica.cc:333] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215: stopping tablet replica
I20260709 13:10:54.874023 11576 raft_consensus.cc:2243] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:54.874851 11576 raft_consensus.cc:2272] T eac9c02fc91043da80c23156c017b264 P b112290c0b6e4aa08967a0350cf4b215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.876175 21203 raft_consensus.cc:493] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.876778 21203 raft_consensus.cc:515] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:54.878897 21203 leader_election.cc:290] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:54.883373 20161 leader_election.cc:336] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:54.883980 20163 leader_election.cc:336] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111)
I20260709 13:10:54.884485 20163 leader_election.cc:304] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:54.885260 21203 raft_consensus.cc:2749] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.886269 21203 raft_consensus.cc:493] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.886685 21203 raft_consensus.cc:515] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:54.888959 21246 raft_consensus.cc:493] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.889704 21246 raft_consensus.cc:515] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:54.892454 21246 leader_election.cc:290] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:54.888967 21203 leader_election.cc:290] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:54.896173 20162 leader_election.cc:336] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:54.896248 20163 leader_election.cc:336] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111)
W20260709 13:10:54.898204 20161 leader_election.cc:336] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:54.899678 20161 leader_election.cc:304] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:54.900483 21203 raft_consensus.cc:2749] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:54.902619 20161 leader_election.cc:336] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:54.903136 20161 leader_election.cc:304] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:54.903872 21203 raft_consensus.cc:2749] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.947580 21203 raft_consensus.cc:493] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.948226 21203 raft_consensus.cc:515] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:54.950074 21203 leader_election.cc:290] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:54.952701 20161 leader_election.cc:336] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:54.953985 20163 leader_election.cc:336] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111)
I20260709 13:10:54.954403 20163 leader_election.cc:304] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:54.955054 21203 raft_consensus.cc:2749] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:54.961098 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:10:54.991950 21203 raft_consensus.cc:493] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.992703 21203 raft_consensus.cc:515] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
I20260709 13:10:54.994268 21246 raft_consensus.cc:493] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:54.994880 21203 leader_election.cc:290] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
I20260709 13:10:54.995007 21246 raft_consensus.cc:515] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:54.998021 21246 leader_election.cc:290] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:54.999897 20162 leader_election.cc:336] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111)
W20260709 13:10:55.004941 20161 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:55.005576 20161 leader_election.cc:336] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:55.005940 20161 leader_election.cc:304] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:55.007246 21203 raft_consensus.cc:2749] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:55.012001 20163 leader_election.cc:336] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111)
I20260709 13:10:55.012519 20163 leader_election.cc:304] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:55.014741 21246 raft_consensus.cc:2749] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:55.016702 20162 consensus_peers.cc:597] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.022728 20162 consensus_peers.cc:597] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.066300 11576 tablet_server.cc:179] TabletServer@127.11.78.4:0 shutting down...
I20260709 13:10:55.072384 21231 raft_consensus.cc:493] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:55.072976 21231 raft_consensus.cc:515] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } } peers { permanent_uuid: "af9bb61060db4eff9bfe238bbcbea9ca" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 35489 } }
I20260709 13:10:55.074815 21231 leader_election.cc:290] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127), af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489)
W20260709 13:10:55.080880 20161 leader_election.cc:336] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
W20260709 13:10:55.081475 20163 leader_election.cc:336] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer af9bb61060db4eff9bfe238bbcbea9ca (127.11.78.2:35489): Network error: Client connection negotiation failed: client connection to 127.11.78.2:35489: connect: Connection refused (error 111)
I20260709 13:10:55.081962 20163 leader_election.cc:304] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: af9bb61060db4eff9bfe238bbcbea9ca, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:55.082540 21231 raft_consensus.cc:2749] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:55.118964 20162 consensus_peers.cc:597] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.131649 21231 raft_consensus.cc:493] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e49ff5dc8abb43e5af05c0ef94a90941)
I20260709 13:10:55.132197 21231 raft_consensus.cc:515] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b112290c0b6e4aa08967a0350cf4b215" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 45445 } } peers { permanent_uuid: "9e3242b28df94215893da755f099a6e2" member_type: VOTER last_known_addr { host: "127.11.78.4" port: 46123 } } peers { permanent_uuid: "e49ff5dc8abb43e5af05c0ef94a90941" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 42127 } }
W20260709 13:10:55.135901 20162 consensus_peers.cc:597] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.146657 21231 leader_election.cc:290] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445), e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127)
W20260709 13:10:55.154891 20162 leader_election.cc:336] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111)
W20260709 13:10:55.155505 20161 leader_election.cc:336] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e49ff5dc8abb43e5af05c0ef94a90941 (127.11.78.1:42127): Network error: Client connection negotiation failed: client connection to 127.11.78.1:42127: connect: Connection refused (error 111)
I20260709 13:10:55.156845 20161 leader_election.cc:304] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e3242b28df94215893da755f099a6e2; no voters: b112290c0b6e4aa08967a0350cf4b215, e49ff5dc8abb43e5af05c0ef94a90941
I20260709 13:10:55.159125 21203 raft_consensus.cc:2749] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:55.165062 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:55.166244 11576 tablet_replica.cc:333] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.167300 11576 raft_consensus.cc:2243] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.167963 11576 raft_consensus.cc:2272] T a5d2c82b22aa4ac9802e9161cc6c6c23 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.170445 11576 tablet_replica.cc:333] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.171031 11576 raft_consensus.cc:2243] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.171604 11576 raft_consensus.cc:2272] T 5716bb9307734152b1901998813a44eb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.174465 11576 tablet_replica.cc:333] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.175168 11576 raft_consensus.cc:2243] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.175750 11576 raft_consensus.cc:2272] T 1afe0f7aca434ac08f951c456f44801d P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.177083 20162 consensus_peers.cc:597] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 -> Peer b112290c0b6e4aa08967a0350cf4b215 (127.11.78.3:45445): Couldn't send request to peer b112290c0b6e4aa08967a0350cf4b215. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.3:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.178269 11576 tablet_replica.cc:333] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.179231 11576 raft_consensus.cc:2243] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.179991 11576 raft_consensus.cc:2272] T 96b550827c3d4286a9fa6f1a30de0033 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.182574 11576 tablet_replica.cc:333] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.183167 11576 raft_consensus.cc:2243] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.183617 11576 raft_consensus.cc:2272] T fcd1831330c34053b8dc72271c19c552 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.185708 11576 tablet_replica.cc:333] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.186393 11576 raft_consensus.cc:2243] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.187157 11576 raft_consensus.cc:2272] T 8821119294dc4787ae9b90b24070a2fc P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.189121 11576 tablet_replica.cc:333] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.189677 11576 raft_consensus.cc:2243] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.190079 11576 raft_consensus.cc:2272] T e123c09eb9fb4796a206bad4baa67b05 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.191992 11576 tablet_replica.cc:333] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.192574 11576 raft_consensus.cc:2243] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.193313 11576 raft_consensus.cc:2272] T c577376c4e4f414c9e6b3b717c9dea3c P 9e3242b28df94215893da755f099a6e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.195531 11576 tablet_replica.cc:333] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.196187 11576 raft_consensus.cc:2243] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.196609 11576 raft_consensus.cc:2272] T d3e25a4e35244733b59abb26b98e197f P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.198499 11576 tablet_replica.cc:333] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.199048 11576 raft_consensus.cc:2243] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.199523 11576 raft_consensus.cc:2272] T 2716c2c5bb624410a935d9f5de12ea96 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.201854 11576 tablet_replica.cc:333] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.202589 11576 raft_consensus.cc:2243] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.203084 11576 raft_consensus.cc:2272] T adb0269325f84a20b8bbf06dba278dcb P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.205089 11576 tablet_replica.cc:333] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.205624 11576 raft_consensus.cc:2243] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.206037 11576 raft_consensus.cc:2272] T dc59f19c65354a2882be0da8f9b88764 P 9e3242b28df94215893da755f099a6e2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.207798 11576 tablet_replica.cc:333] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.208365 11576 raft_consensus.cc:2243] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.209122 11576 raft_consensus.cc:2272] T 580e9dc6e4c24718873d74c4398812dd P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.210909 11576 tablet_replica.cc:333] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.211431 11576 raft_consensus.cc:2243] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.212222 11576 raft_consensus.cc:2272] T b95d568843284ddda0eda68734cdd590 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.214114 11576 tablet_replica.cc:333] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.214643 11576 raft_consensus.cc:2243] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.215368 11576 raft_consensus.cc:2272] T dae08a3fb8914d8eb858aea9fd39e4d8 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.217307 11576 tablet_replica.cc:333] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.217834 11576 raft_consensus.cc:2243] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.218226 11576 raft_consensus.cc:2272] T 159ac08d09bd48f1a2d00965fb182e47 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.220325 11576 tablet_replica.cc:333] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.220887 11576 raft_consensus.cc:2243] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.221323 11576 raft_consensus.cc:2272] T 0b3ac05b81ea4c3c83799ea30724a707 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.223412 11576 tablet_replica.cc:333] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.223969 11576 raft_consensus.cc:2243] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.224432 11576 raft_consensus.cc:2272] T 50c50d6c7464403bb75d1dbbcc2bcecd P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.226672 11576 tablet_replica.cc:333] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.227187 11576 raft_consensus.cc:2243] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.228140 11576 raft_consensus.cc:2272] T d0e9f15408e44661bc3aaf3d74fbba55 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.230441 11576 tablet_replica.cc:333] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.230954 11576 raft_consensus.cc:2243] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.231473 11576 raft_consensus.cc:2272] T 15f30be759394f459819ccb2558de4b3 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.233307 11576 tablet_replica.cc:333] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.233814 11576 raft_consensus.cc:2243] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.234565 11576 raft_consensus.cc:2272] T ae3c66d6c878411e93702c52bee230c1 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.236466 11576 tablet_replica.cc:333] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.237013 11576 raft_consensus.cc:2243] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.237438 11576 raft_consensus.cc:2272] T d813cf323225419f955c3efdae688a83 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.239413 11576 tablet_replica.cc:333] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.239938 11576 raft_consensus.cc:2243] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.240403 11576 raft_consensus.cc:2272] T f494e6d6aa8a4b80b4f36c9a880d4ed0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.242180 11576 tablet_replica.cc:333] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.242702 11576 raft_consensus.cc:2243] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.243113 11576 raft_consensus.cc:2272] T f34249aa09174ce3b90e9cbf1bfebb62 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.244957 11576 tablet_replica.cc:333] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.245474 11576 raft_consensus.cc:2243] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.245862 11576 raft_consensus.cc:2272] T 05e2711a72b24afe97685d3b68ca9465 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.247778 11576 tablet_replica.cc:333] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.248399 11576 raft_consensus.cc:2243] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.248807 11576 raft_consensus.cc:2272] T 928d42c4bfd54d59bdda6b75cfd037db P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.250753 11576 tablet_replica.cc:333] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.251291 11576 raft_consensus.cc:2243] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.252060 11576 raft_consensus.cc:2272] T 69a1f4669e774779972fe3fd39706aef P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.253907 11576 tablet_replica.cc:333] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.254653 11576 raft_consensus.cc:2243] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.255486 11576 raft_consensus.cc:2272] T 1da0f3e9b2604f71afd4792bd89d38ca P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.257694 11576 tablet_replica.cc:333] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.258448 11576 raft_consensus.cc:2243] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.259158 11576 raft_consensus.cc:2272] T c021951a7255405393cb29fc326c0791 P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.261862 11576 tablet_replica.cc:333] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.262545 11576 raft_consensus.cc:2243] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.263080 11576 raft_consensus.cc:2272] T dfc07241f7bb4356a03e4bb862681665 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.265671 11576 tablet_replica.cc:333] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.266317 11576 raft_consensus.cc:2243] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.266780 11576 raft_consensus.cc:2272] T 2f32b127d2f647c8b07a07d61f643bdf P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.269529 11576 tablet_replica.cc:333] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.270217 11576 raft_consensus.cc:2243] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.271211 11576 raft_consensus.cc:2272] T 5bac48363d4d4312b0a4ce40551b6a6c P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.273705 11576 tablet_replica.cc:333] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.274397 11576 raft_consensus.cc:2243] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.275377 11576 raft_consensus.cc:2272] T 1ca23f3e5d7849b78fc9a0c03c170791 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.278172 11576 tablet_replica.cc:333] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.278898 11576 raft_consensus.cc:2243] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.279414 11576 raft_consensus.cc:2272] T 049e74a7f6364769958bf3682e89a7da P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.282081 11576 tablet_replica.cc:333] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.282780 11576 raft_consensus.cc:2243] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.283277 11576 raft_consensus.cc:2272] T 8f3013974914421182c82eaf339e22cc P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.285835 11576 tablet_replica.cc:333] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.286546 11576 raft_consensus.cc:2243] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.287031 11576 raft_consensus.cc:2272] T 43c0e701ffff44788247b6796c34378b P 9e3242b28df94215893da755f099a6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.289556 11576 tablet_replica.cc:333] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.290261 11576 raft_consensus.cc:2243] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.291195 11576 raft_consensus.cc:2272] T f7888f5f6364427b9a0d647763feb39f P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.293872 11576 tablet_replica.cc:333] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.294582 11576 raft_consensus.cc:2243] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.295091 11576 raft_consensus.cc:2272] T 77cd3c2ff5d348dd9b5baa2b04163b97 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.297830 11576 tablet_replica.cc:333] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.298538 11576 raft_consensus.cc:2243] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.299717 11576 raft_consensus.cc:2272] T e9882d3537dc4f1487e6f5784c2b999a P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.302434 11576 tablet_replica.cc:333] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.303078 11576 raft_consensus.cc:2243] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.303592 11576 raft_consensus.cc:2272] T 4b3109762d1147289ef7abb943db28d0 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.306136 11576 tablet_replica.cc:333] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.306808 11576 raft_consensus.cc:2243] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.307276 11576 raft_consensus.cc:2272] T cd2390af31254060951179e822c53383 P 9e3242b28df94215893da755f099a6e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.309681 11576 tablet_replica.cc:333] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.310352 11576 raft_consensus.cc:2243] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.310854 11576 raft_consensus.cc:2272] T efe4e3a9b96d4af1ad4db55958206dd9 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.313457 11576 tablet_replica.cc:333] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.314083 11576 raft_consensus.cc:2243] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.315057 11576 raft_consensus.cc:2272] T 96254c9e0b6a4f8e828190935026cf4b P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.317564 11576 tablet_replica.cc:333] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2: stopping tablet replica
I20260709 13:10:55.318192 11576 raft_consensus.cc:2243] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.318670 11576 raft_consensus.cc:2272] T eac9c02fc91043da80c23156c017b264 P 9e3242b28df94215893da755f099a6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.391057 11576 tablet_server.cc:196] TabletServer@127.11.78.4:0 shutdown complete.
I20260709 13:10:55.453325 11576 master.cc:562] Master@127.11.78.62:45221 shutting down...
I20260709 13:10:55.482610 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.483126 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.483399 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3502d846919542858dce16a7f3cc577b: stopping tablet replica
I20260709 13:10:55.505493 11576 master.cc:584] Master@127.11.78.62:45221 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34409 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:55.596165 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:39961
I20260709 13:10:55.597283 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:55.603477 21253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:55.603505 21252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:55.604949 21255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:55.606873 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:55.608135 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:55.608326 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:55.608521 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602655608506 us; error 0 us; skew 500 ppm
I20260709 13:10:55.609193 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:55.611773 11576 webserver.cc:533] Webserver started at http://127.11.78.62:43429/ using document root <none> and password file <none>
I20260709 13:10:55.612392 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:55.612628 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:55.612987 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:55.614120 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "4a445a14299a44ceaf20582795c9780f"
format_stamp: "Formatted at 2026-07-09 13:10:55 on dist-test-slave-smzk"
I20260709 13:10:55.618718 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:10:55.622452 21260 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:55.623365 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:55.623669 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "4a445a14299a44ceaf20582795c9780f"
format_stamp: "Formatted at 2026-07-09 13:10:55 on dist-test-slave-smzk"
I20260709 13:10:55.624024 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:55.655157 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:55.656448 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:55.698855 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:39961
I20260709 13:10:55.698997 21311 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:39961 every 8 connection(s)
I20260709 13:10:55.705868 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:55.718874 21312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f: Bootstrap starting.
I20260709 13:10:55.724522 21312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:55.729952 21312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f: No bootstrap required, opened a new log
I20260709 13:10:55.732478 21312 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER }
I20260709 13:10:55.732996 21312 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:55.733246 21312 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a445a14299a44ceaf20582795c9780f, State: Initialized, Role: FOLLOWER
I20260709 13:10:55.733937 21312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER }
I20260709 13:10:55.734431 21312 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:55.734660 21312 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:55.734947 21312 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.740284 21312 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER }
I20260709 13:10:55.740880 21312 leader_election.cc:304] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a445a14299a44ceaf20582795c9780f; no voters: 
I20260709 13:10:55.742249 21312 leader_election.cc:290] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:55.742808 21315 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:55.744475 21315 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 1 LEADER]: Becoming Leader. State: Replica: 4a445a14299a44ceaf20582795c9780f, State: Running, Role: LEADER
I20260709 13:10:55.745185 21315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER }
I20260709 13:10:55.745575 21312 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:55.749847 21316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a445a14299a44ceaf20582795c9780f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER } }
I20260709 13:10:55.750607 21316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:55.751385 21317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a445a14299a44ceaf20582795c9780f. Latest consensus state: current_term: 1 leader_uuid: "4a445a14299a44ceaf20582795c9780f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a445a14299a44ceaf20582795c9780f" member_type: VOTER } }
I20260709 13:10:55.752467 21317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:55.753273 21322 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:55.758702 21322 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:55.763275 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:55.768283 21322 catalog_manager.cc:1383] Generated new cluster ID: 6699db6d78f2488c9d92452983a59e1d
I20260709 13:10:55.768600 21322 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:55.790653 21322 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:55.792001 21322 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:55.806133 21322 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f: Generated new TSK 0
I20260709 13:10:55.806845 21322 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:55.830426 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:55.837462 21333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:55.838872 21334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:55.841797 11576 server_base.cc:1061] running on GCE node
W20260709 13:10:55.841871 21336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:55.843142 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:55.843400 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:55.843586 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602655843553 us; error 0 us; skew 500 ppm
I20260709 13:10:55.844237 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:55.847047 11576 webserver.cc:533] Webserver started at http://127.11.78.1:40457/ using document root <none> and password file <none>
I20260709 13:10:55.847594 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:55.847841 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:55.848233 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:55.849488 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "b2f922cb7cff42009ad77df0f0d38446"
format_stamp: "Formatted at 2026-07-09 13:10:55 on dist-test-slave-smzk"
I20260709 13:10:55.854471 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:55.858443 21341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:55.859478 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:55.859902 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "b2f922cb7cff42009ad77df0f0d38446"
format_stamp: "Formatted at 2026-07-09 13:10:55 on dist-test-slave-smzk"
I20260709 13:10:55.860296 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:55.891227 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:55.892776 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:55.894580 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:55.897621 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:55.897887 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:55.898170 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:55.898371 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:55.989872 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:39269
I20260709 13:10:55.989977 21404 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:39269 every 8 connection(s)
I20260709 13:10:55.998296 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:56.008942 21409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:56.010134 21410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:56.014137 11576 server_base.cc:1061] running on GCE node
W20260709 13:10:56.015084 21412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:56.015301 21405 heartbeater.cc:344] Connected to a master server at 127.11.78.62:39961
I20260709 13:10:56.015797 21405 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:56.016605 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:56.016954 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:56.017004 21405 heartbeater.cc:507] Master 127.11.78.62:39961 requested a full tablet report, sending...
I20260709 13:10:56.017239 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602656017214 us; error 0 us; skew 500 ppm
I20260709 13:10:56.018090 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:56.020421 21277 ts_manager.cc:194] Registered new tserver with Master: b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269)
I20260709 13:10:56.021492 11576 webserver.cc:533] Webserver started at http://127.11.78.2:33633/ using document root <none> and password file <none>
I20260709 13:10:56.022181 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:56.022390 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:56.022764 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:56.023522 21277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43434
I20260709 13:10:56.024742 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "876556b9628646659aea3c1770100805"
format_stamp: "Formatted at 2026-07-09 13:10:56 on dist-test-slave-smzk"
I20260709 13:10:56.030818 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:56.035090 21417 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.036234 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:56.036608 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "876556b9628646659aea3c1770100805"
format_stamp: "Formatted at 2026-07-09 13:10:56 on dist-test-slave-smzk"
I20260709 13:10:56.036931 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:56.051319 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:56.052753 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:56.054545 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:56.057188 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:56.057448 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.057711 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:56.057932 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.105733 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:38231
I20260709 13:10:56.105875 21479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:38231 every 8 connection(s)
I20260709 13:10:56.111056 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:56.118978 21483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:56.120457 21484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:56.127106 21486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:56.129781 21480 heartbeater.cc:344] Connected to a master server at 127.11.78.62:39961
I20260709 13:10:56.130435 21480 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:56.131716 21480 heartbeater.cc:507] Master 127.11.78.62:39961 requested a full tablet report, sending...
I20260709 13:10:56.133708 11576 server_base.cc:1061] running on GCE node
I20260709 13:10:56.134261 21277 ts_manager.cc:194] Registered new tserver with Master: 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:56.134956 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:56.135272 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:56.135483 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602656135463 us; error 0 us; skew 500 ppm
I20260709 13:10:56.136384 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:56.136293 21277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43436
I20260709 13:10:56.139849 11576 webserver.cc:533] Webserver started at http://127.11.78.3:35241/ using document root <none> and password file <none>
I20260709 13:10:56.140501 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:56.140748 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:56.141049 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:56.142647 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "952cb258025b41d8b81745c37ee2bc7c"
format_stamp: "Formatted at 2026-07-09 13:10:56 on dist-test-slave-smzk"
I20260709 13:10:56.147958 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:10:56.152098 21491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.153105 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:56.153527 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "952cb258025b41d8b81745c37ee2bc7c"
format_stamp: "Formatted at 2026-07-09 13:10:56 on dist-test-slave-smzk"
I20260709 13:10:56.153867 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:56.192251 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:56.193768 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:56.195513 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:56.198118 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:56.198361 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.198613 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:56.198805 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:56.253882 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:33387
I20260709 13:10:56.254132 21553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:33387 every 8 connection(s)
I20260709 13:10:56.270591 21554 heartbeater.cc:344] Connected to a master server at 127.11.78.62:39961
I20260709 13:10:56.271081 21554 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:56.271849 21554 heartbeater.cc:507] Master 127.11.78.62:39961 requested a full tablet report, sending...
I20260709 13:10:56.274006 21277 ts_manager.cc:194] Registered new tserver with Master: 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:56.275009 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017205868s
I20260709 13:10:56.275483 21277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43444
I20260709 13:10:56.307718 21277 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43458:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:56.311280 21277 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:56.399770 21445 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5aa9e7c81492e80df6a9cea093cd9 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:56.401917 21445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5aa9e7c81492e80df6a9cea093cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.402545 21443 tablet_service.cc:1511] Processing CreateTablet for tablet 298382d8221440f889b2e9b776fbd963 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:56.404376 21443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298382d8221440f889b2e9b776fbd963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.405476 21444 tablet_service.cc:1511] Processing CreateTablet for tablet 289753df40de4d598094b5010f418c99 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:56.407140 21444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289753df40de4d598094b5010f418c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.408994 21369 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5aa9e7c81492e80df6a9cea093cd9 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:56.410753 21369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5aa9e7c81492e80df6a9cea093cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.412741 21442 tablet_service.cc:1511] Processing CreateTablet for tablet acae033af5504b1680a43cf6a177d4af (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:56.414692 21442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae033af5504b1680a43cf6a177d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.415064 21367 tablet_service.cc:1511] Processing CreateTablet for tablet 298382d8221440f889b2e9b776fbd963 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:56.416420 21368 tablet_service.cc:1511] Processing CreateTablet for tablet 289753df40de4d598094b5010f418c99 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:56.419152 21366 tablet_service.cc:1511] Processing CreateTablet for tablet acae033af5504b1680a43cf6a177d4af (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:56.422087 21441 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad99e88b7e4387898652cb469d16f5 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:56.423098 21365 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad99e88b7e4387898652cb469d16f5 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:56.423949 21441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad99e88b7e4387898652cb469d16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.427011 21364 tablet_service.cc:1511] Processing CreateTablet for tablet c6506abbc9b7428694a0c57b268e6dfe (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:56.430815 21440 tablet_service.cc:1511] Processing CreateTablet for tablet c6506abbc9b7428694a0c57b268e6dfe (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:56.431032 21363 tablet_service.cc:1511] Processing CreateTablet for tablet e831687b4ed1463dacfd0d26fc4266a2 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:56.432694 21440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6506abbc9b7428694a0c57b268e6dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.433625 21367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298382d8221440f889b2e9b776fbd963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.435045 21364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6506abbc9b7428694a0c57b268e6dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.435721 21365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad99e88b7e4387898652cb469d16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.436417 21368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289753df40de4d598094b5010f418c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.438755 21439 tablet_service.cc:1511] Processing CreateTablet for tablet e831687b4ed1463dacfd0d26fc4266a2 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:56.440193 21363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e831687b4ed1463dacfd0d26fc4266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.440624 21439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e831687b4ed1463dacfd0d26fc4266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.449118 21362 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5116ce154b24be01abd9db6450df (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:56.450733 21362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5116ce154b24be01abd9db6450df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.453881 21361 tablet_service.cc:1511] Processing CreateTablet for tablet 4a48d09c03c24a5f9fdad0f93ff35e01 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:56.454643 21438 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5116ce154b24be01abd9db6450df (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:56.458490 21437 tablet_service.cc:1511] Processing CreateTablet for tablet 4a48d09c03c24a5f9fdad0f93ff35e01 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:56.459547 21438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5116ce154b24be01abd9db6450df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.460495 21437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a48d09c03c24a5f9fdad0f93ff35e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.459702 21366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae033af5504b1680a43cf6a177d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.463135 21361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a48d09c03c24a5f9fdad0f93ff35e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.464525 21436 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe2aaad056d44bcadae1d06a81a3697 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:56.466073 21436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe2aaad056d44bcadae1d06a81a3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.472708 21360 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe2aaad056d44bcadae1d06a81a3697 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:56.474428 21360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe2aaad056d44bcadae1d06a81a3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.511303 21573 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:56.519300 21572 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:56.521940 21573 tablet_bootstrap.cc:654] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.557763 21572 tablet_bootstrap.cc:654] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.598592 21572 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:56.599210 21572 ts_tablet_manager.cc:1403] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.018s
I20260709 13:10:56.601163 21519 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5aa9e7c81492e80df6a9cea093cd9 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:56.601910 21573 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:56.602564 21573 ts_tablet_manager.cc:1403] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.024s
I20260709 13:10:56.603152 21519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5aa9e7c81492e80df6a9cea093cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.602651 21572 raft_consensus.cc:359] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.603936 21572 raft_consensus.cc:385] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.604364 21572 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.605316 21572 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.605706 21518 tablet_service.cc:1511] Processing CreateTablet for tablet 289753df40de4d598094b5010f418c99 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:56.606082 21573 raft_consensus.cc:359] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.607517 21573 raft_consensus.cc:385] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.608079 21573 raft_consensus.cc:740] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.608309 21518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289753df40de4d598094b5010f418c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.608608 21513 tablet_service.cc:1511] Processing CreateTablet for tablet e831687b4ed1463dacfd0d26fc4266a2 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:56.609086 21573 consensus_queue.cc:260] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.610888 21513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e831687b4ed1463dacfd0d26fc4266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.612524 21515 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad99e88b7e4387898652cb469d16f5 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:56.614995 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad99e88b7e4387898652cb469d16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.617990 21516 tablet_service.cc:1511] Processing CreateTablet for tablet acae033af5504b1680a43cf6a177d4af (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:56.621838 21514 tablet_service.cc:1511] Processing CreateTablet for tablet c6506abbc9b7428694a0c57b268e6dfe (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:56.626157 21517 tablet_service.cc:1511] Processing CreateTablet for tablet 298382d8221440f889b2e9b776fbd963 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:56.629375 21516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae033af5504b1680a43cf6a177d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.631386 21514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6506abbc9b7428694a0c57b268e6dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.633945 21511 tablet_service.cc:1511] Processing CreateTablet for tablet 4a48d09c03c24a5f9fdad0f93ff35e01 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:56.639073 21510 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe2aaad056d44bcadae1d06a81a3697 (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:56.646247 21511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a48d09c03c24a5f9fdad0f93ff35e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.648607 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe2aaad056d44bcadae1d06a81a3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.652592 21517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298382d8221440f889b2e9b776fbd963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.647451 21512 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5116ce154b24be01abd9db6450df (DEFAULT_TABLE table=test-workload [id=05788c62dbf24ae9b6d388fd39ce0e26]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:56.655469 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5116ce154b24be01abd9db6450df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.677501 21480 heartbeater.cc:499] Master 127.11.78.62:39961 was elected leader, sending a full tablet report...
I20260709 13:10:56.677861 21573 ts_tablet_manager.cc:1434] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.075s	user 0.030s	sys 0.030s
I20260709 13:10:56.679186 21573 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:56.685845 21573 tablet_bootstrap.cc:654] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.709347 21405 heartbeater.cc:499] Master 127.11.78.62:39961 was elected leader, sending a full tablet report...
I20260709 13:10:56.710973 21572 ts_tablet_manager.cc:1434] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.111s	user 0.038s	sys 0.064s
I20260709 13:10:56.712199 21572 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:56.719700 21572 tablet_bootstrap.cc:654] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.728754 21576 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.729775 21576 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.732455 21572 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:56.733132 21572 ts_tablet_manager.cc:1403] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.014s
I20260709 13:10:56.737422 21572 raft_consensus.cc:359] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.738209 21572 raft_consensus.cc:385] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.738517 21572 raft_consensus.cc:740] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.739626 21572 consensus_queue.cc:260] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.742211 21572 ts_tablet_manager.cc:1434] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:56.743440 21572 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
W20260709 13:10:56.746637 21406 tablet.cc:2406] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:56.750993 21572 tablet_bootstrap.cc:654] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.758086 21581 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:56.764158 21572 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:56.764854 21572 ts_tablet_manager.cc:1403] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
W20260709 13:10:56.767819 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:56.768754 21572 raft_consensus.cc:359] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.769728 21572 raft_consensus.cc:385] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.770148 21572 raft_consensus.cc:740] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.771682 21572 consensus_queue.cc:260] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.774227 21572 ts_tablet_manager.cc:1434] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:56.775333 21572 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:56.785135 21572 tablet_bootstrap.cc:654] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.796279 21572 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:56.797760 21576 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:56.796909 21572 ts_tablet_manager.cc:1403] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:10:56.812232 21572 raft_consensus.cc:359] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.813268 21572 raft_consensus.cc:385] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.813586 21572 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.814443 21572 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.826889 21573 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:56.827522 21573 ts_tablet_manager.cc:1403] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.149s	user 0.056s	sys 0.085s
I20260709 13:10:56.830596 21573 raft_consensus.cc:359] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.831339 21573 raft_consensus.cc:385] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.831624 21573 raft_consensus.cc:740] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.833211 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
W20260709 13:10:56.835496 21342 leader_election.cc:343] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:56.839702 21572 ts_tablet_manager.cc:1434] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:10:56.841055 21581 tablet_bootstrap.cc:654] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.841061 21572 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:56.844312 21573 consensus_queue.cc:260] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.845525 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:56.848733 21572 tablet_bootstrap.cc:654] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:56.850436 21345 leader_election.cc:343] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:56.851045 21345 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2f922cb7cff42009ad77df0f0d38446; no voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:56.851581 21573 ts_tablet_manager.cc:1434] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:10:56.852252 21576 raft_consensus.cc:2749] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:56.852730 21573 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:56.857692 21572 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:56.858331 21581 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:56.858331 21572 ts_tablet_manager.cc:1403] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:10:56.859117 21581 ts_tablet_manager.cc:1403] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.000s
I20260709 13:10:56.860148 21573 tablet_bootstrap.cc:654] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.862373 21572 raft_consensus.cc:359] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.862808 21581 raft_consensus.cc:359] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.863407 21572 raft_consensus.cc:385] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.863548 21581 raft_consensus.cc:385] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.863783 21572 raft_consensus.cc:740] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.863947 21581 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.864842 21572 consensus_queue.cc:260] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.865417 21581 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.870628 21572 ts_tablet_manager.cc:1434] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:56.872236 21572 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:56.874336 21554 heartbeater.cc:499] Master 127.11.78.62:39961 was elected leader, sending a full tablet report...
I20260709 13:10:56.875528 21581 ts_tablet_manager.cc:1434] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:10:56.876804 21581 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:56.879908 21573 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:56.880618 21573 ts_tablet_manager.cc:1403] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.009s
I20260709 13:10:56.881857 21572 tablet_bootstrap.cc:654] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.883867 21573 raft_consensus.cc:359] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.884636 21581 tablet_bootstrap.cc:654] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.884701 21573 raft_consensus.cc:385] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:56.885532 21573 raft_consensus.cc:740] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:56.886813 21573 consensus_queue.cc:260] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.889921 21573 ts_tablet_manager.cc:1434] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:10:56.891330 21573 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:56.894062 21576 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.894937 21576 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.899266 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:56.900281 21455 raft_consensus.cc:2468] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 0.
I20260709 13:10:56.901000 21573 tablet_bootstrap.cc:654] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:56.902248 21342 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:56.903991 21579 raft_consensus.cc:2804] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:56.904573 21579 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.905030 21579 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:56.917618 21577 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.918596 21577 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.933072 21577 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:56.938597 21589 raft_consensus.cc:493] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.939558 21589 raft_consensus.cc:515] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.909703 21576 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:56.946570 21576 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.947314 21576 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.949734 21576 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:56.950335 21576 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.950893 21576 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:56.954366 21589 leader_election.cc:290] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.015271 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.017287 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.019035 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
W20260709 13:10:57.025502 21345 leader_election.cc:343] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.026733 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.027908 21455 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 0.
I20260709 13:10:57.030192 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.031265 21455 raft_consensus.cc:2468] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 0.
W20260709 13:10:57.026727 21345 leader_election.cc:343] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:57.034377 21345 leader_election.cc:343] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.039125 21572 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:57.039920 21572 ts_tablet_manager.cc:1403] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.168s	user 0.103s	sys 0.056s
I20260709 13:10:57.043965 21572 raft_consensus.cc:359] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.044997 21572 raft_consensus.cc:385] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.045359 21572 raft_consensus.cc:740] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.046415 21572 consensus_queue.cc:260] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.049638 21572 ts_tablet_manager.cc:1434] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:57.050906 21572 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:57.003592 21576 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.061367 21572 tablet_bootstrap.cc:654] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.061864 21342 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.063891 21342 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.064731 21576 raft_consensus.cc:2804] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.065086 21593 raft_consensus.cc:2804] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.065532 21576 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.065830 21593 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.066478 21576 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.066516 21593 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.064378 21581 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.069797 21581 ts_tablet_manager.cc:1403] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.193s	user 0.041s	sys 0.050s
I20260709 13:10:57.069406 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.070700 21380 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 0.
I20260709 13:10:57.074110 21493 leader_election.cc:304] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.075618 21589 raft_consensus.cc:2804] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.076202 21589 raft_consensus.cc:493] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.076711 21589 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.076771 21581 raft_consensus.cc:359] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.078166 21581 raft_consensus.cc:385] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.078644 21581 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.080842 21581 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.082872 21572 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:57.083705 21572 ts_tablet_manager.cc:1403] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.014s
I20260709 13:10:57.087860 21572 raft_consensus.cc:359] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.088908 21572 raft_consensus.cc:385] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.089277 21572 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.090632 21581 ts_tablet_manager.cc:1434] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:10:57.090564 21572 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.092116 21581 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.094650 21572 ts_tablet_manager.cc:1434] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:10:57.094666 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.096661 21572 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
W20260709 13:10:57.097311 21421 leader_election.cc:343] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.100947 21581 tablet_bootstrap.cc:654] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.107806 21572 tablet_bootstrap.cc:654] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.123023 21572 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:57.123682 21572 ts_tablet_manager.cc:1403] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.009s
I20260709 13:10:57.123863 21576 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.139933 21589 raft_consensus.cc:515] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.141331 21573 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.141922 21573 ts_tablet_manager.cc:1403] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.251s	user 0.118s	sys 0.118s
I20260709 13:10:57.142855 21589 leader_election.cc:290] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.127497 21572 raft_consensus.cc:359] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.145900 21576 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Requested vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.146179 21572 raft_consensus.cc:385] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.146509 21572 raft_consensus.cc:740] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.147311 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.145288 21573 raft_consensus.cc:359] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.147513 21572 consensus_queue.cc:260] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.136556 21593 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
W20260709 13:10:57.149248 21345 leader_election.cc:343] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.150579 21581 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.145342 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.146275 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.152403 21380 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.152989 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.151660 21455 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:57.154955 21345 leader_election.cc:343] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.151475 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.156343 21454 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.156482 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.150516 21572 ts_tablet_manager.cc:1434] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:10:57.157485 21378 raft_consensus.cc:2393] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 876556b9628646659aea3c1770100805 in current term 1: Already voted for candidate b2f922cb7cff42009ad77df0f0d38446 in this term.
I20260709 13:10:57.158427 21572 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:10:57.159381 21419 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 876556b9628646659aea3c1770100805; no voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:57.124361 21579 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.161993 21455 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 1.
I20260709 13:10:57.162932 21453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.150471 21593 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Requested vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.163350 21342 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.164739 21579 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Requested vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.165881 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.168154 21579 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.167382 21576 raft_consensus.cc:2804] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:57.166810 21492 leader_election.cc:343] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.168588 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.168872 21576 raft_consensus.cc:697] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Becoming Leader. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Running, Role: LEADER
W20260709 13:10:57.169929 21345 leader_election.cc:343] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.169801 21576 consensus_queue.cc:237] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.171293 21454 raft_consensus.cc:2468] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 1.
I20260709 13:10:57.171710 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.172070 21577 raft_consensus.cc:2749] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.172477 21452 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.151473 21581 ts_tablet_manager.cc:1403] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.032s
I20260709 13:10:57.173931 21579 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.175558 21342 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.176791 21581 raft_consensus.cc:359] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.177572 21581 raft_consensus.cc:385] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.177699 21597 raft_consensus.cc:2804] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.177944 21581 raft_consensus.cc:740] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.178261 21597 raft_consensus.cc:697] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Becoming Leader. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Running, Role: LEADER
W20260709 13:10:57.178319 21492 leader_election.cc:343] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.178840 21581 consensus_queue.cc:260] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.179229 21597 consensus_queue.cc:237] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.181959 21572 tablet_bootstrap.cc:654] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.181602 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.184571 21527 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 0.
I20260709 13:10:57.182207 21380 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:57.185530 21452 raft_consensus.cc:2468] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 1.
I20260709 13:10:57.179474 21579 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.185999 21345 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.186322 21493 leader_election.cc:304] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 876556b9628646659aea3c1770100805
I20260709 13:10:57.187235 21589 raft_consensus.cc:2804] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.187819 21589 raft_consensus.cc:697] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:10:57.188007 21342 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.188102 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.150612 21573 raft_consensus.cc:385] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.189080 21573 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.188720 21589 consensus_queue.cc:237] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.190035 21573 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.192992 21573 ts_tablet_manager.cc:1434] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:10:57.193702 21576 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:57.194376 21342 leader_election.cc:343] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.195031 21576 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.184006 21581 ts_tablet_manager.cc:1434] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:57.196079 21576 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.196223 21593 raft_consensus.cc:2804] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.197034 21581 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.197146 21593 raft_consensus.cc:697] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Becoming Leader. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Running, Role: LEADER
I20260709 13:10:57.198302 21593 consensus_queue.cc:237] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.205108 21275 catalog_manager.cc:5697] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "b2f922cb7cff42009ad77df0f0d38446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.207396 21581 tablet_bootstrap.cc:654] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.208779 21573 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.214144 21576 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.217329 21573 tablet_bootstrap.cc:654] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.226053 21576 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Requested vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.227133 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.228008 21527 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.230484 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
W20260709 13:10:57.232229 21342 leader_election.cc:343] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.238749 21581 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.239470 21581 ts_tablet_manager.cc:1403] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.002s
I20260709 13:10:57.242882 21581 raft_consensus.cc:359] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.243845 21581 raft_consensus.cc:385] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.244232 21581 raft_consensus.cc:740] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.246380 21277 catalog_manager.cc:5697] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 1 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.245414 21581 consensus_queue.cc:260] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.248939 21572 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:57.250609 21527 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f922cb7cff42009ad77df0f0d38446 in term 1.
I20260709 13:10:57.250916 21581 ts_tablet_manager.cc:1434] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:10:57.252182 21581 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.252331 21345 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 876556b9628646659aea3c1770100805
I20260709 13:10:57.254801 21573 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.255429 21573 ts_tablet_manager.cc:1403] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.007s
I20260709 13:10:57.256752 21576 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.257356 21576 raft_consensus.cc:697] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Becoming Leader. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Running, Role: LEADER
I20260709 13:10:57.258272 21576 consensus_queue.cc:237] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.249578 21572 ts_tablet_manager.cc:1403] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.012s
I20260709 13:10:57.260010 21581 tablet_bootstrap.cc:654] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.260949 21593 raft_consensus.cc:493] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.261557 21593 raft_consensus.cc:515] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.264989 21572 raft_consensus.cc:359] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.265765 21572 raft_consensus.cc:385] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.266110 21572 raft_consensus.cc:740] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.265808 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.267153 21572 consensus_queue.cc:260] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.268935 21572 ts_tablet_manager.cc:1434] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:57.269969 21572 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
W20260709 13:10:57.270856 21342 leader_election.cc:343] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.272063 21581 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.272648 21581 ts_tablet_manager.cc:1403] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:10:57.276201 21593 leader_election.cc:290] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.276129 21581 raft_consensus.cc:359] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.276880 21581 raft_consensus.cc:385] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.276952 21572 tablet_bootstrap.cc:654] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.277220 21581 raft_consensus.cc:740] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.278236 21581 consensus_queue.cc:260] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.280923 21581 ts_tablet_manager.cc:1434] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:57.280791 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.282047 21581 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
W20260709 13:10:57.282299 21345 leader_election.cc:343] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.282773 21345 leader_election.cc:304] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2f922cb7cff42009ad77df0f0d38446; no voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.283861 21593 raft_consensus.cc:2749] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.258538 21573 raft_consensus.cc:359] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.284816 21573 raft_consensus.cc:385] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.285517 21573 raft_consensus.cc:740] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.286391 21573 consensus_queue.cc:260] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.288772 21573 ts_tablet_manager.cc:1434] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.005s
I20260709 13:10:57.288964 21572 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: No bootstrap required, opened a new log
I20260709 13:10:57.289228 21581 tablet_bootstrap.cc:654] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.289611 21572 ts_tablet_manager.cc:1403] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:10:57.289849 21573 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.299471 21572 raft_consensus.cc:359] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.300419 21572 raft_consensus.cc:385] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.300709 21572 raft_consensus.cc:740] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.301620 21572 consensus_queue.cc:260] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.304064 21572 ts_tablet_manager.cc:1434] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:57.308202 21573 tablet_bootstrap.cc:654] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.315284 21275 catalog_manager.cc:5697] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "b2f922cb7cff42009ad77df0f0d38446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.317332 21275 catalog_manager.cc:5697] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "b2f922cb7cff42009ad77df0f0d38446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.319283 21275 catalog_manager.cc:5697] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "b2f922cb7cff42009ad77df0f0d38446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.321669 21573 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.321688 21581 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.322542 21573 ts_tablet_manager.cc:1403] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.004s
I20260709 13:10:57.322542 21581 ts_tablet_manager.cc:1403] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.017s
I20260709 13:10:57.326409 21581 raft_consensus.cc:359] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.326411 21573 raft_consensus.cc:359] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.327301 21581 raft_consensus.cc:385] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.327371 21573 raft_consensus.cc:385] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.327718 21581 raft_consensus.cc:740] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.327867 21573 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.328724 21573 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.328724 21581 consensus_queue.cc:260] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.331317 21581 ts_tablet_manager.cc:1434] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:10:57.332376 21581 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.334003 21573 ts_tablet_manager.cc:1434] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:57.335142 21573 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.339200 21581 tablet_bootstrap.cc:654] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.344969 21573 tablet_bootstrap.cc:654] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.346040 21589 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.346712 21589 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.350504 21589 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.350927 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.350509 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.353649 21581 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.351923 21454 raft_consensus.cc:2393] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 952cb258025b41d8b81745c37ee2bc7c in current term 1: Already voted for candidate b2f922cb7cff42009ad77df0f0d38446 in this term.
I20260709 13:10:57.354295 21581 ts_tablet_manager.cc:1403] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:10:57.355517 21492 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c; no voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:57.355791 21573 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.356567 21573 ts_tablet_manager.cc:1403] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:10:57.356701 21589 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.357749 21581 raft_consensus.cc:359] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.358531 21581 raft_consensus.cc:385] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.358824 21581 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.359416 21573 raft_consensus.cc:359] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.359627 21581 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.360280 21573 raft_consensus.cc:385] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.360582 21573 raft_consensus.cc:740] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.361548 21573 consensus_queue.cc:260] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.362428 21581 ts_tablet_manager.cc:1434] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:10:57.363703 21573 ts_tablet_manager.cc:1434] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:10:57.364100 21589 raft_consensus.cc:2749] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.364799 21573 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.363510 21581 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.371817 21573 tablet_bootstrap.cc:654] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.373960 21581 tablet_bootstrap.cc:654] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.373970 21589 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.374775 21589 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.378623 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.379624 21573 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.379920 21589 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.380249 21573 ts_tablet_manager.cc:1403] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:10:57.381366 21581 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.381358 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.382122 21581 ts_tablet_manager.cc:1403] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:10:57.382316 21454 raft_consensus.cc:2393] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 952cb258025b41d8b81745c37ee2bc7c in current term 1: Already voted for candidate b2f922cb7cff42009ad77df0f0d38446 in this term.
I20260709 13:10:57.383366 21492 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c; no voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:57.383384 21573 raft_consensus.cc:359] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.384394 21589 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.384434 21573 raft_consensus.cc:385] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.385138 21573 raft_consensus.cc:740] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.385006 21581 raft_consensus.cc:359] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.385808 21581 raft_consensus.cc:385] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.386125 21581 raft_consensus.cc:740] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.386031 21573 consensus_queue.cc:260] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.386971 21581 consensus_queue.cc:260] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.388435 21573 ts_tablet_manager.cc:1434] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:57.389672 21581 ts_tablet_manager.cc:1434] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:57.389750 21573 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.390918 21581 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.397405 21581 tablet_bootstrap.cc:654] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.401379 21589 raft_consensus.cc:2749] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.397401 21573 tablet_bootstrap.cc:654] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.405512 21589 raft_consensus.cc:493] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.406033 21589 raft_consensus.cc:515] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.409040 21581 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.409240 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5aa9e7c81492e80df6a9cea093cd9" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.409720 21581 ts_tablet_manager.cc:1403] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:10:57.409721 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5aa9e7c81492e80df6a9cea093cd9" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.410002 21380 raft_consensus.cc:2468] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 0.
I20260709 13:10:57.410815 21454 raft_consensus.cc:2468] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 0.
I20260709 13:10:57.409241 21589 leader_election.cc:290] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.411720 21493 leader_election.cc:304] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.412812 21589 raft_consensus.cc:2804] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.409076 21573 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.413198 21589 raft_consensus.cc:493] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.413718 21573 ts_tablet_manager.cc:1403] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:10:57.413226 21581 raft_consensus.cc:359] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.413967 21589 raft_consensus.cc:3060] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.414304 21581 raft_consensus.cc:385] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.414726 21581 raft_consensus.cc:740] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.415499 21581 consensus_queue.cc:260] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.416843 21576 raft_consensus.cc:493] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.416843 21573 raft_consensus.cc:359] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.417846 21573 raft_consensus.cc:385] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.417695 21576 raft_consensus.cc:515] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.418237 21573 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.420248 21573 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.421288 21581 ts_tablet_manager.cc:1434] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:57.422371 21581 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: Bootstrap starting.
I20260709 13:10:57.422263 21589 raft_consensus.cc:515] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.424667 21589 leader_election.cc:290] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.424846 21573 ts_tablet_manager.cc:1434] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:57.426019 21573 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: Bootstrap starting.
I20260709 13:10:57.428174 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.429664 21581 tablet_bootstrap.cc:654] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.432252 21573 tablet_bootstrap.cc:654] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:57.435111 21342 leader_election.cc:343] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.436487 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5aa9e7c81492e80df6a9cea093cd9" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.437180 21454 raft_consensus.cc:3060] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.440409 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5aa9e7c81492e80df6a9cea093cd9" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.440732 21576 leader_election.cc:290] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 876556b9628646659aea3c1770100805 (127.11.78.2:38231), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.441233 21380 raft_consensus.cc:3060] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.443087 21581 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: No bootstrap required, opened a new log
I20260709 13:10:57.443882 21581 ts_tablet_manager.cc:1403] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:10:57.445142 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "b2f922cb7cff42009ad77df0f0d38446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
W20260709 13:10:57.446836 21345 leader_election.cc:343] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:57.447395 21345 leader_election.cc:304] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2f922cb7cff42009ad77df0f0d38446; no voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:10:57.447732 21581 raft_consensus.cc:359] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.448860 21581 raft_consensus.cc:385] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.448974 21576 raft_consensus.cc:2749] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.449280 21581 raft_consensus.cc:740] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.450480 21581 consensus_queue.cc:260] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.453523 21581 ts_tablet_manager.cc:1434] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:10:57.465622 21380 raft_consensus.cc:2468] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:57.467290 21493 leader_election.cc:304] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.468557 21454 raft_consensus.cc:2468] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:57.469833 21589 raft_consensus.cc:2804] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.470849 21573 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: No bootstrap required, opened a new log
I20260709 13:10:57.470772 21589 raft_consensus.cc:697] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:10:57.471458 21573 ts_tablet_manager.cc:1403] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.026s
I20260709 13:10:57.471995 21589 consensus_queue.cc:237] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.474293 21573 raft_consensus.cc:359] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.474992 21573 raft_consensus.cc:385] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.475299 21573 raft_consensus.cc:740] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.476236 21573 consensus_queue.cc:260] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.478118 21573 ts_tablet_manager.cc:1434] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:10:57.481948 21274 catalog_manager.cc:5697] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 1 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.499748 21577 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.500275 21577 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.502170 21577 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.503537 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.503403 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.504586 21527 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.504611 21380 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.506263 21421 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
I20260709 13:10:57.507107 21577 raft_consensus.cc:2804] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.507510 21577 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.507822 21577 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.513806 21577 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.516067 21577 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.516928 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.517304 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.517555 21380 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.518033 21527 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.523854 21380 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.524144 21527 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.525395 21419 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.526410 21577 raft_consensus.cc:2804] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.527694 21577 raft_consensus.cc:697] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:57.528545 21577 consensus_queue.cc:237] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.537534 21274 catalog_manager.cc:5697] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 0 to 1, leader changed from <none> to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.574705 21589 raft_consensus.cc:493] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.575309 21589 raft_consensus.cc:515] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.577239 21589 leader_election.cc:290] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.578434 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.578521 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:57.579140 21380 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 0.
I20260709 13:10:57.579371 21454 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 0.
I20260709 13:10:57.580422 21493 leader_election.cc:304] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.581475 21589 raft_consensus.cc:2804] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.581807 21589 raft_consensus.cc:493] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.582057 21589 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.587021 21589 raft_consensus.cc:515] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.588801 21589 leader_election.cc:290] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:57.589799 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.590060 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:57.590377 21380 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.590893 21454 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.595677 21380 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:57.597052 21493 leader_election.cc:304] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.597893 21589 raft_consensus.cc:2804] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.598024 21454 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:57.598402 21589 raft_consensus.cc:697] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:10:57.599514 21589 consensus_queue.cc:237] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.607416 21577 raft_consensus.cc:493] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.607940 21577 raft_consensus.cc:515] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.607499 21274 catalog_manager.cc:5697] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 1 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.610100 21577 leader_election.cc:290] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.611114 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.611919 21380 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.612114 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.612938 21527 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.613233 21419 leader_election.cc:304] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.614292 21577 raft_consensus.cc:2804] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.614696 21577 raft_consensus.cc:493] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.615088 21577 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.622107 21577 raft_consensus.cc:515] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.623871 21577 leader_election.cc:290] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.624893 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.625102 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.625838 21380 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.625871 21527 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.630724 21528 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.633786 21380 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.633783 21527 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.635600 21421 leader_election.cc:304] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
I20260709 13:10:57.636430 21577 raft_consensus.cc:2804] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.637064 21577 raft_consensus.cc:697] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:57.638015 21577 consensus_queue.cc:237] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.639338 21576 consensus_queue.cc:1048] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.648453 21274 catalog_manager.cc:5697] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 0 to 1, leader changed from <none> to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.666334 21593 consensus_queue.cc:1048] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.676585 21577 raft_consensus.cc:493] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.677230 21577 raft_consensus.cc:515] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.680436 21597 consensus_queue.cc:1048] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.680663 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.681548 21378 raft_consensus.cc:2468] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.682884 21589 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.683250 21577 leader_election.cc:290] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.683063 21419 leader_election.cc:304] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.683518 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.684321 21577 raft_consensus.cc:2804] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:57.684360 21527 raft_consensus.cc:2468] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 0.
I20260709 13:10:57.684908 21577 raft_consensus.cc:493] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.685372 21577 raft_consensus.cc:3060] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.703053 21629 raft_consensus.cc:493] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.703743 21629 raft_consensus.cc:515] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.704231 21577 raft_consensus.cc:515] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.707007 21577 leader_election.cc:290] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.707855 21380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:10:57.708660 21380 raft_consensus.cc:3060] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.708467 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298382d8221440f889b2e9b776fbd963" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:57.709081 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.709481 21527 raft_consensus.cc:3060] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.712810 21576 consensus_queue.cc:1048] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.713121 21629 leader_election.cc:290] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.713532 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.719995 21421 leader_election.cc:304] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 876556b9628646659aea3c1770100805; no voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:57.721933 21629 raft_consensus.cc:2749] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.723021 21454 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.731526 21380 raft_consensus.cc:2468] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.734692 21419 leader_election.cc:304] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:10:57.735884 21629 raft_consensus.cc:2804] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.736114 21597 consensus_queue.cc:1048] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:57.736496 21629 raft_consensus.cc:697] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:57.741356 21589 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:57.742110 21527 raft_consensus.cc:2468] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:57.742717 21629 consensus_queue.cc:237] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.770483 21277 catalog_manager.cc:5697] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 0 to 1, leader changed from <none> to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 1 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:57.780659 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:57.787071 21576 consensus_queue.cc:1048] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:57.787387 21629 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.788199 21629 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:57.789953 21629 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:57.791095 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f922cb7cff42009ad77df0f0d38446" is_pre_election: true
I20260709 13:10:57.791417 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:57.792457 21529 raft_consensus.cc:2393] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 876556b9628646659aea3c1770100805 in current term 1: Already voted for candidate b2f922cb7cff42009ad77df0f0d38446 in this term.
I20260709 13:10:57.793973 21421 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 876556b9628646659aea3c1770100805; no voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:57.795171 21629 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.803364 21629 raft_consensus.cc:2749] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:57.809726 11576 ts_manager.cc:295] Set tserver state for b2f922cb7cff42009ad77df0f0d38446 to MAINTENANCE_MODE
I20260709 13:10:57.810853 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:10:57.814746 21576 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:57.830915 21597 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.867503 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:57.868567 11576 tablet_replica.cc:333] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.869405 11576 raft_consensus.cc:2243] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.869930 11576 raft_consensus.cc:2272] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.873052 11576 tablet_replica.cc:333] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.874001 11576 raft_consensus.cc:2243] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.874568 11576 raft_consensus.cc:2272] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.877063 11576 tablet_replica.cc:333] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.877692 11576 raft_consensus.cc:2243] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.879063 11576 raft_consensus.cc:2272] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.881958 11576 tablet_replica.cc:333] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.882547 11576 raft_consensus.cc:2243] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.882925 11576 raft_consensus.cc:2272] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.884971 11576 tablet_replica.cc:333] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.885535 11576 raft_consensus.cc:2243] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.886430 11576 raft_consensus.cc:2272] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.889024 11576 tablet_replica.cc:333] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.889602 11576 raft_consensus.cc:2243] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.889969 11576 raft_consensus.cc:2272] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.891805 11576 tablet_replica.cc:333] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.892436 11576 raft_consensus.cc:2243] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.893370 11576 raft_consensus.cc:2272] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.895794 11576 tablet_replica.cc:333] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.896428 11576 raft_consensus.cc:2243] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.896842 11576 raft_consensus.cc:2272] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.899495 11576 tablet_replica.cc:333] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.900103 11576 raft_consensus.cc:2243] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.900991 11576 raft_consensus.cc:2272] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.903354 11576 tablet_replica.cc:333] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: stopping tablet replica
I20260709 13:10:57.903857 11576 raft_consensus.cc:2243] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.904311 11576 raft_consensus.cc:2272] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.936904 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
I20260709 13:10:57.938367 21629 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:57.971935 21419 consensus_peers.cc:597] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.972078 21493 consensus_peers.cc:597] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.014539 21493 consensus_peers.cc:597] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.079746 21589 consensus_queue.cc:1048] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:58.092360 21577 consensus_queue.cc:1048] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:58.109539 21419 consensus_peers.cc:597] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.154923 21641 consensus_queue.cc:1048] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:58.214462 21493 consensus_peers.cc:597] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.222821 21650 consensus_queue.cc:1048] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:58.238566 21419 consensus_peers.cc:597] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.781689 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:58.902902 21493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111) [suppressed 134 similar messages]
I20260709 13:10:59.151603 21589 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.152300 21589 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.154289 21589 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:59.155650 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
W20260709 13:10:59.158416 21493 leader_election.cc:336] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.158857 21493 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c; no voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.159523 21589 raft_consensus.cc:2749] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.169678 21629 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.170429 21629 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.172479 21629 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.173728 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:59.174568 21529 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:59.175961 21421 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
W20260709 13:10:59.176781 21419 leader_election.cc:336] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.176947 21629 raft_consensus.cc:2804] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.177388 21629 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.177747 21629 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.183022 21629 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.184831 21629 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.186192 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:59.186897 21529 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:59.189078 21419 leader_election.cc:336] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.193668 21529 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:10:59.194851 21421 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.195627 21629 raft_consensus.cc:2804] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.196683 21629 raft_consensus.cc:697] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:59.197405 21629 consensus_queue.cc:237] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.205075 21277 catalog_manager.cc:5697] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 1 to 2, leader changed from b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.212123 21589 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.212795 21589 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.218209 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
I20260709 13:10:59.217257 21589 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
W20260709 13:10:59.223174 21493 leader_election.cc:336] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.223618 21493 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c; no voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.224413 21589 raft_consensus.cc:2749] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.250007 21629 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.250617 21629 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.252538 21629 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.253868 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:59.254523 21529 raft_consensus.cc:2468] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:59.255525 21421 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
I20260709 13:10:59.256438 21629 raft_consensus.cc:2804] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.256875 21629 raft_consensus.cc:493] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
W20260709 13:10:59.256935 21419 leader_election.cc:336] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.257311 21629 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.263406 21629 raft_consensus.cc:515] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.265393 21629 leader_election.cc:290] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.266676 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad99e88b7e4387898652cb469d16f5" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:59.267517 21529 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:59.269636 21419 leader_election.cc:336] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.274029 21529 raft_consensus.cc:2468] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:10:59.275419 21421 leader_election.cc:304] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.275836 21589 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.276567 21629 raft_consensus.cc:2804] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.276538 21589 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.277295 21629 raft_consensus.cc:697] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:59.278223 21629 consensus_queue.cc:237] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.278713 21589 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:59.279896 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
W20260709 13:10:59.283844 21493 leader_election.cc:336] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.284343 21493 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c; no voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.285091 21589 raft_consensus.cc:2749] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.288821 21277 catalog_manager.cc:5697] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 1 to 2, leader changed from b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.294633 21629 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.295194 21629 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.297279 21629 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.300259 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:59.300885 21529 raft_consensus.cc:2468] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 1.
I20260709 13:10:59.301844 21421 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
W20260709 13:10:59.302414 21419 leader_election.cc:336] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.302533 21629 raft_consensus.cc:2804] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.303045 21629 raft_consensus.cc:493] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.303349 21629 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.308504 21629 raft_consensus.cc:515] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.310237 21629 leader_election.cc:290] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.311359 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a48d09c03c24a5f9fdad0f93ff35e01" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:10:59.311936 21529 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:59.314311 21419 leader_election.cc:336] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.317209 21529 raft_consensus.cc:2468] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:10:59.318429 21421 leader_election.cc:304] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.319126 21629 raft_consensus.cc:2804] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.319555 21629 raft_consensus.cc:697] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:10:59.320391 21629 consensus_queue.cc:237] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.327350 21277 catalog_manager.cc:5697] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 1 to 2, leader changed from b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.330160 21629 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.330873 21629 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.333012 21629 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:10:59.334190 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "952cb258025b41d8b81745c37ee2bc7c" is_pre_election: true
I20260709 13:10:59.336189 21589 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.336728 21589 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
W20260709 13:10:59.339507 21419 leader_election.cc:336] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.338928 21589 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:59.340129 21419 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 876556b9628646659aea3c1770100805; no voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.340961 21629 raft_consensus.cc:2749] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.342290 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805" is_pre_election: true
W20260709 13:10:59.342813 21493 leader_election.cc:336] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.342960 21454 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 1.
I20260709 13:10:59.344103 21492 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.344740 21589 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.345085 21589 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2f922cb7cff42009ad77df0f0d38446)
I20260709 13:10:59.345335 21589 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.350299 21589 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.351837 21589 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:10:59.353266 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:10:59.353976 21454 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:59.356716 21493 leader_election.cc:336] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111)
I20260709 13:10:59.359681 21454 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 2.
I20260709 13:10:59.360807 21492 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: b2f922cb7cff42009ad77df0f0d38446
I20260709 13:10:59.361507 21589 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.362582 21589 raft_consensus.cc:697] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:10:59.363426 21589 consensus_queue.cc:237] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:10:59.370395 21277 catalog_manager.cc:5697] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 1 to 2, leader changed from b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 2 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:59.590858 21419 consensus_peers.cc:597] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.677971 21529 raft_consensus.cc:1275] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.679563 21629 consensus_queue.cc:1048] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:59.782732 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:59.821228 21419 consensus_peers.cc:597] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:59.842437 21493 consensus_peers.cc:597] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.849821 21529 raft_consensus.cc:1275] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.851334 21659 consensus_queue.cc:1048] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.880360 21529 raft_consensus.cc:1275] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.881834 21629 consensus_queue.cc:1048] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:59.899266 21419 consensus_peers.cc:597] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.954334 21454 raft_consensus.cc:1275] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.955662 21667 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:00.432018 21493 consensus_peers.cc:597] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.470275 21493 consensus_peers.cc:597] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.538076 21419 consensus_peers.cc:597] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.556314 21419 consensus_peers.cc:597] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.660498 21419 consensus_peers.cc:597] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.783895 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:00.809873 21493 consensus_peers.cc:597] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:01.785089 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:02.117991 21419 consensus_peers.cc:597] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.265944 21493 consensus_peers.cc:597] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.508078 21419 consensus_peers.cc:597] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.548946 21419 consensus_peers.cc:597] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.729882 21419 consensus_peers.cc:597] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.786105 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:02.894007 21419 consensus_peers.cc:597] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.917356 21493 consensus_peers.cc:597] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:02.972973 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:02.980542 21679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.981446 21680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.992376 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:02.993414 21682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.995862 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:02.996183 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:02.996402 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602662996379 us; error 0 us; skew 500 ppm
I20260709 13:11:02.997140 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:03.000543 11576 webserver.cc:533] Webserver started at http://127.11.78.1:40457/ using document root <none> and password file <none>
I20260709 13:11:03.001226 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:03.001511 11576 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:03.005824 11576 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:03.010540 21687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.011461 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:03.011790 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "b2f922cb7cff42009ad77df0f0d38446"
format_stamp: "Formatted at 2026-07-09 13:10:55 on dist-test-slave-smzk"
I20260709 13:11:03.012166 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:03.030619 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 13:11:03.030716 21493 consensus_peers.cc:597] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:03.032254 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:03.033967 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:03.038029 21694 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:11:03.088704 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:03.089110 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.001s	sys 0.002s
I20260709 13:11:03.089520 11576 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:03.095403 21694 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.108363 21694 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.109128 21694 tablet_bootstrap.cc:492] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.109722 21694 ts_tablet_manager.cc:1403] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:11:03.111866 21694 raft_consensus.cc:359] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.112459 21694 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.113160 21694 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.115480 21694 ts_tablet_manager.cc:1434] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:11:03.116256 21694 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.127956 21694 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.128783 21694 tablet_bootstrap.cc:492] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.129455 21694 ts_tablet_manager.cc:1403] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:11:03.131799 21694 raft_consensus.cc:359] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.132411 21694 raft_consensus.cc:740] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.133021 21694 consensus_queue.cc:260] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.134507 21694 ts_tablet_manager.cc:1434] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:03.135294 21694 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.136701 11576 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:03.137108 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.048s	user 0.047s	sys 0.000s
I20260709 13:11:03.151998 21694 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.153038 21694 tablet_bootstrap.cc:492] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.153631 21694 ts_tablet_manager.cc:1403] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 13:11:03.156406 21694 raft_consensus.cc:359] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.157177 21694 raft_consensus.cc:740] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.157860 21694 consensus_queue.cc:260] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.159688 21694 ts_tablet_manager.cc:1434] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:11:03.160514 21694 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.172165 21694 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.173010 21694 tablet_bootstrap.cc:492] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.173617 21694 ts_tablet_manager.cc:1403] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:11:03.175393 21694 raft_consensus.cc:359] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.175928 21694 raft_consensus.cc:740] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.176733 21694 consensus_queue.cc:260] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.178490 21694 ts_tablet_manager.cc:1434] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:03.179167 21694 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.190253 21694 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.191136 21694 tablet_bootstrap.cc:492] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.191875 21694 ts_tablet_manager.cc:1403] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:11:03.193830 21694 raft_consensus.cc:359] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.194365 21694 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.195004 21694 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.197074 21694 ts_tablet_manager.cc:1434] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:03.197921 21694 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.202440 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:39269
I20260709 13:11:03.202545 21756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:39269 every 8 connection(s)
I20260709 13:11:03.207576 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.219201 21694 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.220189 21694 tablet_bootstrap.cc:492] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.220769 21694 ts_tablet_manager.cc:1403] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:11:03.223523 21694 raft_consensus.cc:359] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.224252 21694 raft_consensus.cc:740] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.224988 21694 consensus_queue.cc:260] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.227037 21694 ts_tablet_manager.cc:1434] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:03.227934 21694 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.236683 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222e5116ce154b24be01abd9db6450df"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:03.237752 21455 raft_consensus.cc:606] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:03.238065 21757 heartbeater.cc:344] Connected to a master server at 127.11.78.62:39961
I20260709 13:11:03.238610 21757 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:03.239466 21757 heartbeater.cc:507] Master 127.11.78.62:39961 requested a full tablet report, sending...
I20260709 13:11:03.241935 21694 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.242276 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289753df40de4d598094b5010f418c99"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:03.243002 21455 raft_consensus.cc:606] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:03.243003 21694 tablet_bootstrap.cc:492] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.244921 21694 ts_tablet_manager.cc:1403] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:11:03.244846 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:03.246002 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:03.246488 21274 ts_manager.cc:194] Re-registered known tserver with Master: b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269)
I20260709 13:11:03.246905 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.248147 21694 raft_consensus.cc:359] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.248936 21694 raft_consensus.cc:740] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.249639 21694 consensus_queue.cc:260] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.251748 21694 ts_tablet_manager.cc:1434] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:03.252630 21694 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.256943 21274 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46646
I20260709 13:11:03.260598 21757 heartbeater.cc:499] Master 127.11.78.62:39961 was elected leader, sending a full tablet report...
I20260709 13:11:03.266485 21694 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.267378 21694 tablet_bootstrap.cc:492] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.267982 21694 ts_tablet_manager.cc:1403] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 13:11:03.270016 21694 raft_consensus.cc:359] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.270517 21694 raft_consensus.cc:740] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.271235 21694 consensus_queue.cc:260] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.272818 21694 ts_tablet_manager.cc:1434] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:03.273591 21694 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.280194 21678 raft_consensus.cc:993] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:03.280751 21766 raft_consensus.cc:1081] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:03.282757 21527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222e5116ce154b24be01abd9db6450df"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:03.283337 21527 raft_consensus.cc:493] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.283722 21527 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.285917 21694 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.286795 21694 tablet_bootstrap.cc:492] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.287474 21694 ts_tablet_manager.cc:1403] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:11:03.289319 21527 raft_consensus.cc:515] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.290050 21694 raft_consensus.cc:359] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.291805 21527 leader_election.cc:290] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 3 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:03.292089 21694 raft_consensus.cc:740] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.293256 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:03.293243 21694 consensus_queue.cc:260] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.294104 21455 raft_consensus.cc:3055] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.294500 21455 raft_consensus.cc:740] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:03.295794 21694 ts_tablet_manager.cc:1434] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:03.295441 21455 consensus_queue.cc:260] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.297076 21455 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.297243 21694 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Bootstrap starting.
I20260709 13:11:03.310626 21455 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 3.
I20260709 13:11:03.312100 21492 leader_election.cc:304] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
I20260709 13:11:03.312366 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5116ce154b24be01abd9db6450df" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:03.313038 21667 raft_consensus.cc:2804] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.313196 21730 raft_consensus.cc:3060] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.315476 21694 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:03.317093 21694 tablet_bootstrap.cc:492] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Bootstrap complete.
I20260709 13:11:03.318058 21694 ts_tablet_manager.cc:1403] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:11:03.322582 21694 raft_consensus.cc:359] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.323378 21694 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f922cb7cff42009ad77df0f0d38446, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.324137 21694 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.324934 21667 raft_consensus.cc:697] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 3 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:03.326505 21694 ts_tablet_manager.cc:1434] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:03.326331 21667 consensus_queue.cc:237] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.325814 21730 raft_consensus.cc:2468] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 3.
I20260709 13:11:03.336702 21274 catalog_manager.cc:5697] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 2 to 3, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 3 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.400848 21730 raft_consensus.cc:3060] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.595598 21730 raft_consensus.cc:3060] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.636448 21678 raft_consensus.cc:993] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:03.637040 21766 raft_consensus.cc:1081] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:03.638772 21529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "289753df40de4d598094b5010f418c99"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:03.639448 21529 raft_consensus.cc:493] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.639802 21529 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.645750 21529 raft_consensus.cc:515] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.647708 21529 leader_election.cc:290] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:03.648840 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:03.649056 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289753df40de4d598094b5010f418c99" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:03.649535 21730 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.649890 21455 raft_consensus.cc:3055] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.650221 21455 raft_consensus.cc:740] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:03.650974 21455 consensus_queue.cc:260] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.652024 21455 raft_consensus.cc:3060] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.655632 21730 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 2.
I20260709 13:11:03.657052 21493 leader_election.cc:304] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:03.657819 21667 raft_consensus.cc:2804] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.657882 21455 raft_consensus.cc:2468] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 2.
I20260709 13:11:03.658329 21667 raft_consensus.cc:697] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:03.659358 21667 consensus_queue.cc:237] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:03.667411 21274 catalog_manager.cc:5697] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 1 to 2, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 2 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.671051 21730 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:03.787175 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:03.809373 21730 raft_consensus.cc:1275] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:03.810878 21667 consensus_queue.cc:1048] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.830718 21455 raft_consensus.cc:1275] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:03.833753 21787 consensus_queue.cc:1048] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.149799 21730 raft_consensus.cc:1275] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.151674 21771 consensus_queue.cc:1048] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.160815 21455 raft_consensus.cc:1275] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.163287 21667 consensus_queue.cc:1048] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.258524 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.276724 21529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
mode: GRACEFUL
new_leader_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:42348
I20260709 13:11:04.277283 21529 raft_consensus.cc:606] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Received request to transfer leadership to TS 876556b9628646659aea3c1770100805
I20260709 13:11:04.279877 21529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
mode: GRACEFUL
new_leader_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:42348
I20260709 13:11:04.280463 21529 raft_consensus.cc:606] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Received request to transfer leadership to TS 876556b9628646659aea3c1770100805
I20260709 13:11:04.281699 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:04.282298 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:04.283001 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.441551 21787 raft_consensus.cc:993] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: : Instructing follower 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:04.442098 21667 raft_consensus.cc:1081] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Signalling peer 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:04.443953 21455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe"
dest_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:36352
I20260709 13:11:04.444545 21455 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.445003 21455 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.450518 21455 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.452172 21455 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 3 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:11:04.453290 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:04.453456 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:11:04.453905 21730 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.454370 21529 raft_consensus.cc:3055] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.454707 21529 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:04.455590 21529 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.457068 21529 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.459547 21730 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 3.
I20260709 13:11:04.460856 21419 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:04.461658 21793 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:04.462170 21793 raft_consensus.cc:697] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:04.463073 21793 consensus_queue.cc:237] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.463889 21529 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 3.
I20260709 13:11:04.472288 21277 catalog_manager.cc:5697] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 2 to 3, leader changed from 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.626258 21787 raft_consensus.cc:993] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: : Instructing follower 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:04.626730 21667 raft_consensus.cc:1081] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Signalling peer 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:04.628342 21455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af"
dest_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:36352
I20260709 13:11:04.628809 21455 raft_consensus.cc:493] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.629088 21455 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.634150 21455 raft_consensus.cc:515] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.635746 21455 leader_election.cc:290] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:11:04.637028 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:04.637028 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acae033af5504b1680a43cf6a177d4af" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:11:04.637928 21730 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.637991 21529 raft_consensus.cc:3055] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.638427 21529 raft_consensus.cc:740] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:04.639300 21529 consensus_queue.cc:260] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.640604 21529 raft_consensus.cc:3060] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.645210 21730 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:11:04.646709 21419 leader_election.cc:304] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:04.647661 21766 raft_consensus.cc:2804] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.647882 21529 raft_consensus.cc:2468] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:11:04.648316 21766 raft_consensus.cc:697] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:04.649441 21766 consensus_queue.cc:237] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:04.657399 21277 catalog_manager.cc:5697] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 1 to 2, leader changed from 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:04.788352 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:04.888713 21529 raft_consensus.cc:1275] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:04.890514 21766 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.901299 21730 raft_consensus.cc:1275] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:04.903060 21678 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.215396 21730 raft_consensus.cc:1275] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.215603 21529 raft_consensus.cc:1275] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.217041 21678 consensus_queue.cc:1048] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:05.217857 21793 consensus_queue.cc:1048] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.289937 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.297873 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:05.298569 21455 raft_consensus.cc:606] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:05.301528 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:05.302120 21455 raft_consensus.cc:606] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:05.303732 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:05.304374 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:05.304986 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.366925 21793 raft_consensus.cc:993] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:05.367507 21678 raft_consensus.cc:1081] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:05.369181 21529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:05.369758 21529 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.370093 21529 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.375566 21529 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.377302 21529 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:05.378281 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:05.378475 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:05.379002 21730 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.379220 21455 raft_consensus.cc:3055] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.379683 21455 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:05.380559 21455 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.381655 21455 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.387593 21730 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 2.
I20260709 13:11:05.388690 21455 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 2.
I20260709 13:11:05.389261 21493 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:05.390090 21667 raft_consensus.cc:2804] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.390990 21667 raft_consensus.cc:697] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:05.391794 21667 consensus_queue.cc:237] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.398873 21274 catalog_manager.cc:5697] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 1 to 2, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 2 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.500901 21793 raft_consensus.cc:993] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:05.501483 21678 raft_consensus.cc:1081] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:05.503254 21529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:05.503798 21529 raft_consensus.cc:493] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.504146 21529 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.508828 21529 raft_consensus.cc:515] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.510334 21529 leader_election.cc:290] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 4 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:05.511459 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:05.511479 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6506abbc9b7428694a0c57b268e6dfe" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:05.512192 21730 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.512615 21455 raft_consensus.cc:3055] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:05.512967 21455 raft_consensus.cc:740] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:05.513909 21455 consensus_queue.cc:260] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.515159 21455 raft_consensus.cc:3060] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.519028 21730 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 4.
I20260709 13:11:05.520557 21493 leader_election.cc:304] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:05.521451 21667 raft_consensus.cc:2804] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:05.522066 21667 raft_consensus.cc:697] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 4 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:05.522127 21455 raft_consensus.cc:2468] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 4.
I20260709 13:11:05.523034 21667 consensus_queue.cc:237] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:05.529881 21274 catalog_manager.cc:5697] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 3 to 4, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 4 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:05.789575 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:05.830560 21730 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.832181 21667 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.844017 21455 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.845666 21818 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.064565 21730 raft_consensus.cc:1275] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:06.066408 21818 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:06.082062 21455 raft_consensus.cc:1275] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:06.084291 21818 consensus_queue.cc:1048] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:06.311582 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:06.323990 21529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
mode: GRACEFUL
new_leader_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:42348
I20260709 13:11:06.325071 21529 raft_consensus.cc:606] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Received request to transfer leadership to TS 876556b9628646659aea3c1770100805
I20260709 13:11:06.328496 21529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
mode: GRACEFUL
new_leader_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:42348
I20260709 13:11:06.329099 21529 raft_consensus.cc:606] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Received request to transfer leadership to TS 876556b9628646659aea3c1770100805
I20260709 13:11:06.330382 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:06.330935 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:06.331676 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:06.401432 21810 raft_consensus.cc:993] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: : Instructing follower 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:06.402078 21818 raft_consensus.cc:1081] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Signalling peer 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:06.404333 21455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2"
dest_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:36352
I20260709 13:11:06.404927 21455 raft_consensus.cc:493] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.405306 21455 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.413949 21455 raft_consensus.cc:515] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.415689 21455 leader_election.cc:290] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:11:06.416951 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:06.417240 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:11:06.417887 21730 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.417982 21529 raft_consensus.cc:3055] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.418447 21529 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:06.419512 21529 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.420807 21529 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.425968 21730 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:11:06.427739 21419 leader_election.cc:304] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:06.428825 21678 raft_consensus.cc:2804] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.430152 21678 raft_consensus.cc:697] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:06.431006 21529 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 2.
I20260709 13:11:06.431978 21678 consensus_queue.cc:237] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.440778 21277 catalog_manager.cc:5697] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 1 to 2, leader changed from 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 2 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.453291 21667 raft_consensus.cc:993] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: : Instructing follower 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:06.454022 21667 raft_consensus.cc:1081] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Signalling peer 876556b9628646659aea3c1770100805 to start an election
I20260709 13:11:06.456434 21455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "876556b9628646659aea3c1770100805"
 from {username='slave'} at 127.0.0.1:36352
I20260709 13:11:06.457185 21455 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.459030 21455 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.465335 21455 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.466954 21455 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 3 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3:33387)
I20260709 13:11:06.467990 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:06.468286 21529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "876556b9628646659aea3c1770100805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
I20260709 13:11:06.468860 21529 raft_consensus.cc:3055] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:06.468860 21730 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.469465 21529 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:06.470602 21529 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.472085 21529 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.477617 21730 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 3.
I20260709 13:11:06.478965 21419 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:06.479763 21678 raft_consensus.cc:2804] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.480216 21529 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876556b9628646659aea3c1770100805 in term 3.
I20260709 13:11:06.480278 21678 raft_consensus.cc:697] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Becoming Leader. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:06.481793 21678 consensus_queue.cc:237] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:06.489230 21277 catalog_manager.cc:5697] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 reported cstate change: term changed from 2 to 3, leader changed from 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3) to 876556b9628646659aea3c1770100805 (127.11.78.2). New cstate: current_term: 3 leader_uuid: "876556b9628646659aea3c1770100805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:06.791042 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:06.821581 21730 raft_consensus.cc:1275] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.823096 21678 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.835597 21529 raft_consensus.cc:1275] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.837795 21825 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.947757 21529 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.949563 21833 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:06.961809 21731 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Refusing update from remote peer 876556b9628646659aea3c1770100805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.963724 21833 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:07.337955 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:07.346880 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:07.347535 21455 raft_consensus.cc:606] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:07.350571 21455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2"
dest_uuid: "876556b9628646659aea3c1770100805"
mode: GRACEFUL
new_leader_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:11:07.351090 21455 raft_consensus.cc:606] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Received request to transfer leadership to TS 952cb258025b41d8b81745c37ee2bc7c
I20260709 13:11:07.352324 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:07.352934 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:07.353596 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:07.408546 21838 raft_consensus.cc:993] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:07.409139 21833 raft_consensus.cc:1081] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:07.410905 21529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:07.411420 21529 raft_consensus.cc:493] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.411705 21529 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.418200 21529 raft_consensus.cc:515] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.419970 21529 leader_election.cc:290] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 4 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:07.421306 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:07.422065 21455 raft_consensus.cc:3055] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:07.421306 21731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe2aaad056d44bcadae1d06a81a3697" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:07.422431 21455 raft_consensus.cc:740] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:07.422822 21731 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.423273 21455 consensus_queue.cc:260] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.424365 21455 raft_consensus.cc:3060] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.429528 21455 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 4.
I20260709 13:11:07.430822 21492 leader_election.cc:304] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876556b9628646659aea3c1770100805, 952cb258025b41d8b81745c37ee2bc7c; no voters: 
I20260709 13:11:07.431327 21731 raft_consensus.cc:2468] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 4.
I20260709 13:11:07.431679 21667 raft_consensus.cc:2804] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:07.433030 21667 raft_consensus.cc:697] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 4 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:07.434115 21667 consensus_queue.cc:237] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.444243 21277 catalog_manager.cc:5697] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 3 to 4, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 4 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.723269 21838 raft_consensus.cc:993] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: : Instructing follower 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:07.723968 21833 raft_consensus.cc:1081] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Signalling peer 952cb258025b41d8b81745c37ee2bc7c to start an election
I20260709 13:11:07.725876 21529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2"
dest_uuid: "952cb258025b41d8b81745c37ee2bc7c"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:11:07.726583 21529 raft_consensus.cc:493] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.726903 21529 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.733542 21529 raft_consensus.cc:515] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.735324 21529 leader_election.cc:290] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 3 election: Requested vote from peers b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269), 876556b9628646659aea3c1770100805 (127.11.78.2:38231)
I20260709 13:11:07.736565 21455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "876556b9628646659aea3c1770100805"
I20260709 13:11:07.736380 21731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e831687b4ed1463dacfd0d26fc4266a2" candidate_uuid: "952cb258025b41d8b81745c37ee2bc7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2f922cb7cff42009ad77df0f0d38446"
I20260709 13:11:07.737313 21455 raft_consensus.cc:3055] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:07.737414 21731 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.737725 21455 raft_consensus.cc:740] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 876556b9628646659aea3c1770100805, State: Running, Role: LEADER
I20260709 13:11:07.738541 21455 consensus_queue.cc:260] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.739745 21455 raft_consensus.cc:3060] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.745349 21731 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 3.
I20260709 13:11:07.746738 21455 raft_consensus.cc:2468] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 952cb258025b41d8b81745c37ee2bc7c in term 3.
I20260709 13:11:07.747121 21493 leader_election.cc:304] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952cb258025b41d8b81745c37ee2bc7c, b2f922cb7cff42009ad77df0f0d38446; no voters: 
I20260709 13:11:07.748090 21667 raft_consensus.cc:2804] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.748780 21667 raft_consensus.cc:697] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 3 LEADER]: Becoming Leader. State: Replica: 952cb258025b41d8b81745c37ee2bc7c, State: Running, Role: LEADER
I20260709 13:11:07.749713 21667 consensus_queue.cc:237] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } }
I20260709 13:11:07.757931 21277 catalog_manager.cc:5697] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c reported cstate change: term changed from 2 to 3, leader changed from 876556b9628646659aea3c1770100805 (127.11.78.2) to 952cb258025b41d8b81745c37ee2bc7c (127.11.78.3). New cstate: current_term: 3 leader_uuid: "952cb258025b41d8b81745c37ee2bc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "952cb258025b41d8b81745c37ee2bc7c" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 33387 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:07.792281 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:07.925402 21455 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:07.927045 21840 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.936666 21730 raft_consensus.cc:1275] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:07.938735 21840 consensus_queue.cc:1048] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:08.188603 21730 raft_consensus.cc:1275] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:08.189975 21840 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f922cb7cff42009ad77df0f0d38446" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:08.199314 21455 raft_consensus.cc:1275] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Refusing update from remote peer 952cb258025b41d8b81745c37ee2bc7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:08.203399 21840 consensus_queue.cc:1048] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "876556b9628646659aea3c1770100805" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:08.360787 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:08.394750 11576 tablet_server.cc:179] TabletServer@127.11.78.1:39269 shutting down...
I20260709 13:11:08.431795 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.432803 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.433530 11576 raft_consensus.cc:2243] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.434026 11576 raft_consensus.cc:2272] T 4a48d09c03c24a5f9fdad0f93ff35e01 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.436924 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.437588 11576 raft_consensus.cc:2243] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.438046 11576 raft_consensus.cc:2272] T e1ad99e88b7e4387898652cb469d16f5 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.440714 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.441339 11576 raft_consensus.cc:2243] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.441752 11576 raft_consensus.cc:2272] T c6506abbc9b7428694a0c57b268e6dfe P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.443918 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.444525 11576 raft_consensus.cc:2243] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.444988 11576 raft_consensus.cc:2272] T 298382d8221440f889b2e9b776fbd963 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.447359 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.447952 11576 raft_consensus.cc:2243] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.448678 11576 raft_consensus.cc:2272] T e831687b4ed1463dacfd0d26fc4266a2 P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.452155 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.452716 11576 raft_consensus.cc:2243] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.453351 11576 raft_consensus.cc:2272] T 96a5aa9e7c81492e80df6a9cea093cd9 P b2f922cb7cff42009ad77df0f0d38446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.456310 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.457020 11576 raft_consensus.cc:2243] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.457530 11576 raft_consensus.cc:2272] T 222e5116ce154b24be01abd9db6450df P b2f922cb7cff42009ad77df0f0d38446 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.459910 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.460469 11576 raft_consensus.cc:2243] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.461117 11576 raft_consensus.cc:2272] T 289753df40de4d598094b5010f418c99 P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.463428 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.463938 11576 raft_consensus.cc:2243] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.464507 11576 raft_consensus.cc:2272] T acae033af5504b1680a43cf6a177d4af P b2f922cb7cff42009ad77df0f0d38446 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.466708 11576 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:08.467289 11576 raft_consensus.cc:2243] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.467785 11576 raft_consensus.cc:2272] T 2fe2aaad056d44bcadae1d06a81a3697 P b2f922cb7cff42009ad77df0f0d38446 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.502981 11576 tablet_server.cc:196] TabletServer@127.11.78.1:39269 shutdown complete.
W20260709 13:11:08.524380 21493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111) [suppressed 94 similar messages]
W20260709 13:11:08.529678 21493 consensus_peers.cc:597] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:08.540740 21419 consensus_peers.cc:597] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.541922 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:11:08.563601 21492 consensus_peers.cc:597] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c -> Peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Couldn't send request to peer 876556b9628646659aea3c1770100805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:08.574461 21492 consensus_peers.cc:597] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c -> Peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Couldn't send request to peer 876556b9628646659aea3c1770100805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.584010 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.585090 11576 tablet_replica.cc:333] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.585963 11576 raft_consensus.cc:2243] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.586699 11576 raft_consensus.cc:2272] T 289753df40de4d598094b5010f418c99 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.589694 11576 tablet_replica.cc:333] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.590494 11576 raft_consensus.cc:2243] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.591580 11576 raft_consensus.cc:2272] T acae033af5504b1680a43cf6a177d4af P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.594275 11576 tablet_replica.cc:333] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.595013 11576 raft_consensus.cc:2243] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.595508 11576 raft_consensus.cc:2272] T e831687b4ed1463dacfd0d26fc4266a2 P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.599601 11576 tablet_replica.cc:333] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.600380 11576 raft_consensus.cc:2243] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.601402 11576 raft_consensus.cc:2272] T 298382d8221440f889b2e9b776fbd963 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.604347 11576 tablet_replica.cc:333] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.605023 11576 raft_consensus.cc:2243] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.605569 11576 raft_consensus.cc:2272] T c6506abbc9b7428694a0c57b268e6dfe P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.608209 11576 tablet_replica.cc:333] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.608902 11576 raft_consensus.cc:2243] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.609524 11576 raft_consensus.cc:2272] T 222e5116ce154b24be01abd9db6450df P 876556b9628646659aea3c1770100805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.612373 11576 tablet_replica.cc:333] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.613034 11576 raft_consensus.cc:2243] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.613603 11576 raft_consensus.cc:2272] T 96a5aa9e7c81492e80df6a9cea093cd9 P 876556b9628646659aea3c1770100805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.616505 11576 tablet_replica.cc:333] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.617157 11576 raft_consensus.cc:2243] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.617674 11576 raft_consensus.cc:2272] T 2fe2aaad056d44bcadae1d06a81a3697 P 876556b9628646659aea3c1770100805 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.621546 11576 tablet_replica.cc:333] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.622177 11576 raft_consensus.cc:2243] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.623268 11576 raft_consensus.cc:2272] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.626194 11576 tablet_replica.cc:333] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805: stopping tablet replica
I20260709 13:11:08.626797 11576 raft_consensus.cc:2243] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.627835 11576 raft_consensus.cc:2272] T e1ad99e88b7e4387898652cb469d16f5 P 876556b9628646659aea3c1770100805 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:08.638036 21492 consensus_peers.cc:597] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c -> Peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Couldn't send request to peer 876556b9628646659aea3c1770100805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.659102 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
W20260709 13:11:08.670699 21493 consensus_peers.cc:597] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c -> Peer b2f922cb7cff42009ad77df0f0d38446 (127.11.78.1:39269): Couldn't send request to peer b2f922cb7cff42009ad77df0f0d38446. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:39269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.690976 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
W20260709 13:11:08.725447 21492 consensus_peers.cc:597] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c -> Peer 876556b9628646659aea3c1770100805 (127.11.78.2:38231): Couldn't send request to peer 876556b9628646659aea3c1770100805. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.729066 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.729892 11576 tablet_replica.cc:333] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.730762 11576 raft_consensus.cc:2243] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.731691 11576 raft_consensus.cc:2272] T 289753df40de4d598094b5010f418c99 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.734171 11576 tablet_replica.cc:333] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.734761 11576 raft_consensus.cc:2243] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.735556 11576 raft_consensus.cc:2272] T 2fe2aaad056d44bcadae1d06a81a3697 P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.738358 11576 tablet_replica.cc:333] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.738994 11576 raft_consensus.cc:2243] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.739519 11576 raft_consensus.cc:2272] T e1ad99e88b7e4387898652cb469d16f5 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.741683 11576 tablet_replica.cc:333] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.742230 11576 raft_consensus.cc:2243] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.743112 11576 raft_consensus.cc:2272] T 222e5116ce154b24be01abd9db6450df P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.745175 11576 tablet_replica.cc:333] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.745920 11576 raft_consensus.cc:2243] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.746886 11576 raft_consensus.cc:2272] T 96a5aa9e7c81492e80df6a9cea093cd9 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.749231 11576 tablet_replica.cc:333] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.749783 11576 raft_consensus.cc:2243] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.750336 11576 raft_consensus.cc:2272] T 4a48d09c03c24a5f9fdad0f93ff35e01 P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.752583 11576 tablet_replica.cc:333] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.753126 11576 raft_consensus.cc:2243] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.753574 11576 raft_consensus.cc:2272] T acae033af5504b1680a43cf6a177d4af P 952cb258025b41d8b81745c37ee2bc7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.755805 11576 tablet_replica.cc:333] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.756760 11576 raft_consensus.cc:2243] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.757268 11576 raft_consensus.cc:2272] T 298382d8221440f889b2e9b776fbd963 P 952cb258025b41d8b81745c37ee2bc7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.759341 11576 tablet_replica.cc:333] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.759845 11576 raft_consensus.cc:2243] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.760654 11576 raft_consensus.cc:2272] T c6506abbc9b7428694a0c57b268e6dfe P 952cb258025b41d8b81745c37ee2bc7c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.763098 11576 tablet_replica.cc:333] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c: stopping tablet replica
I20260709 13:11:08.763633 11576 raft_consensus.cc:2243] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.764863 11576 raft_consensus.cc:2272] T e831687b4ed1463dacfd0d26fc4266a2 P 952cb258025b41d8b81745c37ee2bc7c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:08.793823 21325 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:08.806108 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:11:08.837498 11576 master.cc:562] Master@127.11.78.62:39961 shutting down...
I20260709 13:11:08.867090 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.867731 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.868119 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4a445a14299a44ceaf20582795c9780f: stopping tablet replica
I20260709 13:11:08.890120 11576 master.cc:584] Master@127.11.78.62:39961 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13342 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:11:08.939433 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:46023
I20260709 13:11:08.940869 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:08.947152 21858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:08.949072 21859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:08.950057 21861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:08.950737 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:08.951716 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:08.951898 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:08.952147 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602668952113 us; error 0 us; skew 500 ppm
I20260709 13:11:08.952731 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:08.955367 11576 webserver.cc:533] Webserver started at http://127.11.78.62:38703/ using document root <none> and password file <none>
I20260709 13:11:08.955919 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:08.956161 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:08.956476 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:08.957659 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "a1fa9ff569f6439889f7be4255f677e6"
format_stamp: "Formatted at 2026-07-09 13:11:08 on dist-test-slave-smzk"
I20260709 13:11:08.962913 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:08.967113 21866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:08.968351 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:08.968755 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "a1fa9ff569f6439889f7be4255f677e6"
format_stamp: "Formatted at 2026-07-09 13:11:08 on dist-test-slave-smzk"
I20260709 13:11:08.969084 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.005143 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.006536 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.053169 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:46023
I20260709 13:11:09.053368 21917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:46023 every 8 connection(s)
I20260709 13:11:09.057801 21918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.072706 21918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6: Bootstrap starting.
I20260709 13:11:09.078161 21918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.083176 21918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6: No bootstrap required, opened a new log
I20260709 13:11:09.085851 21918 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER }
I20260709 13:11:09.086278 21918 raft_consensus.cc:385] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.086483 21918 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1fa9ff569f6439889f7be4255f677e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.087025 21918 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER }
I20260709 13:11:09.087528 21918 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:09.087752 21918 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:09.087991 21918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.093958 21918 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER }
I20260709 13:11:09.094508 21918 leader_election.cc:304] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1fa9ff569f6439889f7be4255f677e6; no voters: 
I20260709 13:11:09.095808 21918 leader_election.cc:290] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:09.096339 21921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.097888 21921 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 1 LEADER]: Becoming Leader. State: Replica: a1fa9ff569f6439889f7be4255f677e6, State: Running, Role: LEADER
I20260709 13:11:09.098637 21921 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER }
I20260709 13:11:09.099385 21918 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:09.103390 21922 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1fa9ff569f6439889f7be4255f677e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER } }
I20260709 13:11:09.104185 21922 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:09.104678 21923 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1fa9ff569f6439889f7be4255f677e6. Latest consensus state: current_term: 1 leader_uuid: "a1fa9ff569f6439889f7be4255f677e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1fa9ff569f6439889f7be4255f677e6" member_type: VOTER } }
I20260709 13:11:09.105680 21923 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:09.109539 21928 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:09.118506 21928 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:09.119732 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:09.128721 21928 catalog_manager.cc:1383] Generated new cluster ID: 94b6b5daf32b4c5c9bb3dc70c538db2e
I20260709 13:11:09.129117 21928 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:09.166921 21928 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:09.168512 21928 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:09.183414 21928 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6: Generated new TSK 0
I20260709 13:11:09.184233 21928 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:09.250818 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.257561 21939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.258659 21940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.262430 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:09.262554 21942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.263886 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:09.264219 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.264400 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602669264368 us; error 0 us; skew 500 ppm
I20260709 13:11:09.264992 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.267627 11576 webserver.cc:533] Webserver started at http://127.11.78.1:44591/ using document root <none> and password file <none>
I20260709 13:11:09.268232 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.268400 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.268744 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.270069 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "aca6933986ba4e33b07563a6ad5c99b1"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.275254 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:11:09.279314 21947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.280608 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:09.280946 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "aca6933986ba4e33b07563a6ad5c99b1"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.281275 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.309239 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.310633 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.312551 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.315394 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.315598 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.315930 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.316179 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:11:09.367249 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:39425
I20260709 13:11:09.367384 22009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:39425 every 8 connection(s)
I20260709 13:11:09.373487 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.383366 22014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.383929 22015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.387475 22017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.388273 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:09.389376 22010 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46023
I20260709 13:11:09.389743 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:09.389817 22010 heartbeater.cc:461] Registering TS with master...
W20260709 13:11:09.390161 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.390379 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602669390341 us; error 0 us; skew 500 ppm
I20260709 13:11:09.390954 22010 heartbeater.cc:507] Master 127.11.78.62:46023 requested a full tablet report, sending...
I20260709 13:11:09.391038 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.393790 21883 ts_manager.cc:194] Registered new tserver with Master: aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425)
I20260709 13:11:09.394284 11576 webserver.cc:533] Webserver started at http://127.11.78.2:42861/ using document root <none> and password file <none>
I20260709 13:11:09.394902 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.395129 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.395401 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.396240 21883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43702
I20260709 13:11:09.396821 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "c6636a7bba6e43b28341fc74532e63fe"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.402030 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:09.405788 22022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.406654 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:11:09.407027 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "c6636a7bba6e43b28341fc74532e63fe"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.407302 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.424120 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.425376 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.427026 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.429529 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.429774 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.430033 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.430214 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.475896 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:45535
I20260709 13:11:09.476130 22084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:45535 every 8 connection(s)
I20260709 13:11:09.480978 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.490780 22088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.493188 22089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.497112 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:09.497962 22091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.498556 22085 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46023
I20260709 13:11:09.499078 22085 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:09.499358 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:09.499739 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.499940 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602669499921 us; error 0 us; skew 500 ppm
I20260709 13:11:09.500239 22085 heartbeater.cc:507] Master 127.11.78.62:46023 requested a full tablet report, sending...
I20260709 13:11:09.500692 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.503275 21883 ts_manager.cc:194] Registered new tserver with Master: c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535)
I20260709 13:11:09.504596 11576 webserver.cc:533] Webserver started at http://127.11.78.3:41323/ using document root <none> and password file <none>
I20260709 13:11:09.505420 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.505707 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.505589 21883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43706
I20260709 13:11:09.506176 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.507808 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "455049a553dd454891dbed4b8766d3b3"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.513618 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:11:09.518225 22096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.519132 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:09.519546 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "455049a553dd454891dbed4b8766d3b3"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-smzk"
I20260709 13:11:09.519867 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.540964 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.542271 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.543853 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.546365 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.546604 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.546864 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.547047 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.593859 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:40079
I20260709 13:11:09.594038 22158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:40079 every 8 connection(s)
I20260709 13:11:09.610550 22159 heartbeater.cc:344] Connected to a master server at 127.11.78.62:46023
I20260709 13:11:09.611151 22159 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:09.612309 22159 heartbeater.cc:507] Master 127.11.78.62:46023 requested a full tablet report, sending...
I20260709 13:11:09.615077 21883 ts_manager.cc:194] Registered new tserver with Master: 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:09.616312 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019026104s
I20260709 13:11:09.616866 21883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47944
I20260709 13:11:09.647296 21883 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47952:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:09.649927 21883 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:09.706561 22124 tablet_service.cc:1511] Processing CreateTablet for tablet 2f162e0ab17948f793738a5619ca2043 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:09.708199 22123 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3e70789a64c0aac833a1e246fd77e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:09.708834 22124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f162e0ab17948f793738a5619ca2043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.710666 22123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3e70789a64c0aac833a1e246fd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.716571 22050 tablet_service.cc:1511] Processing CreateTablet for tablet 2f162e0ab17948f793738a5619ca2043 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:09.716879 22049 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3e70789a64c0aac833a1e246fd77e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:09.718096 22050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f162e0ab17948f793738a5619ca2043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.718853 22049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3e70789a64c0aac833a1e246fd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.731107 21975 tablet_service.cc:1511] Processing CreateTablet for tablet 2f162e0ab17948f793738a5619ca2043 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:09.732621 21975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f162e0ab17948f793738a5619ca2043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.739218 22174 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: Bootstrap starting.
I20260709 13:11:09.741844 22175 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: Bootstrap starting.
I20260709 13:11:09.742005 21974 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3e70789a64c0aac833a1e246fd77e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2ced6862a4084d09aab82f10042084c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:09.743606 21974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3e70789a64c0aac833a1e246fd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.749058 22174 tablet_bootstrap.cc:654] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.750386 22175 tablet_bootstrap.cc:654] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.763280 22174 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: No bootstrap required, opened a new log
I20260709 13:11:09.763897 22174 ts_tablet_manager.cc:1403] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
I20260709 13:11:09.765643 22176 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: Bootstrap starting.
I20260709 13:11:09.767362 22175 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: No bootstrap required, opened a new log
I20260709 13:11:09.767462 22174 raft_consensus.cc:359] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.768201 22175 ts_tablet_manager.cc:1403] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.010s
I20260709 13:11:09.768491 22174 raft_consensus.cc:385] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.768826 22174 raft_consensus.cc:740] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455049a553dd454891dbed4b8766d3b3, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.769860 22174 consensus_queue.cc:260] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.772188 22175 raft_consensus.cc:359] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.773607 22175 raft_consensus.cc:385] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.774047 22175 raft_consensus.cc:740] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.774434 22159 heartbeater.cc:499] Master 127.11.78.62:46023 was elected leader, sending a full tablet report...
I20260709 13:11:09.775153 22176 tablet_bootstrap.cc:654] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.775050 22175 consensus_queue.cc:260] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.777177 22174 ts_tablet_manager.cc:1434] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:11:09.778604 22174 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: Bootstrap starting.
I20260709 13:11:09.789541 22174 tablet_bootstrap.cc:654] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.802165 22085 heartbeater.cc:499] Master 127.11.78.62:46023 was elected leader, sending a full tablet report...
I20260709 13:11:09.803635 22174 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: No bootstrap required, opened a new log
I20260709 13:11:09.803635 22176 tablet_bootstrap.cc:492] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: No bootstrap required, opened a new log
I20260709 13:11:09.804489 22174 ts_tablet_manager.cc:1403] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:11:09.804502 22176 ts_tablet_manager.cc:1403] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.016s
I20260709 13:11:09.806030 22175 ts_tablet_manager.cc:1434] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: Time spent starting tablet: real 0.037s	user 0.020s	sys 0.010s
I20260709 13:11:09.807452 22175 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: Bootstrap starting.
I20260709 13:11:09.807922 22174 raft_consensus.cc:359] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.808193 22176 raft_consensus.cc:359] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.808821 22174 raft_consensus.cc:385] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.809187 22174 raft_consensus.cc:740] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455049a553dd454891dbed4b8766d3b3, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.809191 22176 raft_consensus.cc:385] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.809845 22176 raft_consensus.cc:740] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.810207 22174 consensus_queue.cc:260] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.810840 22176 consensus_queue.cc:260] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:09.812815 22174 ts_tablet_manager.cc:1434] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:09.816700 22175 tablet_bootstrap.cc:654] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.818636 22010 heartbeater.cc:499] Master 127.11.78.62:46023 was elected leader, sending a full tablet report...
I20260709 13:11:09.818892 22176 ts_tablet_manager.cc:1434] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:11:09.820214 22176 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: Bootstrap starting.
I20260709 13:11:09.829440 22176 tablet_bootstrap.cc:654] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.837102 22175 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: No bootstrap required, opened a new log
I20260709 13:11:09.837646 22175 ts_tablet_manager.cc:1403] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:11:09.837767 22176 tablet_bootstrap.cc:492] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: No bootstrap required, opened a new log
I20260709 13:11:09.838474 22176 ts_tablet_manager.cc:1403] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:11:09.840085 22175 raft_consensus.cc:359] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.840754 22175 raft_consensus.cc:385] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.841023 22175 raft_consensus.cc:740] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.841300 22176 raft_consensus.cc:359] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.841642 22175 consensus_queue.cc:260] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.842094 22176 raft_consensus.cc:385] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.842555 22176 raft_consensus.cc:740] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.843478 22176 consensus_queue.cc:260] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:09.844094 22175 ts_tablet_manager.cc:1434] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:09.846189 22176 ts_tablet_manager.cc:1434] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:11:10.010301 22183 raft_consensus.cc:493] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.010893 22183 raft_consensus.cc:515] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:10.013499 22183 leader_election.cc:290] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079), c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535)
I20260709 13:11:10.026126 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f162e0ab17948f793738a5619ca2043" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3" is_pre_election: true
I20260709 13:11:10.026995 22134 raft_consensus.cc:2468] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 0.
I20260709 13:11:10.027613 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f162e0ab17948f793738a5619ca2043" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe" is_pre_election: true
I20260709 13:11:10.028419 21948 leader_election.cc:304] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455049a553dd454891dbed4b8766d3b3, aca6933986ba4e33b07563a6ad5c99b1; no voters: 
I20260709 13:11:10.028717 22060 raft_consensus.cc:2468] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 0.
I20260709 13:11:10.029692 22183 raft_consensus.cc:2804] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.030086 22183 raft_consensus.cc:493] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.030395 22183 raft_consensus.cc:3060] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.035816 22183 raft_consensus.cc:515] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:10.037546 22183 leader_election.cc:290] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 election: Requested vote from peers 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079), c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535)
I20260709 13:11:10.038825 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f162e0ab17948f793738a5619ca2043" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3"
I20260709 13:11:10.038947 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f162e0ab17948f793738a5619ca2043" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
I20260709 13:11:10.039621 22134 raft_consensus.cc:3060] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.039682 22060 raft_consensus.cc:3060] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.045907 22060 raft_consensus.cc:2468] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 1.
I20260709 13:11:10.047197 21950 leader_election.cc:304] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aca6933986ba4e33b07563a6ad5c99b1, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:10.047907 22134 raft_consensus.cc:2468] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 1.
I20260709 13:11:10.048019 22183 raft_consensus.cc:2804] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.049614 22183 raft_consensus.cc:697] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Becoming Leader. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Running, Role: LEADER
I20260709 13:11:10.050570 22183 consensus_queue.cc:237] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } }
I20260709 13:11:10.053714 22179 raft_consensus.cc:493] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.054549 22179 raft_consensus.cc:515] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.058058 22179 leader_election.cc:290] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425), c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535)
I20260709 13:11:10.062366 21881 catalog_manager.cc:5697] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "aca6933986ba4e33b07563a6ad5c99b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.069674 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3e70789a64c0aac833a1e246fd77e" candidate_uuid: "455049a553dd454891dbed4b8766d3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1" is_pre_election: true
I20260709 13:11:10.070637 21985 raft_consensus.cc:2468] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455049a553dd454891dbed4b8766d3b3 in term 0.
I20260709 13:11:10.071718 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3e70789a64c0aac833a1e246fd77e" candidate_uuid: "455049a553dd454891dbed4b8766d3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe" is_pre_election: true
I20260709 13:11:10.072172 22100 leader_election.cc:304] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455049a553dd454891dbed4b8766d3b3, aca6933986ba4e33b07563a6ad5c99b1; no voters: 
I20260709 13:11:10.072710 22060 raft_consensus.cc:2468] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455049a553dd454891dbed4b8766d3b3 in term 0.
I20260709 13:11:10.073243 22179 raft_consensus.cc:2804] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.073675 22179 raft_consensus.cc:493] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.073998 22179 raft_consensus.cc:3060] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.080379 22179 raft_consensus.cc:515] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.082036 22179 leader_election.cc:290] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [CANDIDATE]: Term 1 election: Requested vote from peers aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425), c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535)
I20260709 13:11:10.083184 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3e70789a64c0aac833a1e246fd77e" candidate_uuid: "455049a553dd454891dbed4b8766d3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
I20260709 13:11:10.083144 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3e70789a64c0aac833a1e246fd77e" candidate_uuid: "455049a553dd454891dbed4b8766d3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
I20260709 13:11:10.084129 22060 raft_consensus.cc:3060] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.084205 21985 raft_consensus.cc:3060] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.092485 21985 raft_consensus.cc:2468] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455049a553dd454891dbed4b8766d3b3 in term 1.
I20260709 13:11:10.092489 22060 raft_consensus.cc:2468] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455049a553dd454891dbed4b8766d3b3 in term 1.
I20260709 13:11:10.093971 22100 leader_election.cc:304] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455049a553dd454891dbed4b8766d3b3, aca6933986ba4e33b07563a6ad5c99b1; no voters: 
I20260709 13:11:10.094798 22179 raft_consensus.cc:2804] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.096278 22179 raft_consensus.cc:697] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 455049a553dd454891dbed4b8766d3b3, State: Running, Role: LEADER
I20260709 13:11:10.097055 22179 consensus_queue.cc:237] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.105751 21881 catalog_manager.cc:5697] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 455049a553dd454891dbed4b8766d3b3 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "455049a553dd454891dbed4b8766d3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.175782 21881 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47958:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:10.178094 21881 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:10.204761 21974 tablet_service.cc:1511] Processing CreateTablet for tablet c5d36cb99a1f418681c042303bbd50fc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:10.206089 22050 tablet_service.cc:1511] Processing CreateTablet for tablet c5d36cb99a1f418681c042303bbd50fc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:10.206089 21974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d36cb99a1f418681c042303bbd50fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.207484 22050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d36cb99a1f418681c042303bbd50fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.207978 22124 tablet_service.cc:1511] Processing CreateTablet for tablet c5d36cb99a1f418681c042303bbd50fc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:10.209244 22124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d36cb99a1f418681c042303bbd50fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.210381 21975 tablet_service.cc:1511] Processing CreateTablet for tablet ff9246ba0821464eba6cf2269e046f8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:10.211616 21975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9246ba0821464eba6cf2269e046f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.213429 22049 tablet_service.cc:1511] Processing CreateTablet for tablet ff9246ba0821464eba6cf2269e046f8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:10.214665 22049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9246ba0821464eba6cf2269e046f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.217919 22123 tablet_service.cc:1511] Processing CreateTablet for tablet ff9246ba0821464eba6cf2269e046f8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=67869ae69c7a476a85f4e73e4e40e8d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:10.219412 22123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9246ba0821464eba6cf2269e046f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.232337 22175 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: Bootstrap starting.
I20260709 13:11:10.232578 22174 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: Bootstrap starting.
I20260709 13:11:10.239220 22174 tablet_bootstrap.cc:654] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.239444 22175 tablet_bootstrap.cc:654] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.247383 22176 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: Bootstrap starting.
I20260709 13:11:10.251029 22174 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: No bootstrap required, opened a new log
I20260709 13:11:10.251649 22174 ts_tablet_manager.cc:1403] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:11:10.254432 22175 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: No bootstrap required, opened a new log
I20260709 13:11:10.255036 22175 ts_tablet_manager.cc:1403] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:11:10.254904 22174 raft_consensus.cc:359] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.255738 22174 raft_consensus.cc:385] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.256093 22174 raft_consensus.cc:740] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455049a553dd454891dbed4b8766d3b3, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.257031 22176 tablet_bootstrap.cc:654] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.256937 22174 consensus_queue.cc:260] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.258111 22175 raft_consensus.cc:359] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.258855 22175 raft_consensus.cc:385] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.259155 22175 raft_consensus.cc:740] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.261232 22175 consensus_queue.cc:260] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.263447 22175 ts_tablet_manager.cc:1434] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:10.264497 22175 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Bootstrap starting.
I20260709 13:11:10.268277 22176 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: No bootstrap required, opened a new log
I20260709 13:11:10.268539 22174 ts_tablet_manager.cc:1434] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:11:10.269112 22176 ts_tablet_manager.cc:1403] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 13:11:10.270073 22174 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: Bootstrap starting.
I20260709 13:11:10.271448 22175 tablet_bootstrap.cc:654] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.276585 22176 raft_consensus.cc:359] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.277401 22174 tablet_bootstrap.cc:654] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.277585 22176 raft_consensus.cc:385] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.278034 22176 raft_consensus.cc:740] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.279135 22176 consensus_queue.cc:260] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.282099 22176 ts_tablet_manager.cc:1434] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:10.285425 22176 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: Bootstrap starting.
I20260709 13:11:10.292163 22183 raft_consensus.cc:493] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.293138 22175 tablet_bootstrap.cc:492] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: No bootstrap required, opened a new log
I20260709 13:11:10.292806 22183 raft_consensus.cc:515] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.294577 22176 tablet_bootstrap.cc:654] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.295075 22183 leader_election.cc:290] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:10.292213 22174 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: No bootstrap required, opened a new log
I20260709 13:11:10.295915 22174 ts_tablet_manager.cc:1403] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:11:10.296409 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe" is_pre_election: true
I20260709 13:11:10.295919 22175 ts_tablet_manager.cc:1403] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.007s
I20260709 13:11:10.298166 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3" is_pre_election: true
I20260709 13:11:10.299257 22134 raft_consensus.cc:2468] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 0.
I20260709 13:11:10.300652 22175 raft_consensus.cc:359] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.301520 22175 raft_consensus.cc:385] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.302543 22175 raft_consensus.cc:740] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.301401 21948 leader_election.cc:304] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455049a553dd454891dbed4b8766d3b3, aca6933986ba4e33b07563a6ad5c99b1; no voters: 
I20260709 13:11:10.303453 22175 consensus_queue.cc:260] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.304409 22183 raft_consensus.cc:2804] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.305019 22183 raft_consensus.cc:493] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.305510 22183 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.306097 22175 ts_tablet_manager.cc:1434] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
W20260709 13:11:10.308867 21950 leader_election.cc:343] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.309418 22174 raft_consensus.cc:359] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.310464 22174 raft_consensus.cc:385] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.310768 22174 raft_consensus.cc:740] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455049a553dd454891dbed4b8766d3b3, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.311646 22174 consensus_queue.cc:260] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.313942 22174 ts_tablet_manager.cc:1434] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:10.322414 22183 raft_consensus.cc:515] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.325135 22176 tablet_bootstrap.cc:492] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: No bootstrap required, opened a new log
I20260709 13:11:10.325845 22176 ts_tablet_manager.cc:1403] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.014s
I20260709 13:11:10.326215 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
I20260709 13:11:10.327071 22060 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.328935 22176 raft_consensus.cc:359] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.329705 22176 raft_consensus.cc:385] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.329952 22176 raft_consensus.cc:740] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.330663 22176 consensus_queue.cc:260] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.330991 22183 leader_election.cc:290] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 election: Requested vote from peers c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:10.333349 22176 ts_tablet_manager.cc:1434] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:10.331683 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3"
I20260709 13:11:10.335047 22134 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.335930 22060 raft_consensus.cc:2468] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 1.
I20260709 13:11:10.337380 21950 leader_election.cc:304] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aca6933986ba4e33b07563a6ad5c99b1, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:10.338461 22183 raft_consensus.cc:2804] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.338948 22183 raft_consensus.cc:697] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Becoming Leader. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Running, Role: LEADER
I20260709 13:11:10.339720 22183 consensus_queue.cc:237] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.341727 22134 raft_consensus.cc:2468] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 1.
I20260709 13:11:10.352306 21881 catalog_manager.cc:5697] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "aca6933986ba4e33b07563a6ad5c99b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.449877 22180 raft_consensus.cc:493] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.450532 22180 raft_consensus.cc:515] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.452797 22180 leader_election.cc:290] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:10.466235 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1" is_pre_election: true
I20260709 13:11:10.466643 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3" is_pre_election: true
I20260709 13:11:10.467200 21985 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 0.
I20260709 13:11:10.467576 22134 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 0.
I20260709 13:11:10.468766 22026 leader_election.cc:304] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aca6933986ba4e33b07563a6ad5c99b1, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:10.469698 22180 raft_consensus.cc:2804] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.470062 22180 raft_consensus.cc:493] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.470363 22180 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.475893 22180 raft_consensus.cc:515] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.477605 22180 leader_election.cc:290] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 1 election: Requested vote from peers aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:10.478657 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
I20260709 13:11:10.478839 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455049a553dd454891dbed4b8766d3b3"
I20260709 13:11:10.479228 21985 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.479588 22134 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.485410 21985 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 1.
I20260709 13:11:10.486096 22134 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 1.
I20260709 13:11:10.486792 22026 leader_election.cc:304] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aca6933986ba4e33b07563a6ad5c99b1, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:10.487762 22180 raft_consensus.cc:2804] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.488812 22180 raft_consensus.cc:697] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 LEADER]: Becoming Leader. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Running, Role: LEADER
I20260709 13:11:10.489611 22180 consensus_queue.cc:237] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.498071 21881 catalog_manager.cc:5697] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe reported cstate change: term changed from 0 to 1, leader changed from <none> to c6636a7bba6e43b28341fc74532e63fe (127.11.78.2). New cstate: current_term: 1 leader_uuid: "c6636a7bba6e43b28341fc74532e63fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.505910 22179 consensus_queue.cc:1048] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.526301 22179 consensus_queue.cc:1048] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.561668 22183 consensus_queue.cc:1048] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.562672 22188 consensus_queue.cc:1048] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.610764 22060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d"
dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
mode: GRACEFUL
new_leader_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
 from {username='slave'} at 127.0.0.1:48666
I20260709 13:11:10.611426 22060 raft_consensus.cc:606] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 LEADER]: Received request to transfer leadership to TS aca6933986ba4e33b07563a6ad5c99b1
I20260709 13:11:10.846226 22218 consensus_queue.cc:1048] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.859182 22218 consensus_queue.cc:1048] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.957959 22180 consensus_queue.cc:1048] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.966130 22208 raft_consensus.cc:993] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: : Instructing follower aca6933986ba4e33b07563a6ad5c99b1 to start an election
I20260709 13:11:10.967128 22180 raft_consensus.cc:1081] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 LEADER]: Signalling peer aca6933986ba4e33b07563a6ad5c99b1 to start an election
I20260709 13:11:10.969515 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d"
dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
 from {username='slave'} at 127.0.0.1:56886
I20260709 13:11:10.971006 21984 raft_consensus.cc:493] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.971490 21984 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.973039 22208 consensus_queue.cc:1048] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.979878 21984 raft_consensus.cc:515] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.982127 21984 leader_election.cc:290] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 2 election: Requested vote from peers c6636a7bba6e43b28341fc74532e63fe (127.11.78.2:45535), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:10.983325 22060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
I20260709 13:11:10.983956 22060 raft_consensus.cc:3055] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.984352 22060 raft_consensus.cc:740] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Running, Role: LEADER
I20260709 13:11:10.985230 22060 consensus_queue.cc:260] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:10.984468 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9246ba0821464eba6cf2269e046f8d" candidate_uuid: "aca6933986ba4e33b07563a6ad5c99b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455049a553dd454891dbed4b8766d3b3"
I20260709 13:11:10.986528 22060 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.986795 22134 raft_consensus.cc:3060] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.993607 22060 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 2.
I20260709 13:11:10.995208 22134 raft_consensus.cc:2468] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca6933986ba4e33b07563a6ad5c99b1 in term 2.
I20260709 13:11:10.995312 21950 leader_election.cc:304] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aca6933986ba4e33b07563a6ad5c99b1, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:10.998241 22218 raft_consensus.cc:2804] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.998803 22218 raft_consensus.cc:697] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 2 LEADER]: Becoming Leader. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Running, Role: LEADER
I20260709 13:11:10.999709 22218 consensus_queue.cc:237] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:11.007085 21881 catalog_manager.cc:5697] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 reported cstate change: term changed from 1 to 2, leader changed from c6636a7bba6e43b28341fc74532e63fe (127.11.78.2) to aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "aca6933986ba4e33b07563a6ad5c99b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.092628 11576 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:11:11.094441 11576 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:11:11.094877 11576 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:11:11.110975 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc"
dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
mode: GRACEFUL
new_leader_uuid: "c6636a7bba6e43b28341fc74532e63fe"
 from {username='slave'} at 127.0.0.1:56888
I20260709 13:11:11.111722 21984 raft_consensus.cc:606] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Received request to transfer leadership to TS c6636a7bba6e43b28341fc74532e63fe
I20260709 13:11:11.113289 11576 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:11:11.476580 22219 raft_consensus.cc:993] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: : Instructing follower c6636a7bba6e43b28341fc74532e63fe to start an election
I20260709 13:11:11.477200 22218 raft_consensus.cc:1081] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Signalling peer c6636a7bba6e43b28341fc74532e63fe to start an election
I20260709 13:11:11.479182 22060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc"
dest_uuid: "c6636a7bba6e43b28341fc74532e63fe"
 from {username='slave'} at 127.0.0.1:48636
I20260709 13:11:11.479993 22060 raft_consensus.cc:493] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.480440 22060 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.486297 22060 raft_consensus.cc:515] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:11.487996 22060 leader_election.cc:290] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 2 election: Requested vote from peers aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1:39425), 455049a553dd454891dbed4b8766d3b3 (127.11.78.3:40079)
I20260709 13:11:11.489167 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aca6933986ba4e33b07563a6ad5c99b1"
I20260709 13:11:11.489431 22134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d36cb99a1f418681c042303bbd50fc" candidate_uuid: "c6636a7bba6e43b28341fc74532e63fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455049a553dd454891dbed4b8766d3b3"
I20260709 13:11:11.489876 21984 raft_consensus.cc:3055] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.490235 22134 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.490284 21984 raft_consensus.cc:740] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aca6933986ba4e33b07563a6ad5c99b1, State: Running, Role: LEADER
I20260709 13:11:11.491287 21984 consensus_queue.cc:260] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:11.492370 21984 raft_consensus.cc:3060] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.496901 22134 raft_consensus.cc:2468] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 2.
I20260709 13:11:11.497534 21984 raft_consensus.cc:2468] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6636a7bba6e43b28341fc74532e63fe in term 2.
I20260709 13:11:11.498356 22023 leader_election.cc:304] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455049a553dd454891dbed4b8766d3b3, c6636a7bba6e43b28341fc74532e63fe; no voters: 
I20260709 13:11:11.499995 22234 raft_consensus.cc:2804] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.501180 22234 raft_consensus.cc:697] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 LEADER]: Becoming Leader. State: Replica: c6636a7bba6e43b28341fc74532e63fe, State: Running, Role: LEADER
I20260709 13:11:11.502034 22234 consensus_queue.cc:237] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } }
I20260709 13:11:11.509182 21881 catalog_manager.cc:5697] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe reported cstate change: term changed from 1 to 2, leader changed from aca6933986ba4e33b07563a6ad5c99b1 (127.11.78.1) to c6636a7bba6e43b28341fc74532e63fe (127.11.78.2). New cstate: current_term: 2 leader_uuid: "c6636a7bba6e43b28341fc74532e63fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca6933986ba4e33b07563a6ad5c99b1" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 39425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.558069 22134 raft_consensus.cc:1275] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Refusing update from remote peer aca6933986ba4e33b07563a6ad5c99b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.559888 22218 consensus_queue.cc:1048] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "455049a553dd454891dbed4b8766d3b3" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.570559 22060 raft_consensus.cc:1275] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Refusing update from remote peer aca6933986ba4e33b07563a6ad5c99b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.572461 22218 consensus_queue.cc:1048] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6636a7bba6e43b28341fc74532e63fe" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.751978 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:11:11.775521 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:11.776538 11576 tablet_replica.cc:333] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1: stopping tablet replica
I20260709 13:11:11.777287 11576 raft_consensus.cc:2243] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:11.778187 11576 raft_consensus.cc:2272] T ff9246ba0821464eba6cf2269e046f8d P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.780711 11576 tablet_replica.cc:333] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1: stopping tablet replica
I20260709 13:11:11.781255 11576 raft_consensus.cc:2243] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.781654 11576 raft_consensus.cc:2272] T c5d36cb99a1f418681c042303bbd50fc P aca6933986ba4e33b07563a6ad5c99b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.783960 11576 tablet_replica.cc:333] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1: stopping tablet replica
I20260709 13:11:11.784533 11576 raft_consensus.cc:2243] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.784961 11576 raft_consensus.cc:2272] T 3fb3e70789a64c0aac833a1e246fd77e P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.786682 11576 tablet_replica.cc:333] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1: stopping tablet replica
I20260709 13:11:11.787145 11576 raft_consensus.cc:2243] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:11.787935 11576 raft_consensus.cc:2272] T 2f162e0ab17948f793738a5619ca2043 P aca6933986ba4e33b07563a6ad5c99b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.812361 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
I20260709 13:11:11.828349 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
I20260709 13:11:11.853495 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:11.854353 11576 tablet_replica.cc:333] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: stopping tablet replica
I20260709 13:11:11.855050 11576 raft_consensus.cc:2243] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:11.855772 11576 pending_rounds.cc:70] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Trying to abort 1 pending ops.
I20260709 13:11:11.855993 11576 pending_rounds.cc:77] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636542479552512 op_type: NO_OP noop_request { }
I20260709 13:11:11.856438 11576 raft_consensus.cc:2889] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:11.856781 11576 raft_consensus.cc:2272] T c5d36cb99a1f418681c042303bbd50fc P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.859443 11576 tablet_replica.cc:333] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe: stopping tablet replica
I20260709 13:11:11.860096 11576 raft_consensus.cc:2243] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.860574 11576 raft_consensus.cc:2272] T ff9246ba0821464eba6cf2269e046f8d P c6636a7bba6e43b28341fc74532e63fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.863046 11576 tablet_replica.cc:333] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe: stopping tablet replica
I20260709 13:11:11.863629 11576 raft_consensus.cc:2243] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.864138 11576 raft_consensus.cc:2272] T 3fb3e70789a64c0aac833a1e246fd77e P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.866067 11576 tablet_replica.cc:333] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe: stopping tablet replica
I20260709 13:11:11.866556 11576 raft_consensus.cc:2243] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.867039 11576 raft_consensus.cc:2272] T 2f162e0ab17948f793738a5619ca2043 P c6636a7bba6e43b28341fc74532e63fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.890793 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
I20260709 13:11:11.903750 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
I20260709 13:11:11.925586 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:11.926316 11576 tablet_replica.cc:333] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3: stopping tablet replica
I20260709 13:11:11.926956 11576 raft_consensus.cc:2243] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.927415 11576 raft_consensus.cc:2272] T ff9246ba0821464eba6cf2269e046f8d P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.930155 11576 tablet_replica.cc:333] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3: stopping tablet replica
I20260709 13:11:11.930696 11576 raft_consensus.cc:2243] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.931097 11576 raft_consensus.cc:2272] T c5d36cb99a1f418681c042303bbd50fc P 455049a553dd454891dbed4b8766d3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.933254 11576 tablet_replica.cc:333] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3: stopping tablet replica
I20260709 13:11:11.933761 11576 raft_consensus.cc:2243] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:11.934574 11576 raft_consensus.cc:2272] T 3fb3e70789a64c0aac833a1e246fd77e P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.936606 11576 tablet_replica.cc:333] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3: stopping tablet replica
I20260709 13:11:11.937091 11576 raft_consensus.cc:2243] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:11.937463 11576 raft_consensus.cc:2272] T 2f162e0ab17948f793738a5619ca2043 P 455049a553dd454891dbed4b8766d3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.961385 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:11:11.974445 11576 master.cc:562] Master@127.11.78.62:46023 shutting down...
I20260709 13:11:11.996239 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:11.996822 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:11.997155 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P a1fa9ff569f6439889f7be4255f677e6: stopping tablet replica
I20260709 13:11:12.016845 11576 master.cc:584] Master@127.11.78.62:46023 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3109 ms)
[----------] 6 tests from LeaderRebalancerTest (325810 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:11:12.048949 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:41453
I20260709 13:11:12.050143 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:12.055884 22239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.056290 22240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.057678 22242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.059100 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:12.060220 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:12.060429 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:12.060601 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602672060583 us; error 0 us; skew 500 ppm
I20260709 13:11:12.061152 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:12.063674 11576 webserver.cc:533] Webserver started at http://127.11.78.62:35421/ using document root <none> and password file <none>
I20260709 13:11:12.064271 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:12.064481 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:12.064759 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:12.065812 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "36d0768454884987b731bd5818e2a14c"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.070801 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:11:12.074532 22247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.075465 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:12.075805 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "36d0768454884987b731bd5818e2a14c"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.076125 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:12.097682 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:12.098706 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:12.139793 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:41453
I20260709 13:11:12.139940 22298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:41453 every 8 connection(s)
I20260709 13:11:12.144308 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.156699 22299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: Bootstrap starting.
I20260709 13:11:12.162422 22299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.167238 22299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: No bootstrap required, opened a new log
I20260709 13:11:12.169811 22299 raft_consensus.cc:359] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER }
I20260709 13:11:12.170270 22299 raft_consensus.cc:385] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.170532 22299 raft_consensus.cc:740] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d0768454884987b731bd5818e2a14c, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.171298 22299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER }
I20260709 13:11:12.171876 22299 raft_consensus.cc:399] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:12.172132 22299 raft_consensus.cc:493] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:12.172497 22299 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.178443 22299 raft_consensus.cc:515] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER }
I20260709 13:11:12.179056 22299 leader_election.cc:304] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36d0768454884987b731bd5818e2a14c; no voters: 
I20260709 13:11:12.180454 22299 leader_election.cc:290] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:12.180984 22302 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.182507 22302 raft_consensus.cc:697] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 1 LEADER]: Becoming Leader. State: Replica: 36d0768454884987b731bd5818e2a14c, State: Running, Role: LEADER
I20260709 13:11:12.183226 22302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER }
I20260709 13:11:12.183975 22299 sys_catalog.cc:565] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:12.186275 22304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36d0768454884987b731bd5818e2a14c. Latest consensus state: current_term: 1 leader_uuid: "36d0768454884987b731bd5818e2a14c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER } }
I20260709 13:11:12.186276 22303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36d0768454884987b731bd5818e2a14c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d0768454884987b731bd5818e2a14c" member_type: VOTER } }
I20260709 13:11:12.187074 22304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:12.187179 22303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:12.191380 22307 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:12.196301 22307 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:12.202726 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:12.206355 22307 catalog_manager.cc:1383] Generated new cluster ID: fae2ee4956654b8f995cf9b09504ced2
I20260709 13:11:12.206667 22307 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:12.239941 22307 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:12.241307 22307 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:12.261018 22307 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: Generated new TSK 0
I20260709 13:11:12.261680 22307 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:12.270637 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:12.277346 22320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.278256 22321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.280484 22323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.282094 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:12.283288 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:12.283496 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:12.283638 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602672283625 us; error 0 us; skew 500 ppm
I20260709 13:11:12.284224 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:12.286937 11576 webserver.cc:533] Webserver started at http://127.11.78.1:44505/ using document root <none> and password file <none>
I20260709 13:11:12.287384 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:12.287552 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:12.287770 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:12.288920 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "36dad85592ac43e9bfad3ee2aced7296"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.293640 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:11:12.297358 22328 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.298343 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:11:12.298698 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "36dad85592ac43e9bfad3ee2aced7296"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.299001 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:12.320901 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:12.322088 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:12.323688 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:12.326157 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:12.326400 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.326674 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:12.326846 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.374075 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:36251
I20260709 13:11:12.374244 22390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:36251 every 8 connection(s)
I20260709 13:11:12.379041 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:12.387670 22396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.387668 22395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.396492 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:12.396584 22398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.397686 22391 heartbeater.cc:344] Connected to a master server at 127.11.78.62:41453
I20260709 13:11:12.398188 22391 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:12.398924 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:12.399252 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:12.399315 22391 heartbeater.cc:507] Master 127.11.78.62:41453 requested a full tablet report, sending...
I20260709 13:11:12.399525 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602672399505 us; error 0 us; skew 500 ppm
I20260709 13:11:12.400434 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:12.402196 22264 ts_manager.cc:194] Registered new tserver with Master: 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251)
I20260709 13:11:12.403502 11576 webserver.cc:533] Webserver started at http://127.11.78.2:37321/ using document root <none> and password file <none>
I20260709 13:11:12.404343 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:12.404568 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:12.404625 22264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57006
I20260709 13:11:12.404848 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:12.406369 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.411188 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:11:12.415393 22403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.416400 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:11:12.416762 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.417065 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:12.433145 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:12.434291 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:12.435817 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:12.438297 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:12.438525 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.438784 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:12.438956 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.485524 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:45955
I20260709 13:11:12.485713 22465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:45955 every 8 connection(s)
I20260709 13:11:12.490809 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:12.498600 22469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.500671 22470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.504312 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:12.505138 22472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.505306 22466 heartbeater.cc:344] Connected to a master server at 127.11.78.62:41453
I20260709 13:11:12.505838 22466 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:12.506595 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:12.506693 22466 heartbeater.cc:507] Master 127.11.78.62:41453 requested a full tablet report, sending...
W20260709 13:11:12.506968 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:12.507313 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602672507287 us; error 0 us; skew 500 ppm
I20260709 13:11:12.508132 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:12.509421 22264 ts_manager.cc:194] Registered new tserver with Master: b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:12.511080 22264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57010
I20260709 13:11:12.511477 11576 webserver.cc:533] Webserver started at http://127.11.78.3:38467/ using document root <none> and password file <none>
I20260709 13:11:12.512295 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:12.512643 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:12.512977 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:12.514333 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "898d51d3c83f4012b2188cf90191b4a4"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.519842 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:11:12.524514 22477 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.525722 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:12.526396 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "898d51d3c83f4012b2188cf90191b4a4"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-smzk"
I20260709 13:11:12.527011 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:12.547260 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:12.548791 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:12.550606 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:12.553443 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:12.553715 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.553995 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:12.554198 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.606350 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:34781
I20260709 13:11:12.606464 22539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:34781 every 8 connection(s)
I20260709 13:11:12.622447 22540 heartbeater.cc:344] Connected to a master server at 127.11.78.62:41453
I20260709 13:11:12.622942 22540 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:12.623690 22540 heartbeater.cc:507] Master 127.11.78.62:41453 requested a full tablet report, sending...
I20260709 13:11:12.625888 22264 ts_manager.cc:194] Registered new tserver with Master: 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:12.626741 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016572147s
I20260709 13:11:12.627331 22264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57026
I20260709 13:11:12.656466 22264 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57030:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:12.659461 22264 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:12.732239 22356 tablet_service.cc:1511] Processing CreateTablet for tablet 81500240a0fb40a9b2ffc5bd7faaa984 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:12.735158 22353 tablet_service.cc:1511] Processing CreateTablet for tablet 856926a8717f459a8d9d75ad0bedf155 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:12.733884 22356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81500240a0fb40a9b2ffc5bd7faaa984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.736357 22505 tablet_service.cc:1511] Processing CreateTablet for tablet 81500240a0fb40a9b2ffc5bd7faaa984 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:12.737288 22355 tablet_service.cc:1511] Processing CreateTablet for tablet 2cff88ddd5394d958dccc2033f8cba0f (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:12.738008 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81500240a0fb40a9b2ffc5bd7faaa984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.738831 22355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff88ddd5394d958dccc2033f8cba0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.735627 22354 tablet_service.cc:1511] Processing CreateTablet for tablet b386d438715d43ec90fa734ad1ad31e2 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:12.741787 22354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b386d438715d43ec90fa734ad1ad31e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.741964 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 2cff88ddd5394d958dccc2033f8cba0f (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:12.743464 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff88ddd5394d958dccc2033f8cba0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.746030 22353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856926a8717f459a8d9d75ad0bedf155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.747700 22352 tablet_service.cc:1511] Processing CreateTablet for tablet 7a564c9f1c7840cf8baec73c7bc4b357 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.749141 22351 tablet_service.cc:1511] Processing CreateTablet for tablet a0dc8ec80a4049a29c3fa6f65a33edb4 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.750839 22351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dc8ec80a4049a29c3fa6f65a33edb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.753219 22503 tablet_service.cc:1511] Processing CreateTablet for tablet b386d438715d43ec90fa734ad1ad31e2 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:12.753571 22502 tablet_service.cc:1511] Processing CreateTablet for tablet 856926a8717f459a8d9d75ad0bedf155 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:12.754804 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b386d438715d43ec90fa734ad1ad31e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.757309 22501 tablet_service.cc:1511] Processing CreateTablet for tablet 7a564c9f1c7840cf8baec73c7bc4b357 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.757659 22350 tablet_service.cc:1511] Processing CreateTablet for tablet 1179f88a74484ed195aa0bb2cef6ef3a (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.758878 22501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a564c9f1c7840cf8baec73c7bc4b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.759166 22350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1179f88a74484ed195aa0bb2cef6ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.760699 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856926a8717f459a8d9d75ad0bedf155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.761279 22352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a564c9f1c7840cf8baec73c7bc4b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.764743 22349 tablet_service.cc:1511] Processing CreateTablet for tablet f5d883b9af0946c580a79f7e9e9824b5 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.766350 22349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d883b9af0946c580a79f7e9e9824b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.770824 22348 tablet_service.cc:1511] Processing CreateTablet for tablet 341ea2ab9b194d0fbf85a6c43459d43e (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.770961 22500 tablet_service.cc:1511] Processing CreateTablet for tablet a0dc8ec80a4049a29c3fa6f65a33edb4 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.772446 22348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ea2ab9b194d0fbf85a6c43459d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.773981 22499 tablet_service.cc:1511] Processing CreateTablet for tablet 1179f88a74484ed195aa0bb2cef6ef3a (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.774387 22498 tablet_service.cc:1511] Processing CreateTablet for tablet f5d883b9af0946c580a79f7e9e9824b5 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.772603 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dc8ec80a4049a29c3fa6f65a33edb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.775947 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d883b9af0946c580a79f7e9e9824b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.776676 22499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1179f88a74484ed195aa0bb2cef6ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.778589 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 341ea2ab9b194d0fbf85a6c43459d43e (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.781244 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ea2ab9b194d0fbf85a6c43459d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.861960 22555 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:12.863168 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 81500240a0fb40a9b2ffc5bd7faaa984 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:12.864022 22556 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:12.864851 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81500240a0fb40a9b2ffc5bd7faaa984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.869225 22555 tablet_bootstrap.cc:654] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.869517 22430 tablet_service.cc:1511] Processing CreateTablet for tablet 2cff88ddd5394d958dccc2033f8cba0f (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:12.871052 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff88ddd5394d958dccc2033f8cba0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.872318 22426 tablet_service.cc:1511] Processing CreateTablet for tablet a0dc8ec80a4049a29c3fa6f65a33edb4 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.873945 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dc8ec80a4049a29c3fa6f65a33edb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.873734 22429 tablet_service.cc:1511] Processing CreateTablet for tablet b386d438715d43ec90fa734ad1ad31e2 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:12.875142 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b386d438715d43ec90fa734ad1ad31e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.876461 22427 tablet_service.cc:1511] Processing CreateTablet for tablet 7a564c9f1c7840cf8baec73c7bc4b357 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.877873 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a564c9f1c7840cf8baec73c7bc4b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.881326 22428 tablet_service.cc:1511] Processing CreateTablet for tablet 856926a8717f459a8d9d75ad0bedf155 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:12.882769 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856926a8717f459a8d9d75ad0bedf155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.886075 22425 tablet_service.cc:1511] Processing CreateTablet for tablet 1179f88a74484ed195aa0bb2cef6ef3a (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.872382 22556 tablet_bootstrap.cc:654] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.886168 22424 tablet_service.cc:1511] Processing CreateTablet for tablet f5d883b9af0946c580a79f7e9e9824b5 (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.889902 22424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d883b9af0946c580a79f7e9e9824b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.886606 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 341ea2ab9b194d0fbf85a6c43459d43e (DEFAULT_TABLE table=test-workload [id=4f82704524d0482e97956417fbf0ca29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.893772 22425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1179f88a74484ed195aa0bb2cef6ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.895617 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ea2ab9b194d0fbf85a6c43459d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.950812 22556 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:12.951483 22556 ts_tablet_manager.cc:1403] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.043s
I20260709 13:11:12.954710 22556 raft_consensus.cc:359] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:12.956347 22556 raft_consensus.cc:385] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.956697 22556 raft_consensus.cc:740] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.957679 22556 consensus_queue.cc:260] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:12.964864 22559 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:12.973706 22555 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:12.974444 22555 ts_tablet_manager.cc:1403] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.033s
I20260709 13:11:12.981205 22391 heartbeater.cc:499] Master 127.11.78.62:41453 was elected leader, sending a full tablet report...
I20260709 13:11:12.981537 22556 ts_tablet_manager.cc:1434] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.014s
I20260709 13:11:12.983040 22556 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:12.988757 22555 raft_consensus.cc:359] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:12.989702 22555 raft_consensus.cc:385] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.989766 22556 tablet_bootstrap.cc:654] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.990166 22555 raft_consensus.cc:740] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.991129 22555 consensus_queue.cc:260] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:12.985200 22559 tablet_bootstrap.cc:654] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.994135 22540 heartbeater.cc:499] Master 127.11.78.62:41453 was elected leader, sending a full tablet report...
I20260709 13:11:12.998499 22555 ts_tablet_manager.cc:1434] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:11:13.000061 22555 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.011380 22559 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.012271 22559 ts_tablet_manager.cc:1403] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.004s
I20260709 13:11:13.014000 22561 raft_consensus.cc:493] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.014814 22561 raft_consensus.cc:515] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.016649 22559 raft_consensus.cc:359] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.017906 22559 raft_consensus.cc:385] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.018316 22559 raft_consensus.cc:740] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.019420 22559 consensus_queue.cc:260] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.021265 22561 leader_election.cc:290] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.022248 22555 tablet_bootstrap.cc:654] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.028280 22555 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.028667 22556 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.029767 22556 ts_tablet_manager.cc:1403] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.047s	user 0.035s	sys 0.006s
I20260709 13:11:13.034153 22556 raft_consensus.cc:359] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.035246 22556 raft_consensus.cc:385] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.028901 22555 ts_tablet_manager.cc:1403] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 13:11:13.039888 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.040390 22555 raft_consensus.cc:359] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.041673 22555 raft_consensus.cc:385] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:13.041896 22481 leader_election.cc:343] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.042201 22555 raft_consensus.cc:740] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.035668 22556 raft_consensus.cc:740] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.044371 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.044935 22556 consensus_queue.cc:260] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.045653 22466 heartbeater.cc:499] Master 127.11.78.62:41453 was elected leader, sending a full tablet report...
I20260709 13:11:13.045974 22559 ts_tablet_manager.cc:1434] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.033s	user 0.022s	sys 0.006s
W20260709 13:11:13.046555 22480 leader_election.cc:343] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.047125 22480 leader_election.cc:304] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4; no voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.047870 22559 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.048440 22561 raft_consensus.cc:2749] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.043521 22555 consensus_queue.cc:260] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.053949 22556 ts_tablet_manager.cc:1434] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:11:13.054713 22559 tablet_bootstrap.cc:654] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.055406 22556 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.061478 22555 ts_tablet_manager.cc:1434] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:11:13.062698 22555 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.062973 22556 tablet_bootstrap.cc:654] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.067107 22560 raft_consensus.cc:493] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.067967 22560 raft_consensus.cc:515] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.070488 22555 tablet_bootstrap.cc:654] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.079607 22560 leader_election.cc:290] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.126340 22560 raft_consensus.cc:493] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.127113 22560 raft_consensus.cc:515] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.130101 22560 leader_election.cc:290] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.169332 22556 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.170184 22556 ts_tablet_manager.cc:1403] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.115s	user 0.041s	sys 0.071s
I20260709 13:11:13.170310 22555 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.170671 22559 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.171068 22555 ts_tablet_manager.cc:1403] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.109s	user 0.048s	sys 0.043s
I20260709 13:11:13.171269 22559 ts_tablet_manager.cc:1403] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.124s	user 0.048s	sys 0.070s
I20260709 13:11:13.173954 22556 raft_consensus.cc:359] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.175882 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.174289 22559 raft_consensus.cc:359] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.174863 22555 raft_consensus.cc:359] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.176864 22555 raft_consensus.cc:385] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.176704 22559 raft_consensus.cc:385] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.176342 22556 raft_consensus.cc:385] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.177680 22559 raft_consensus.cc:740] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.177865 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.178620 22556 raft_consensus.cc:740] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.178292 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.179194 22441 raft_consensus.cc:2468] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.179497 22559 consensus_queue.cc:260] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.179843 22556 consensus_queue.cc:260] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
W20260709 13:11:13.180651 22330 leader_election.cc:343] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.181970 22332 leader_election.cc:304] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.182298 22559 ts_tablet_manager.cc:1434] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:11:13.183005 22560 raft_consensus.cc:2804] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.183393 22560 raft_consensus.cc:493] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.175891 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.183740 22560 raft_consensus.cc:3060] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:13.183843 22332 leader_election.cc:343] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.177556 22555 raft_consensus.cc:740] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.185441 22556 ts_tablet_manager.cc:1434] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:13.185042 22555 consensus_queue.cc:260] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.186201 22514 raft_consensus.cc:2468] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.186546 22556 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.188331 22555 ts_tablet_manager.cc:1434] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 13:11:13.189431 22559 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.193771 22556 tablet_bootstrap.cc:654] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.196365 22559 tablet_bootstrap.cc:654] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:13.196461 22312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:13.193820 22560 raft_consensus.cc:515] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.199622 22330 leader_election.cc:304] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.200584 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.201315 22440 raft_consensus.cc:3060] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.221431 22555 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.224825 22560 leader_election.cc:290] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.225690 22560 raft_consensus.cc:2804] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.226178 22560 raft_consensus.cc:493] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.226565 22560 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.227897 22440 raft_consensus.cc:2468] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.234095 22332 leader_election.cc:304] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.235822 22575 raft_consensus.cc:2804] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.235901 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:13.237289 22575 raft_consensus.cc:697] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.238374 22575 consensus_queue.cc:237] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
W20260709 13:11:13.238864 22330 leader_election.cc:343] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.240288 22560 raft_consensus.cc:515] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.241726 22556 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.242283 22556 ts_tablet_manager.cc:1403] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.015s
I20260709 13:11:13.243685 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.243933 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:13.244176 22559 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.244663 22514 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.245082 22559 ts_tablet_manager.cc:1403] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.029s
W20260709 13:11:13.245398 22332 leader_election.cc:343] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.245229 22556 raft_consensus.cc:359] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.246356 22556 raft_consensus.cc:385] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.246681 22556 raft_consensus.cc:740] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.247447 22556 consensus_queue.cc:260] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.249236 22559 raft_consensus.cc:359] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.249990 22556 ts_tablet_manager.cc:1434] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:13.250720 22559 raft_consensus.cc:385] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.251302 22556 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.251358 22559 raft_consensus.cc:740] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.252211 22555 tablet_bootstrap.cc:654] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.252429 22514 raft_consensus.cc:2468] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.253127 22559 consensus_queue.cc:260] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.253871 22330 leader_election.cc:304] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.255160 22576 raft_consensus.cc:2804] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.256775 22559 ts_tablet_manager.cc:1434] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:13.258119 22559 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.259591 22556 tablet_bootstrap.cc:654] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.254419 22560 leader_election.cc:290] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.265290 22560 raft_consensus.cc:493] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.266237 22559 tablet_bootstrap.cc:654] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.266132 22560 raft_consensus.cc:515] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.270490 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
W20260709 13:11:13.272482 22332 leader_election.cc:343] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.278139 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:13.279997 22330 leader_election.cc:343] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.280681 22330 leader_election.cc:304] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.282714 22560 leader_election.cc:290] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.283792 22560 raft_consensus.cc:2749] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.286352 22262 catalog_manager.cc:5697] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.291857 22556 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.292706 22556 ts_tablet_manager.cc:1403] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.012s
I20260709 13:11:13.292732 22576 raft_consensus.cc:697] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.293830 22576 consensus_queue.cc:237] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.295993 22556 raft_consensus.cc:359] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.296764 22556 raft_consensus.cc:385] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.297061 22556 raft_consensus.cc:740] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.297919 22556 consensus_queue.cc:260] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.300913 22556 ts_tablet_manager.cc:1434] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:13.301319 22555 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.302024 22555 ts_tablet_manager.cc:1403] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.008s
I20260709 13:11:13.302373 22556 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.303171 22559 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.303848 22559 ts_tablet_manager.cc:1403] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.024s
I20260709 13:11:13.305470 22555 raft_consensus.cc:359] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.306349 22555 raft_consensus.cc:385] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.306654 22555 raft_consensus.cc:740] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.307668 22559 raft_consensus.cc:359] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.308717 22559 raft_consensus.cc:385] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.309129 22559 raft_consensus.cc:740] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.310325 22559 consensus_queue.cc:260] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.312594 22556 tablet_bootstrap.cc:654] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.315682 22559 ts_tablet_manager.cc:1434] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:13.317082 22559 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.327390 22556 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.325829 22555 consensus_queue.cc:260] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.329145 22556 ts_tablet_manager.cc:1403] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260709 13:11:13.330974 22555 ts_tablet_manager.cc:1434] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.005s
I20260709 13:11:13.332335 22559 tablet_bootstrap.cc:654] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.332557 22555 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.332370 22556 raft_consensus.cc:359] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.333710 22556 raft_consensus.cc:385] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.334038 22556 raft_consensus.cc:740] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.335040 22556 consensus_queue.cc:260] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.337757 22556 ts_tablet_manager.cc:1434] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:13.340718 22556 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.340740 22555 tablet_bootstrap.cc:654] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.346777 22559 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.332667 22565 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.347307 22576 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.347499 22559 ts_tablet_manager.cc:1403] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.015s
I20260709 13:11:13.347929 22565 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.348184 22576 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.352250 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.352522 22576 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.353046 22440 raft_consensus.cc:2468] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.353477 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.355340 22332 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.356320 22556 tablet_bootstrap.cc:654] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:13.356772 22330 leader_election.cc:343] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.357788 22576 raft_consensus.cc:2804] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.358256 22576 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.358609 22576 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.364464 22565 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.355273 22559 raft_consensus.cc:359] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.375874 22559 raft_consensus.cc:385] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.376981 22559 raft_consensus.cc:740] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.379127 22556 tablet_bootstrap.cc:492] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.379765 22556 ts_tablet_manager.cc:1403] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.014s
I20260709 13:11:13.380442 22576 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.382989 22556 raft_consensus.cc:359] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.383829 22556 raft_consensus.cc:385] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.384199 22556 raft_consensus.cc:740] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.384431 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.385129 22440 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.384960 22556 consensus_queue.cc:260] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.387396 22556 ts_tablet_manager.cc:1434] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:11:13.379211 22559 consensus_queue.cc:260] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.390472 22559 ts_tablet_manager.cc:1434] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:11:13.391554 22559 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.392935 22264 catalog_manager.cc:5697] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.395306 22556 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.398298 22559 tablet_bootstrap.cc:654] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.403893 22555 tablet_bootstrap.cc:492] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.404544 22555 ts_tablet_manager.cc:1403] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.013s
I20260709 13:11:13.406469 22556 tablet_bootstrap.cc:654] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.422741 22440 raft_consensus.cc:2468] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.424274 22332 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.423969 22555 raft_consensus.cc:359] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.424980 22555 raft_consensus.cc:385] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.425463 22578 raft_consensus.cc:2804] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.427930 22578 raft_consensus.cc:697] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.428946 22578 consensus_queue.cc:237] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.431834 22576 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.433710 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
W20260709 13:11:13.435565 22330 leader_election.cc:343] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.431603 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.436767 22559 tablet_bootstrap.cc:492] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.437718 22559 ts_tablet_manager.cc:1403] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.027s
W20260709 13:11:13.438639 22405 leader_election.cc:343] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.439479 22555 raft_consensus.cc:740] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.442458 22559 raft_consensus.cc:359] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.443074 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.443743 22559 raft_consensus.cc:385] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.444309 22559 raft_consensus.cc:740] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.446228 22406 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.447880 22555 consensus_queue.cc:260] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.445609 22559 consensus_queue.cc:260] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.448921 22565 raft_consensus.cc:2749] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.455727 22261 catalog_manager.cc:5697] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.464761 22555 ts_tablet_manager.cc:1434] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:11:13.469254 22555 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.472019 22559 ts_tablet_manager.cc:1434] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.005s
I20260709 13:11:13.475102 22559 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.476554 22556 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.477180 22556 ts_tablet_manager.cc:1403] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.082s	user 0.048s	sys 0.021s
I20260709 13:11:13.470839 22578 raft_consensus.cc:493] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.478116 22578 raft_consensus.cc:515] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.480258 22556 raft_consensus.cc:359] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.481040 22556 raft_consensus.cc:385] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.481264 22561 raft_consensus.cc:493] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.482040 22559 tablet_bootstrap.cc:654] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.481832 22561 raft_consensus.cc:515] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.485132 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.485387 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.485920 22440 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.486032 22555 tablet_bootstrap.cc:654] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:13.487681 22480 leader_election.cc:343] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.487841 22332 leader_election.cc:304] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.488948 22576 raft_consensus.cc:2804] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.489463 22576 raft_consensus.cc:493] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.489959 22576 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.490768 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.491780 22559 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.492468 22559 ts_tablet_manager.cc:1403] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:11:13.492647 22555 tablet_bootstrap.cc:492] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.493207 22555 ts_tablet_manager.cc:1403] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 13:11:13.494486 22561 leader_election.cc:290] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.491488 22440 raft_consensus.cc:2468] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:13.495707 22575 raft_consensus.cc:493] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.496271 22575 raft_consensus.cc:515] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.496732 22481 leader_election.cc:304] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:13.496492 22559 raft_consensus.cc:359] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.497838 22559 raft_consensus.cc:385] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.498210 22559 raft_consensus.cc:740] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.498371 22561 raft_consensus.cc:2804] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.498632 22575 leader_election.cc:290] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.498817 22561 raft_consensus.cc:493] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.499027 22578 leader_election.cc:290] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.499403 22561 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.481323 22556 raft_consensus.cc:740] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.499306 22559 consensus_queue.cc:260] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.500603 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.500950 22556 consensus_queue.cc:260] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.502023 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.502698 22515 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.504079 22330 leader_election.cc:304] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:13.501317 22514 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.506212 22556 ts_tablet_manager.cc:1434] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:11:13.507335 22556 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:13.507419 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.507704 22561 raft_consensus.cc:515] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.508424 22440 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.507731 22578 raft_consensus.cc:2804] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.510746 22578 raft_consensus.cc:493] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.511142 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
W20260709 13:11:13.512856 22480 leader_election.cc:343] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.514611 22556 tablet_bootstrap.cc:654] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.514703 22555 raft_consensus.cc:359] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.511145 22578 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.515794 22555 raft_consensus.cc:385] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.516340 22555 raft_consensus.cc:740] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.517218 22555 consensus_queue.cc:260] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.523378 22559 ts_tablet_manager.cc:1434] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:11:13.514848 22576 raft_consensus.cc:515] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.526892 22555 ts_tablet_manager.cc:1434] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 13:11:13.527956 22559 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.529117 22578 raft_consensus.cc:515] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.530970 22576 leader_election.cc:290] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.533403 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.534363 22440 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.536623 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:13.537546 22514 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.539758 22559 tablet_bootstrap.cc:654] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.542263 22555 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.543021 22561 leader_election.cc:290] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.545531 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.546622 22441 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.552525 22555 tablet_bootstrap.cc:654] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.553911 22559 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.554502 22559 ts_tablet_manager.cc:1403] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.011s
I20260709 13:11:13.557909 22559 raft_consensus.cc:359] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.559015 22559 raft_consensus.cc:385] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.559425 22559 raft_consensus.cc:740] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.560549 22559 consensus_queue.cc:260] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.567373 22559 ts_tablet_manager.cc:1434] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:13.568890 22559 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:13.572443 22576 raft_consensus.cc:493] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.572840 22561 raft_consensus.cc:493] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.573004 22576 raft_consensus.cc:515] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.574038 22561 raft_consensus.cc:515] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.575783 22576 leader_election.cc:290] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.578099 22439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.579223 22439 raft_consensus.cc:2468] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.581274 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:13.583142 22330 leader_election.cc:343] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.584208 22332 leader_election.cc:304] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.585446 22555 tablet_bootstrap.cc:492] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.586079 22555 ts_tablet_manager.cc:1403] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.008s
I20260709 13:11:13.586010 22576 raft_consensus.cc:2804] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.587046 22576 raft_consensus.cc:493] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.587546 22559 tablet_bootstrap.cc:654] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.587517 22576 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.589680 22555 raft_consensus.cc:359] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.590487 22555 raft_consensus.cc:385] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.590857 22555 raft_consensus.cc:740] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.592022 22555 consensus_queue.cc:260] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.603667 22439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.604660 22439 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.605453 22555 ts_tablet_manager.cc:1434] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:11:13.610499 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:13.611416 22515 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.616462 22555 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.623224 22515 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.626574 22555 tablet_bootstrap.cc:654] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.630849 22559 tablet_bootstrap.cc:492] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:13.631546 22559 ts_tablet_manager.cc:1403] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.019s
I20260709 13:11:13.634756 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.635372 22576 raft_consensus.cc:515] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.635746 22559 raft_consensus.cc:359] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.636546 22559 raft_consensus.cc:385] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.636894 22559 raft_consensus.cc:740] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.637734 22556 tablet_bootstrap.cc:492] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:13.637809 22576 leader_election.cc:290] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.637738 22559 consensus_queue.cc:260] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.639066 22556 ts_tablet_manager.cc:1403] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.132s	user 0.048s	sys 0.073s
I20260709 13:11:13.638892 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:13.639600 22513 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.641191 22559 ts_tablet_manager.cc:1434] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:13.642350 22556 raft_consensus.cc:359] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.644780 22556 raft_consensus.cc:385] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.645120 22556 raft_consensus.cc:740] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.645445 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.646142 22438 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.645884 22556 consensus_queue.cc:260] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.649684 22440 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.649863 22513 raft_consensus.cc:2468] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.651434 22330 leader_election.cc:304] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:13.652129 22578 leader_election.cc:290] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.653910 22556 ts_tablet_manager.cc:1434] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:11:13.656803 22576 raft_consensus.cc:2804] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.657430 22576 raft_consensus.cc:697] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.657581 22439 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.658528 22332 leader_election.cc:304] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.658399 22576 consensus_queue.cc:237] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:13.654027 22561 leader_election.cc:290] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.659646 22332 leader_election.cc:304] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:13.660482 22575 raft_consensus.cc:2804] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.661239 22514 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.661367 22560 raft_consensus.cc:2804] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.663303 22575 raft_consensus.cc:697] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.663475 22604 consensus_queue.cc:1048] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.664362 22575 consensus_queue.cc:237] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.664598 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b386d438715d43ec90fa734ad1ad31e2" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.665835 22440 raft_consensus.cc:2393] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 898d51d3c83f4012b2188cf90191b4a4 in current term 1: Already voted for candidate 36dad85592ac43e9bfad3ee2aced7296 in this term.
I20260709 13:11:13.656236 22438 raft_consensus.cc:2468] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.656476 22555 tablet_bootstrap.cc:492] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.667150 22481 leader_election.cc:304] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4; no voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.667570 22555 ts_tablet_manager.cc:1403] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 13:11:13.671347 22555 raft_consensus.cc:359] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.672117 22555 raft_consensus.cc:385] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.672413 22555 raft_consensus.cc:740] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.673245 22555 consensus_queue.cc:260] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.674450 22564 raft_consensus.cc:3060] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.682327 22555 ts_tablet_manager.cc:1434] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:13.682873 22564 raft_consensus.cc:2749] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.683528 22555 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:13.684986 22441 raft_consensus.cc:2468] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:13.681380 22261 catalog_manager.cc:5697] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.686443 22481 leader_election.cc:304] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:13.687837 22561 raft_consensus.cc:2804] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.688493 22561 raft_consensus.cc:697] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:13.689481 22561 consensus_queue.cc:237] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.692631 22555 tablet_bootstrap.cc:654] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.696187 22560 raft_consensus.cc:697] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.700111 22605 raft_consensus.cc:493] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.700984 22605 raft_consensus.cc:515] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.706094 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.709061 22440 raft_consensus.cc:2468] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:13.707890 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:13.711959 22330 leader_election.cc:343] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.713429 22332 leader_election.cc:304] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.703977 22605 leader_election.cc:290] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.715495 22605 raft_consensus.cc:2804] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.716002 22605 raft_consensus.cc:493] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.716485 22605 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.726033 22560 consensus_queue.cc:237] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.732306 22578 consensus_queue.cc:1048] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.747768 22261 catalog_manager.cc:5697] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.749856 22261 catalog_manager.cc:5697] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.751981 22605 raft_consensus.cc:515] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.756237 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.757103 22440 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.759251 22262 catalog_manager.cc:5697] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.761053 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
W20260709 13:11:13.762558 22330 leader_election.cc:343] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.763476 22605 leader_election.cc:290] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.767271 22440 raft_consensus.cc:2468] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:13.768671 22332 leader_election.cc:304] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.769593 22555 tablet_bootstrap.cc:492] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:13.769840 22578 raft_consensus.cc:2804] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.770128 22555 ts_tablet_manager.cc:1403] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.087s	user 0.032s	sys 0.032s
I20260709 13:11:13.770341 22578 raft_consensus.cc:697] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.771286 22578 consensus_queue.cc:237] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.773934 22555 raft_consensus.cc:359] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.774677 22555 raft_consensus.cc:385] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.774926 22555 raft_consensus.cc:740] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.775555 22555 consensus_queue.cc:260] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.777113 22564 raft_consensus.cc:493] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.777571 22564 raft_consensus.cc:515] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.777902 22555 ts_tablet_manager.cc:1434] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:13.779713 22564 leader_election.cc:290] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.780452 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.781240 22366 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:13.782549 22480 leader_election.cc:304] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:13.782670 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.783341 22438 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:13.783438 22564 raft_consensus.cc:2804] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.783867 22564 raft_consensus.cc:493] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.784363 22564 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.790230 22564 raft_consensus.cc:515] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.792112 22564 leader_election.cc:290] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.792861 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:13.793331 22366 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.795405 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.796277 22438 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.800474 22366 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:13.802385 22480 leader_election.cc:304] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:13.803287 22564 raft_consensus.cc:2804] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.803869 22564 raft_consensus.cc:697] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:13.804849 22438 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:13.804812 22564 consensus_queue.cc:237] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.806015 22262 catalog_manager.cc:5697] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.813570 22578 consensus_queue.cc:1048] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.815085 22264 catalog_manager.cc:5697] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.824800 22438 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.832901 22578 consensus_queue.cc:1048] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.890396 22515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:13.891135 22515 raft_consensus.cc:606] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:13.901506 22515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:13.902123 22515 raft_consensus.cc:606] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:13.915575 22366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:13.916141 22366 raft_consensus.cc:606] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.916710 22578 raft_consensus.cc:493] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.917268 22578 raft_consensus.cc:515] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.919404 22578 leader_election.cc:290] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:13.919777 22515 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.920632 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:13.922377 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.923065 22438 raft_consensus.cc:2393] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dad85592ac43e9bfad3ee2aced7296 in current term 1: Already voted for candidate 898d51d3c83f4012b2188cf90191b4a4 in this term.
I20260709 13:11:13.923000 22366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:13.923753 22366 raft_consensus.cc:606] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.924368 22332 leader_election.cc:304] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.925169 22578 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.928205 22564 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.928793 22564 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.930354 22366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:13.931093 22366 raft_consensus.cc:606] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.932633 22578 raft_consensus.cc:2749] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.934252 22564 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.935338 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:13.935653 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:13.936363 22438 raft_consensus.cc:2468] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:13.937520 22481 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:13.938359 22564 raft_consensus.cc:2804] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:13.938401 22578 consensus_queue.cc:1048] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.938854 22564 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.939284 22366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:13.939399 22564 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.939890 22366 raft_consensus.cc:606] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.946106 22578 consensus_queue.cc:1048] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.946225 22366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:13.946969 22366 raft_consensus.cc:606] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:13.947358 22564 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.948853 22515 raft_consensus.cc:1240] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Rejecting Update request from peer 36dad85592ac43e9bfad3ee2aced7296 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:11:13.952237 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:13.952857 22578 consensus_queue.cc:1059] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.953764 22560 raft_consensus.cc:3055] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.954166 22560 raft_consensus.cc:740] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:13.955329 22564 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:13.955121 22560 consensus_queue.cc:260] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:13.956599 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:13.958035 22481 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4; no voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:13.958817 22564 raft_consensus.cc:2749] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:13.960417 22560 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.045780 22560 consensus_queue.cc:1048] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.054133 22564 raft_consensus.cc:493] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.054636 22564 raft_consensus.cc:515] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.059944 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:14.060639 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:14.061569 22440 raft_consensus.cc:2393] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 898d51d3c83f4012b2188cf90191b4a4 in current term 1: Already voted for candidate 36dad85592ac43e9bfad3ee2aced7296 in this term.
I20260709 13:11:14.060074 22564 leader_election.cc:290] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:14.063143 22481 leader_election.cc:304] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4; no voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:14.063175 22578 consensus_queue.cc:1048] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.064471 22564 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.071478 22560 raft_consensus.cc:993] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.072119 22578 raft_consensus.cc:1081] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.072435 22564 raft_consensus.cc:2749] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.074170 22440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:56584
I20260709 13:11:14.074810 22440 raft_consensus.cc:493] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.075130 22440 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.080374 22578 consensus_queue.cc:1048] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.082147 22440 raft_consensus.cc:515] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.085563 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:14.085604 22440 leader_election.cc:290] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:14.086134 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d883b9af0946c580a79f7e9e9824b5" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:14.086303 22366 raft_consensus.cc:3055] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.087387 22366 raft_consensus.cc:740] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.088249 22366 consensus_queue.cc:260] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.089629 22366 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.086905 22514 raft_consensus.cc:3060] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.100735 22604 consensus_queue.cc:1048] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.105832 22366 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:14.105832 22514 raft_consensus.cc:2468] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:14.107302 22406 leader_election.cc:304] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:14.108279 22595 raft_consensus.cc:2804] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.112403 22595 raft_consensus.cc:697] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:14.113341 22595 consensus_queue.cc:237] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.123700 22264 catalog_manager.cc:5697] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 2 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.143069 22564 consensus_queue.cc:1048] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.150400 22561 raft_consensus.cc:993] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:14.152102 22561 raft_consensus.cc:1081] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:14.154620 22366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51910
I20260709 13:11:14.155263 22366 raft_consensus.cc:493] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.155663 22366 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.159003 22628 consensus_queue.cc:1048] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.163738 22578 consensus_queue.cc:1048] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.164427 22366 raft_consensus.cc:515] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.168578 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:14.173368 22576 raft_consensus.cc:993] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:14.173915 22576 raft_consensus.cc:1081] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:14.175084 22366 leader_election.cc:290] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:14.176940 22515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:11:14.178138 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cff88ddd5394d958dccc2033f8cba0f" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:14.178767 22513 raft_consensus.cc:3055] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.179113 22513 raft_consensus.cc:740] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:14.180015 22513 consensus_queue.cc:260] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.181300 22515 raft_consensus.cc:493] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.181819 22515 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.182078 22576 consensus_queue.cc:1048] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.181290 22513 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.191792 22515 raft_consensus.cc:515] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.195206 22513 raft_consensus.cc:2468] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:14.196537 22515 leader_election.cc:290] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:14.197816 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:14.198501 22366 raft_consensus.cc:3055] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.198967 22366 raft_consensus.cc:740] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.198369 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ea2ab9b194d0fbf85a6c43459d43e" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:14.200886 22366 consensus_queue.cc:260] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.201953 22366 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.204717 22330 leader_election.cc:304] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:14.206983 22576 raft_consensus.cc:2804] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.207870 22576 raft_consensus.cc:697] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.208935 22576 consensus_queue.cc:237] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.213964 22366 raft_consensus.cc:2468] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:14.215438 22480 leader_election.cc:304] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:14.216853 22628 raft_consensus.cc:2804] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.217319 22628 raft_consensus.cc:697] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:14.218055 22628 consensus_queue.cc:237] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.218195 22261 catalog_manager.cc:5697] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 1 to 2, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.226289 22264 catalog_manager.cc:5697] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.288985 22628 consensus_queue.cc:1048] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.296774 22561 raft_consensus.cc:993] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:14.297326 22564 raft_consensus.cc:1081] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:14.299216 22365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51910
I20260709 13:11:14.301879 22365 raft_consensus.cc:493] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.302351 22365 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.307206 22604 raft_consensus.cc:993] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.307821 22605 raft_consensus.cc:1081] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.308502 22628 consensus_queue.cc:1048] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.310161 22440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:56584
I20260709 13:11:14.310824 22440 raft_consensus.cc:493] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.311789 22440 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.311473 22365 raft_consensus.cc:515] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.325433 22440 raft_consensus.cc:515] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.325636 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:14.326498 22438 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.327092 22605 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.327831 22440 leader_election.cc:290] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:14.329243 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:14.329942 22513 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.329077 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dc8ec80a4049a29c3fa6f65a33edb4" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:14.330693 22366 raft_consensus.cc:3055] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.331209 22366 raft_consensus.cc:740] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.332437 22366 consensus_queue.cc:260] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.333840 22366 raft_consensus.cc:3060] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.338184 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856926a8717f459a8d9d75ad0bedf155" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:14.338762 22513 raft_consensus.cc:2468] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:14.339210 22514 raft_consensus.cc:3055] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.339758 22514 raft_consensus.cc:740] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:14.340687 22514 consensus_queue.cc:260] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.341948 22514 raft_consensus.cc:3060] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.342298 22605 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.344498 22405 leader_election.cc:304] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:14.345453 22595 raft_consensus.cc:2804] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.345943 22595 raft_consensus.cc:697] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:14.346256 22365 leader_election.cc:290] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:14.346812 22595 consensus_queue.cc:237] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.349606 22366 raft_consensus.cc:2468] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:14.350519 22438 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:14.353111 22332 leader_election.cc:304] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:14.354112 22576 raft_consensus.cc:2804] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.354665 22576 raft_consensus.cc:697] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.355597 22576 consensus_queue.cc:237] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.362365 22514 raft_consensus.cc:2468] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:14.368956 22578 raft_consensus.cc:993] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.369519 22605 raft_consensus.cc:1081] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:14.371495 22440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:56584
I20260709 13:11:14.372339 22440 raft_consensus.cc:493] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.372821 22440 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.373483 22261 catalog_manager.cc:5697] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 1 to 2, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.376276 22262 catalog_manager.cc:5697] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 2 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.383507 22440 raft_consensus.cc:515] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.384776 22438 raft_consensus.cc:1240] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Rejecting Update request from peer 36dad85592ac43e9bfad3ee2aced7296 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:14.387110 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:14.387102 22576 consensus_queue.cc:1059] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.388201 22366 raft_consensus.cc:3055] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.388561 22366 raft_consensus.cc:740] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:14.389864 22440 leader_election.cc:290] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:14.390059 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:14.389487 22366 consensus_queue.cc:260] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.390838 22514 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.391592 22366 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.398694 22514 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:14.398753 22366 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
W20260709 13:11:14.399938 22576 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:14.400215 22405 leader_election.cc:304] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:14.401263 22625 raft_consensus.cc:2804] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.401764 22625 raft_consensus.cc:697] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:14.402540 22625 consensus_queue.cc:237] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:14.409955 22261 catalog_manager.cc:5697] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 2 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.501158 22366 raft_consensus.cc:1275] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.503044 22625 consensus_queue.cc:1048] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.513604 22515 raft_consensus.cc:1275] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.515946 22626 consensus_queue.cc:1048] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.642890 22366 raft_consensus.cc:1275] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.644381 22628 consensus_queue.cc:1048] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.653870 22440 raft_consensus.cc:3060] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.662114 22440 raft_consensus.cc:1275] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.663705 22564 consensus_queue.cc:1048] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.714686 22514 raft_consensus.cc:1275] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.716500 22576 consensus_queue.cc:1048] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.724969 22440 raft_consensus.cc:3060] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.732699 22440 raft_consensus.cc:1275] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.734282 22605 consensus_queue.cc:1048] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.794169 22514 raft_consensus.cc:1275] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.795960 22626 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.805737 22366 raft_consensus.cc:1275] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.807542 22625 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.811673 22514 raft_consensus.cc:1275] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.816329 22625 consensus_queue.cc:1048] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.826586 22366 raft_consensus.cc:1275] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.828163 22595 consensus_queue.cc:1048] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.878777 22440 raft_consensus.cc:1275] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.880609 22605 consensus_queue.cc:1048] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.890141 22514 raft_consensus.cc:1275] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.892683 22604 consensus_queue.cc:1048] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:15.450924 22626 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dad85592ac43e9bfad3ee2aced7296)
I20260709 13:11:15.451535 22626 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:15.453601 22626 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:15.455034 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:15.455034 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:15.456422 22514 raft_consensus.cc:2393] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b361ecda55dd4d19b23d48e52f5f3c7e in current term 2: Already voted for candidate 898d51d3c83f4012b2188cf90191b4a4 in this term.
I20260709 13:11:15.456254 22365 raft_consensus.cc:2468] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:15.457940 22406 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:15.458827 22626 raft_consensus.cc:2804] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:15.459276 22626 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36dad85592ac43e9bfad3ee2aced7296)
I20260709 13:11:15.459587 22626 raft_consensus.cc:3060] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.466153 22626 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:15.468443 22626 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:15.469177 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:15.469830 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:15.470592 22514 raft_consensus.cc:2393] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b361ecda55dd4d19b23d48e52f5f3c7e in current term 2: Already voted for candidate 898d51d3c83f4012b2188cf90191b4a4 in this term.
I20260709 13:11:15.474843 22365 raft_consensus.cc:2468] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:15.476071 22406 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:15.476760 22626 raft_consensus.cc:2804] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:15.477190 22626 raft_consensus.cc:697] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:15.478013 22626 consensus_queue.cc:237] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:15.484755 22264 catalog_manager.cc:5697] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 2 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.926542 22638 raft_consensus.cc:493] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.927290 22638 raft_consensus.cc:515] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:15.930419 22638 leader_election.cc:290] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:15.931161 22514 raft_consensus.cc:1275] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:15.931347 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:15.931929 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a564c9f1c7840cf8baec73c7bc4b357" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:15.932492 22365 raft_consensus.cc:2410] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 898d51d3c83f4012b2188cf90191b4a4 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:11:15.933868 22626 consensus_queue.cc:1048] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:15.934394 22481 leader_election.cc:304] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4; no voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:15.935376 22638 raft_consensus.cc:2749] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:15.953080 22365 raft_consensus.cc:1275] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:15.954595 22647 consensus_queue.cc:1048] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:16.986052 22264 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57032:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:16.989588 22264 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:17.054816 22355 tablet_service.cc:1511] Processing CreateTablet for tablet b2acf583f5f84a4abe788f2659477953 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:17.056375 22426 tablet_service.cc:1511] Processing CreateTablet for tablet b2acf583f5f84a4abe788f2659477953 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:17.057174 22355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2acf583f5f84a4abe788f2659477953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.058276 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2acf583f5f84a4abe788f2659477953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.057873 22497 tablet_service.cc:1511] Processing CreateTablet for tablet b2acf583f5f84a4abe788f2659477953 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:17.059901 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2acf583f5f84a4abe788f2659477953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.063622 22423 tablet_service.cc:1511] Processing CreateTablet for tablet ed21523595444224b0e33d58706b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:17.065469 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed21523595444224b0e33d58706b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.063623 22356 tablet_service.cc:1511] Processing CreateTablet for tablet ed21523595444224b0e33d58706b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:17.071300 22356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed21523595444224b0e33d58706b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.073583 22350 tablet_service.cc:1511] Processing CreateTablet for tablet ed972efc29854a5cafb708f4574b8e55 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:17.075362 22350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed972efc29854a5cafb708f4574b8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.078016 22428 tablet_service.cc:1511] Processing CreateTablet for tablet ed972efc29854a5cafb708f4574b8e55 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:17.079756 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed972efc29854a5cafb708f4574b8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.081940 22352 tablet_service.cc:1511] Processing CreateTablet for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:17.082273 22502 tablet_service.cc:1511] Processing CreateTablet for tablet ed21523595444224b0e33d58706b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:17.082957 22505 tablet_service.cc:1511] Processing CreateTablet for tablet ed972efc29854a5cafb708f4574b8e55 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:17.083662 22352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.083880 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed21523595444224b0e33d58706b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.084666 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed972efc29854a5cafb708f4574b8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.106771 22424 tablet_service.cc:1511] Processing CreateTablet for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:17.108325 22424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.122942 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:17.123335 22349 tablet_service.cc:1511] Processing CreateTablet for tablet 6cce7828b6c042f683a1fbf25553f9a9 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:17.124531 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e411ea2dc2e40d8bcd77e9329f5d95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.124560 22349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cce7828b6c042f683a1fbf25553f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.151804 22425 tablet_service.cc:1511] Processing CreateTablet for tablet 6cce7828b6c042f683a1fbf25553f9a9 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:17.153342 22425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cce7828b6c042f683a1fbf25553f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.161453 22663 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.183980 22500 tablet_service.cc:1511] Processing CreateTablet for tablet 6cce7828b6c042f683a1fbf25553f9a9 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:17.185353 22356 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4ea5df3fdb4b86be5596f6927313d5 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:17.185905 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cce7828b6c042f683a1fbf25553f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.186836 22356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4ea5df3fdb4b86be5596f6927313d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.189739 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4ea5df3fdb4b86be5596f6927313d5 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:17.196095 22355 tablet_service.cc:1511] Processing CreateTablet for tablet 15e614ef73b84786b4df436b6efb2a14 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:17.198318 22502 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4ea5df3fdb4b86be5596f6927313d5 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:17.238689 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4ea5df3fdb4b86be5596f6927313d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.237368 22355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e614ef73b84786b4df436b6efb2a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.243299 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4ea5df3fdb4b86be5596f6927313d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.246320 22664 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.258045 22665 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.215792 22663 tablet_bootstrap.cc:654] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:17.264060 22251 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.78.2:45955, user_credentials={real_user=slave}} blocked reactor thread for 55351.9us
W20260709 13:11:17.265233 22312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:17.270494 22500 tablet_service.cc:1511] Processing CreateTablet for tablet 15e614ef73b84786b4df436b6efb2a14 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:17.272243 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e614ef73b84786b4df436b6efb2a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.272490 22664 tablet_bootstrap.cc:654] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.270772 22426 tablet_service.cc:1511] Processing CreateTablet for tablet 15e614ef73b84786b4df436b6efb2a14 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:17.274003 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e614ef73b84786b4df436b6efb2a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.289851 22349 tablet_service.cc:1511] Processing CreateTablet for tablet b81c8b60fc4144f1a7d8a87370175ec8 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:17.291546 22349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81c8b60fc4144f1a7d8a87370175ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.293366 22665 tablet_bootstrap.cc:654] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.296391 22425 tablet_service.cc:1511] Processing CreateTablet for tablet b81c8b60fc4144f1a7d8a87370175ec8 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:17.310422 22425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81c8b60fc4144f1a7d8a87370175ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.316586 22502 tablet_service.cc:1511] Processing CreateTablet for tablet b81c8b60fc4144f1a7d8a87370175ec8 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:17.318118 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81c8b60fc4144f1a7d8a87370175ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.318713 22355 tablet_service.cc:1511] Processing CreateTablet for tablet 9c989e05630b4961a1e2791ac93ddab4 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:17.327716 22355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c989e05630b4961a1e2791ac93ddab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.330996 22663 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.331669 22663 ts_tablet_manager.cc:1403] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.171s	user 0.009s	sys 0.030s
I20260709 13:11:17.335162 22663 raft_consensus.cc:359] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.336145 22663 raft_consensus.cc:385] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.336447 22663 raft_consensus.cc:740] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.337287 22663 consensus_queue.cc:260] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.339923 22663 ts_tablet_manager.cc:1434] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:11:17.342578 22663 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.342978 22665 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.353539 22665 ts_tablet_manager.cc:1403] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.012s
I20260709 13:11:17.349655 22652 raft_consensus.cc:493] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.355430 22652 raft_consensus.cc:515] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.359794 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:17.362126 22330 leader_election.cc:343] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.331686 22424 tablet_service.cc:1511] Processing CreateTablet for tablet 9c989e05630b4961a1e2791ac93ddab4 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:17.363701 22424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c989e05630b4961a1e2791ac93ddab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.364975 22652 leader_election.cc:290] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.364703 22665 raft_consensus.cc:359] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.365797 22665 raft_consensus.cc:385] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.366140 22665 raft_consensus.cc:740] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.365826 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:17.366966 22665 consensus_queue.cc:260] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.369405 22664 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.374740 22664 ts_tablet_manager.cc:1403] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.014s
I20260709 13:11:17.369939 22665 ts_tablet_manager.cc:1434] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:11:17.376842 22665 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.379626 22500 tablet_service.cc:1511] Processing CreateTablet for tablet 9c989e05630b4961a1e2791ac93ddab4 (DEFAULT_TABLE table=soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:17.379267 22664 raft_consensus.cc:359] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.380776 22664 raft_consensus.cc:385] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.381171 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c989e05630b4961a1e2791ac93ddab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.381173 22664 raft_consensus.cc:740] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.382449 22664 consensus_queue.cc:260] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.383838 22665 tablet_bootstrap.cc:654] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:17.384729 22332 leader_election.cc:343] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.385314 22332 leader_election.cc:304] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.386180 22652 raft_consensus.cc:2749] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.385672 22664 ts_tablet_manager.cc:1434] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:17.388115 22664 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.395908 22664 tablet_bootstrap.cc:654] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.405087 22669 raft_consensus.cc:493] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.406102 22669 raft_consensus.cc:515] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.349525 22663 tablet_bootstrap.cc:654] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.415937 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.416707 22365 raft_consensus.cc:2468] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:17.418275 22406 leader_election.cc:304] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.418481 22669 leader_election.cc:290] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.419395 22647 raft_consensus.cc:2804] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.419835 22647 raft_consensus.cc:493] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.420203 22647 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.421182 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:17.422458 22663 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.423087 22663 ts_tablet_manager.cc:1403] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
W20260709 13:11:17.423748 22405 leader_election.cc:343] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.426601 22663 raft_consensus.cc:359] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.427421 22663 raft_consensus.cc:385] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.427719 22663 raft_consensus.cc:740] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.428435 22647 raft_consensus.cc:515] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.428637 22663 consensus_queue.cc:260] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.431660 22663 ts_tablet_manager.cc:1434] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:17.431931 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.432588 22365 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.434058 22663 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.440986 22365 raft_consensus.cc:2468] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:17.441547 22663 tablet_bootstrap.cc:654] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.442756 22406 leader_election.cc:304] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.444598 22669 raft_consensus.cc:2804] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.445138 22669 raft_consensus.cc:697] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:17.446086 22669 consensus_queue.cc:237] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.450680 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:17.459266 22647 leader_election.cc:290] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.463418 22665 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.464351 22665 ts_tablet_manager.cc:1403] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.009s
W20260709 13:11:17.465597 22405 leader_election.cc:343] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.471760 22663 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.472373 22663 ts_tablet_manager.cc:1403] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.004s
I20260709 13:11:17.475999 22262 catalog_manager.cc:5697] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 0 to 1, leader changed from <none> to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 1 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.476780 22665 raft_consensus.cc:359] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.477505 22665 raft_consensus.cc:385] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.477829 22665 raft_consensus.cc:740] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.479278 22665 consensus_queue.cc:260] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.479548 22663 raft_consensus.cc:359] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.480257 22663 raft_consensus.cc:385] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.480554 22663 raft_consensus.cc:740] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.481312 22663 consensus_queue.cc:260] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.482120 22664 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.482898 22664 ts_tablet_manager.cc:1403] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.095s	user 0.041s	sys 0.036s
I20260709 13:11:17.483762 22663 ts_tablet_manager.cc:1434] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 13:11:17.484937 22663 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.482057 22665 ts_tablet_manager.cc:1434] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:11:17.491220 22665 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.490818 22664 raft_consensus.cc:359] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.491856 22664 raft_consensus.cc:385] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.492272 22664 raft_consensus.cc:740] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.492242 22663 tablet_bootstrap.cc:654] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.493359 22664 consensus_queue.cc:260] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.495437 22673 raft_consensus.cc:493] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.496322 22664 ts_tablet_manager.cc:1434] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:11:17.497512 22664 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.495970 22673 raft_consensus.cc:515] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.501878 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.502697 22365 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:17.505452 22406 leader_election.cc:304] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.505877 22664 tablet_bootstrap.cc:654] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.506395 22673 leader_election.cc:290] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.506511 22669 raft_consensus.cc:2804] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.507256 22669 raft_consensus.cc:493] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.507699 22669 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.512617 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:17.518383 22405 leader_election.cc:343] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.522722 22663 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.523566 22663 ts_tablet_manager.cc:1403] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.018s
I20260709 13:11:17.525336 22665 tablet_bootstrap.cc:654] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.526770 22663 raft_consensus.cc:359] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.527550 22663 raft_consensus.cc:385] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.527964 22663 raft_consensus.cc:740] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.528965 22663 consensus_queue.cc:260] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.531167 22664 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.531605 22663 ts_tablet_manager.cc:1434] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:17.531808 22664 ts_tablet_manager.cc:1403] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.017s
I20260709 13:11:17.532737 22663 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.535640 22664 raft_consensus.cc:359] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.536427 22664 raft_consensus.cc:385] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.529706 22669 raft_consensus.cc:515] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.536746 22664 raft_consensus.cc:740] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.538344 22664 consensus_queue.cc:260] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.541352 22663 tablet_bootstrap.cc:654] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.542155 22664 ts_tablet_manager.cc:1434] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:17.543337 22664 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.548954 22663 tablet_bootstrap.cc:492] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.549621 22663 ts_tablet_manager.cc:1403] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:11:17.551332 22664 tablet_bootstrap.cc:654] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.551390 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.552321 22365 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.552913 22663 raft_consensus.cc:359] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.553678 22663 raft_consensus.cc:385] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.553959 22663 raft_consensus.cc:740] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.554752 22663 consensus_queue.cc:260] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.560190 22663 ts_tablet_manager.cc:1434] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:17.561403 22663 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.568935 22663 tablet_bootstrap.cc:654] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.587889 22638 raft_consensus.cc:493] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.588701 22638 raft_consensus.cc:515] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.590340 22663 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.591199 22663 ts_tablet_manager.cc:1403] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.008s
I20260709 13:11:17.592581 22665 tablet_bootstrap.cc:492] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.592756 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.593402 22665 ts_tablet_manager.cc:1403] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.002s
I20260709 13:11:17.593700 22366 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:17.594022 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:17.595225 22638 leader_election.cc:290] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.594929 22663 raft_consensus.cc:359] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.594846 22440 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:17.595470 22480 leader_election.cc:304] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:17.595954 22663 raft_consensus.cc:385] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.596511 22663 raft_consensus.cc:740] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.597056 22665 raft_consensus.cc:359] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.595894 22638 raft_consensus.cc:493] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.599335 22665 raft_consensus.cc:385] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.599848 22665 raft_consensus.cc:740] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.599650 22638 raft_consensus.cc:515] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.600945 22664 tablet_bootstrap.cc:492] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.600901 22665 consensus_queue.cc:260] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.601693 22664 ts_tablet_manager.cc:1403] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.025s
I20260709 13:11:17.602442 22638 leader_election.cc:290] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.603120 22638 raft_consensus.cc:2804] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.603595 22638 raft_consensus.cc:493] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.603943 22638 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.604171 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:17.605611 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.597519 22663 consensus_queue.cc:260] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
W20260709 13:11:17.610857 22481 leader_election.cc:343] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.588634 22683 raft_consensus.cc:493] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.611944 22683 raft_consensus.cc:515] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.613104 22366 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:17.613737 22638 raft_consensus.cc:515] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.615005 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
W20260709 13:11:17.616575 22332 leader_election.cc:343] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.598515 22669 leader_election.cc:290] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.618230 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.614920 22365 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:17.619026 22364 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.620821 22406 leader_election.cc:304] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.622509 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:17.623517 22515 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.628175 22480 leader_election.cc:304] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.622512 22669 raft_consensus.cc:2804] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.630597 22669 raft_consensus.cc:697] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:17.631156 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:17.631814 22440 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.636162 22638 leader_election.cc:290] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.636806 22638 raft_consensus.cc:2804] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.637187 22638 raft_consensus.cc:493] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.637529 22638 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.638185 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:17.642618 22515 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:17.643738 22684 raft_consensus.cc:493] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.644454 22684 raft_consensus.cc:515] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.645668 22364 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:17.637549 22683 leader_election.cc:290] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.647166 22480 leader_election.cc:304] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:17.619421 22663 ts_tablet_manager.cc:1434] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:11:17.631845 22669 consensus_queue.cc:237] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.648922 22663 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.619788 22664 raft_consensus.cc:359] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.649878 22664 raft_consensus.cc:385] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.650218 22664 raft_consensus.cc:740] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.651152 22664 consensus_queue.cc:260] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.656646 22664 ts_tablet_manager.cc:1434] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.007s
I20260709 13:11:17.657966 22664 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.661176 22685 raft_consensus.cc:2804] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.662443 22665 ts_tablet_manager.cc:1434] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.069s	user 0.027s	sys 0.021s
I20260709 13:11:17.663390 22663 tablet_bootstrap.cc:654] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.663666 22665 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.643289 22440 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:17.659577 22638 raft_consensus.cc:515] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.666433 22514 raft_consensus.cc:2393] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dad85592ac43e9bfad3ee2aced7296 in current term 1: Already voted for candidate 898d51d3c83f4012b2188cf90191b4a4 in this term.
I20260709 13:11:17.668465 22330 leader_election.cc:304] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.669934 22683 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.672176 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.672385 22665 tablet_bootstrap.cc:654] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.672480 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.673156 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:17.673780 22440 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.675236 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:17.676405 22364 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:17.677400 22684 leader_election.cc:290] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.677893 22480 leader_election.cc:304] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.678900 22684 raft_consensus.cc:2804] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:17.679272 22684 raft_consensus.cc:493] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.679611 22684 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.685590 22440 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:17.685295 22261 catalog_manager.cc:5697] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 0 to 1, leader changed from <none> to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 1 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.688016 22638 leader_election.cc:290] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.663959 22685 raft_consensus.cc:697] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:17.691941 22683 raft_consensus.cc:2749] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.695971 22685 consensus_queue.cc:237] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.696326 22481 leader_election.cc:304] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.704500 22638 raft_consensus.cc:2804] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.705282 22638 raft_consensus.cc:697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:17.706465 22638 consensus_queue.cc:237] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.709578 22652 raft_consensus.cc:493] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.710175 22652 raft_consensus.cc:515] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.742132 22684 raft_consensus.cc:515] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.746649 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.747510 22364 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.749843 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
W20260709 13:11:17.751736 22332 leader_election.cc:343] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.746816 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:17.753662 22652 leader_election.cc:290] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.754305 22684 leader_election.cc:290] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:17.757999 22663 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.758456 22365 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:17.758674 22663 ts_tablet_manager.cc:1403] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.010s
I20260709 13:11:17.759003 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:17.742838 22664 tablet_bootstrap.cc:654] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:17.762346 22330 leader_election.cc:343] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.762836 22330 leader_election.cc:304] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.765800 22652 raft_consensus.cc:2749] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.762712 22663 raft_consensus.cc:359] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.770850 22663 raft_consensus.cc:385] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.771227 22663 raft_consensus.cc:740] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.773658 22665 tablet_bootstrap.cc:492] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.774375 22665 ts_tablet_manager.cc:1403] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.111s	user 0.038s	sys 0.038s
I20260709 13:11:17.773743 22663 consensus_queue.cc:260] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.771726 22364 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:17.777140 22663 ts_tablet_manager.cc:1434] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.006s
I20260709 13:11:17.777535 22480 leader_election.cc:304] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.777654 22665 raft_consensus.cc:359] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.778434 22663 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.778517 22665 raft_consensus.cc:385] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.778829 22638 raft_consensus.cc:2804] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.779093 22665 raft_consensus.cc:740] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.779516 22638 raft_consensus.cc:697] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:17.780118 22665 consensus_queue.cc:260] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.780642 22638 consensus_queue.cc:237] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.782758 22665 ts_tablet_manager.cc:1434] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:17.783845 22665 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.787531 22663 tablet_bootstrap.cc:654] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.790544 22665 tablet_bootstrap.cc:654] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.793532 22261 catalog_manager.cc:5697] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.797338 22663 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.797889 22663 ts_tablet_manager.cc:1403] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:11:17.801110 22664 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.800987 22663 raft_consensus.cc:359] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.801779 22663 raft_consensus.cc:385] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.801936 22664 ts_tablet_manager.cc:1403] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.013s
I20260709 13:11:17.802078 22663 raft_consensus.cc:740] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.803169 22663 consensus_queue.cc:260] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.805389 22663 ts_tablet_manager.cc:1434] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:17.806388 22663 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: Bootstrap starting.
I20260709 13:11:17.806847 22664 raft_consensus.cc:359] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.807969 22664 raft_consensus.cc:385] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.808353 22664 raft_consensus.cc:740] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.809368 22664 consensus_queue.cc:260] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.813710 22663 tablet_bootstrap.cc:654] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.815876 22664 ts_tablet_manager.cc:1434] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:11:17.817090 22664 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.830690 22665 tablet_bootstrap.cc:492] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.831314 22665 ts_tablet_manager.cc:1403] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.011s
I20260709 13:11:17.832254 22673 consensus_queue.cc:1048] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.831343 22264 catalog_manager.cc:5697] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 1 to 2, leader changed from b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.834304 22665 raft_consensus.cc:359] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.835112 22665 raft_consensus.cc:385] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.835413 22665 raft_consensus.cc:740] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.834534 22264 catalog_manager.cc:5697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.839087 22664 tablet_bootstrap.cc:654] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.843057 22665 consensus_queue.cc:260] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.846434 22665 ts_tablet_manager.cc:1434] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.006s
I20260709 13:11:17.847841 22665 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.855777 22663 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: No bootstrap required, opened a new log
I20260709 13:11:17.856480 22663 ts_tablet_manager.cc:1403] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.027s
I20260709 13:11:17.859550 22663 raft_consensus.cc:359] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.860285 22663 raft_consensus.cc:385] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.860558 22663 raft_consensus.cc:740] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.861215 22665 tablet_bootstrap.cc:654] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.861241 22663 consensus_queue.cc:260] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.863687 22663 ts_tablet_manager.cc:1434] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:17.872918 22664 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.873521 22664 ts_tablet_manager.cc:1403] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.008s
I20260709 13:11:17.877064 22664 raft_consensus.cc:359] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.877825 22664 raft_consensus.cc:385] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.878103 22664 raft_consensus.cc:740] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.878943 22664 consensus_queue.cc:260] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.881300 22664 ts_tablet_manager.cc:1434] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:17.882256 22664 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.884434 22652 raft_consensus.cc:493] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.885392 22652 raft_consensus.cc:515] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.890062 22664 tablet_bootstrap.cc:654] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.890586 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
W20260709 13:11:17.893103 22332 leader_election.cc:343] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.896709 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
W20260709 13:11:17.899024 22330 leader_election.cc:343] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.899708 22330 leader_election.cc:304] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.900945 22683 raft_consensus.cc:2749] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.901211 22652 leader_election.cc:290] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.919955 22514 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.924521 22647 raft_consensus.cc:493] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.925388 22647 raft_consensus.cc:515] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.930572 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:17.931502 22515 raft_consensus.cc:2468] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:17.933210 22405 leader_election.cc:304] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.934482 22669 raft_consensus.cc:2804] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.934949 22669 raft_consensus.cc:493] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.935385 22669 raft_consensus.cc:3060] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.939466 22675 consensus_queue.cc:1048] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.945785 22665 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:17.946563 22665 ts_tablet_manager.cc:1403] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.099s	user 0.040s	sys 0.039s
I20260709 13:11:17.946097 22669 raft_consensus.cc:515] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.948460 22652 raft_consensus.cc:493] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.949172 22652 raft_consensus.cc:515] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.950531 22665 raft_consensus.cc:359] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.951407 22665 raft_consensus.cc:385] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.951161 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:17.956809 22364 raft_consensus.cc:2468] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:17.956997 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:17.958057 22440 raft_consensus.cc:2393] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dad85592ac43e9bfad3ee2aced7296 in current term 1: Already voted for candidate b361ecda55dd4d19b23d48e52f5f3c7e in this term.
I20260709 13:11:17.951992 22665 raft_consensus.cc:740] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.952419 22652 leader_election.cc:290] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.940124 22647 leader_election.cc:290] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.959101 22665 consensus_queue.cc:260] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.960824 22664 tablet_bootstrap.cc:492] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:17.961412 22664 ts_tablet_manager.cc:1403] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.041s
I20260709 13:11:17.964591 22664 raft_consensus.cc:359] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.965000 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:17.965384 22664 raft_consensus.cc:385] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.965672 22669 leader_election.cc:290] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:17.965816 22664 raft_consensus.cc:740] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.965233 22665 ts_tablet_manager.cc:1434] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:11:17.965890 22513 raft_consensus.cc:3060] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.966725 22664 consensus_queue.cc:260] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:17.967273 22665 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:17.969177 22664 ts_tablet_manager.cc:1434] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:17.953084 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:17.970257 22664 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:17.978180 22332 leader_election.cc:304] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296; no voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:17.978183 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cce7828b6c042f683a1fbf25553f9a9" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:17.979081 22364 raft_consensus.cc:3060] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.979506 22665 tablet_bootstrap.cc:654] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.982085 22664 tablet_bootstrap.cc:654] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.987133 22364 raft_consensus.cc:2468] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:17.987955 22683 raft_consensus.cc:2749] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.996630 22406 leader_election.cc:304] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:17.998093 22669 raft_consensus.cc:2804] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.998756 22669 raft_consensus.cc:697] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.000082 22669 consensus_queue.cc:237] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.009091 22513 raft_consensus.cc:2468] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:18.016705 22664 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:18.017292 22664 ts_tablet_manager.cc:1403] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.017s
I20260709 13:11:18.018627 22665 tablet_bootstrap.cc:492] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:18.019251 22665 ts_tablet_manager.cc:1403] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.052s	user 0.036s	sys 0.008s
I20260709 13:11:18.022481 22665 raft_consensus.cc:359] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.020946 22664 raft_consensus.cc:359] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.021570 22262 catalog_manager.cc:5697] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 0 to 1, leader changed from <none> to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 1 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.023389 22665 raft_consensus.cc:385] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.023759 22664 raft_consensus.cc:385] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.023775 22665 raft_consensus.cc:740] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.024932 22665 consensus_queue.cc:260] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.024346 22664 raft_consensus.cc:740] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.027472 22665 ts_tablet_manager.cc:1434] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:11:18.027573 22664 consensus_queue.cc:260] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.028715 22665 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:18.031294 22664 ts_tablet_manager.cc:1434] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:11:18.032853 22664 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: Bootstrap starting.
I20260709 13:11:18.038529 22665 tablet_bootstrap.cc:654] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.040521 22664 tablet_bootstrap.cc:654] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.041489 22514 raft_consensus.cc:1240] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Rejecting Update request from peer b361ecda55dd4d19b23d48e52f5f3c7e for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:18.043303 22669 consensus_queue.cc:1059] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.044008 22669 consensus_queue.cc:1243] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Peer 898d51d3c83f4012b2188cf90191b4a4 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:11:18.044508 22669 raft_consensus.cc:3055] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.044801 22669 raft_consensus.cc:740] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.045565 22669 consensus_queue.cc:260] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.049546 22669 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.052242 22664 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: No bootstrap required, opened a new log
I20260709 13:11:18.053117 22664 ts_tablet_manager.cc:1403] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:11:18.054374 22647 raft_consensus.cc:493] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.054953 22647 raft_consensus.cc:515] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.056267 22665 tablet_bootstrap.cc:492] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:18.056824 22665 ts_tablet_manager.cc:1403] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.002s
I20260709 13:11:18.057065 22647 leader_election.cc:290] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.056847 22664 raft_consensus.cc:359] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.057797 22664 raft_consensus.cc:385] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.058087 22664 raft_consensus.cc:740] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.058866 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:18.058941 22664 consensus_queue.cc:260] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.059420 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:18.059815 22364 raft_consensus.cc:2468] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:18.059866 22665 raft_consensus.cc:359] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.060881 22665 raft_consensus.cc:385] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.061182 22665 raft_consensus.cc:740] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.061422 22664 ts_tablet_manager.cc:1434] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:18.061414 22406 leader_election.cc:304] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.061869 22665 consensus_queue.cc:260] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.062820 22673 raft_consensus.cc:2804] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.063195 22673 raft_consensus.cc:493] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.063517 22673 raft_consensus.cc:3060] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.066761 22665 ts_tablet_manager.cc:1434] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:11:18.060320 22514 raft_consensus.cc:2468] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:18.069070 22665 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: Bootstrap starting.
I20260709 13:11:18.072731 22673 raft_consensus.cc:515] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.075305 22673 leader_election.cc:290] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.076613 22665 tablet_bootstrap.cc:654] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.077986 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:18.078723 22364 raft_consensus.cc:3060] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.080607 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e614ef73b84786b4df436b6efb2a14" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.081310 22514 raft_consensus.cc:3060] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.082983 22665 tablet_bootstrap.cc:492] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: No bootstrap required, opened a new log
I20260709 13:11:18.083611 22665 ts_tablet_manager.cc:1403] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:11:18.086845 22364 raft_consensus.cc:2468] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:18.086741 22665 raft_consensus.cc:359] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.087647 22665 raft_consensus.cc:385] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.087996 22665 raft_consensus.cc:740] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.088327 22406 leader_election.cc:304] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.089094 22669 raft_consensus.cc:2804] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.088991 22665 consensus_queue.cc:260] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.089594 22514 raft_consensus.cc:2468] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:18.089820 22669 raft_consensus.cc:697] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.090857 22669 consensus_queue.cc:237] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.092375 22665 ts_tablet_manager.cc:1434] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:18.097877 22638 raft_consensus.cc:493] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.098536 22638 raft_consensus.cc:515] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.101387 22638 leader_election.cc:290] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:18.101644 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:18.102384 22364 raft_consensus.cc:2468] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:18.102535 22264 catalog_manager.cc:5697] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 0 to 1, leader changed from <none> to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 1 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.103379 22480 leader_election.cc:304] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.104205 22638 raft_consensus.cc:2804] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.104271 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:18.104606 22638 raft_consensus.cc:493] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.105002 22638 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.105047 22440 raft_consensus.cc:2468] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 0.
I20260709 13:11:18.111483 22638 raft_consensus.cc:515] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.113270 22638 leader_election.cc:290] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:18.114337 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.114413 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:18.115077 22440 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.115252 22364 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.123272 22364 raft_consensus.cc:2468] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:18.123647 22440 raft_consensus.cc:2468] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 1.
I20260709 13:11:18.124593 22480 leader_election.cc:304] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.125494 22638 raft_consensus.cc:2804] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.126013 22638 raft_consensus.cc:697] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.126863 22638 consensus_queue.cc:237] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.135377 22683 raft_consensus.cc:493] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.136125 22683 raft_consensus.cc:515] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.135778 22264 catalog_manager.cc:5697] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.138279 22683 leader_election.cc:290] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.139930 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" is_pre_election: true
I20260709 13:11:18.140745 22440 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:18.141489 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:18.142211 22514 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 0.
I20260709 13:11:18.142433 22332 leader_election.cc:304] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.143607 22683 raft_consensus.cc:2804] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.144008 22683 raft_consensus.cc:493] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.144380 22683 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.145164 22638 consensus_queue.cc:1048] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.151259 22683 raft_consensus.cc:515] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.153497 22683 leader_election.cc:290] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.154320 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.154981 22440 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.155999 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.157673 22514 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.159372 22638 consensus_queue.cc:1048] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.165552 22514 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:18.166882 22330 leader_election.cc:304] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.167856 22683 raft_consensus.cc:2804] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.168370 22683 raft_consensus.cc:697] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.169301 22683 consensus_queue.cc:237] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.175299 22638 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.178108 22440 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 1.
I20260709 13:11:18.187230 22261 catalog_manager.cc:5697] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 1 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.190982 22684 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.248617 22669 raft_consensus.cc:493] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.249217 22669 raft_consensus.cc:515] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.250968 22669 leader_election.cc:290] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.252259 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296" is_pre_election: true
I20260709 13:11:18.252259 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4" is_pre_election: true
I20260709 13:11:18.253257 22514 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:18.253240 22364 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 0.
I20260709 13:11:18.254871 22406 leader_election.cc:304] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.255774 22669 raft_consensus.cc:2804] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.256412 22669 raft_consensus.cc:493] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.256809 22669 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.263624 22669 raft_consensus.cc:515] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.265537 22669 leader_election.cc:290] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.266530 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:18.266819 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.267278 22364 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.267346 22514 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:18.272569 22312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:18.275234 22364 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:18.275234 22514 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 1.
I20260709 13:11:18.277055 22405 leader_election.cc:304] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.278041 22669 raft_consensus.cc:2804] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.278610 22669 raft_consensus.cc:697] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.279374 22669 consensus_queue.cc:237] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.288465 22264 catalog_manager.cc:5697] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 0 to 1, leader changed from <none> to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 1 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.353890 22364 raft_consensus.cc:1275] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:18.355368 22684 consensus_queue.cc:1048] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.364212 22440 raft_consensus.cc:1275] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:11:18.364675 22440 pending_rounds.cc:85] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Aborting all ops after (but not including) 0
I20260709 13:11:18.364893 22440 pending_rounds.cc:107] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:18.365175 22440 raft_consensus.cc:2889] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.368607 22638 consensus_queue.cc:1048] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.381353 22669 consensus_queue.cc:1048] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.394752 22669 consensus_queue.cc:1048] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.549206 22440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:56596
I20260709 13:11:18.549829 22440 raft_consensus.cc:606] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:18.556658 22513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:18.557225 22513 raft_consensus.cc:606] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:18.563649 22513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:18.564325 22513 raft_consensus.cc:606] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:18.570636 22513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:18.571216 22513 raft_consensus.cc:606] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Received request to transfer leadership to TS 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:18.579694 22513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
mode: GRACEFUL
new_leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:55088
I20260709 13:11:18.580368 22513 raft_consensus.cc:606] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Received request to transfer leadership to TS b361ecda55dd4d19b23d48e52f5f3c7e
I20260709 13:11:18.591837 22364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:51932
I20260709 13:11:18.592572 22364 raft_consensus.cc:606] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:18.593323 22669 consensus_queue.cc:1048] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.594560 22685 consensus_queue.cc:1048] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.605686 22684 raft_consensus.cc:993] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:18.606264 22687 raft_consensus.cc:1081] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Signalling peer b361ecda55dd4d19b23d48e52f5f3c7e to start an election
I20260709 13:11:18.611342 22438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
 from {username='slave'} at 127.0.0.1:56574
I20260709 13:11:18.612010 22438 raft_consensus.cc:493] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.612398 22438 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.612263 22684 consensus_queue.cc:1048] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:18.617587 22669 consensus_queue.cc:1048] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.622071 22438 raft_consensus.cc:515] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.624468 22440 raft_consensus.cc:1240] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Rejecting Update request from peer 898d51d3c83f4012b2188cf90191b4a4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:18.626995 22438 leader_election.cc:290] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.628315 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.628980 22513 raft_consensus.cc:3055] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.630342 22685 consensus_queue.cc:1059] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.634441 22366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4ea5df3fdb4b86be5596f6927313d5" candidate_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:18.635913 22513 raft_consensus.cc:740] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.637945 22513 consensus_queue.cc:260] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.639642 22513 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.642479 22652 consensus_queue.cc:1048] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.645128 22684 raft_consensus.cc:993] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.645681 22684 raft_consensus.cc:1081] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.647763 22365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51910
I20260709 13:11:18.648391 22365 raft_consensus.cc:493] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.649065 22365 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.649644 22513 raft_consensus.cc:2468] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b361ecda55dd4d19b23d48e52f5f3c7e in term 2.
I20260709 13:11:18.651063 22405 leader_election.cc:304] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 36dad85592ac43e9bfad3ee2aced7296
I20260709 13:11:18.652352 22669 raft_consensus.cc:2804] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.652827 22669 raft_consensus.cc:697] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Leader. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.653724 22669 consensus_queue.cc:237] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.662300 22365 raft_consensus.cc:515] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.667286 22365 leader_election.cc:290] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.668442 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.668844 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.669255 22438 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.669620 22513 raft_consensus.cc:3055] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.669468 22683 consensus_queue.cc:1048] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.670045 22513 raft_consensus.cc:740] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.670985 22513 consensus_queue.cc:260] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.672547 22513 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.680589 22513 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.681346 22438 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.682864 22330 leader_election.cc:304] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.683861 22652 raft_consensus.cc:2804] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.684376 22652 raft_consensus.cc:697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.685310 22652 consensus_queue.cc:237] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.684252 22264 catalog_manager.cc:5697] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e reported cstate change: term changed from 1 to 2, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2). New cstate: current_term: 2 leader_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.690603 22730 raft_consensus.cc:993] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:18.691092 22683 raft_consensus.cc:1081] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:18.692896 22514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:11:18.693571 22514 raft_consensus.cc:493] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.693897 22514 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.700851 22262 catalog_manager.cc:5697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 1 to 2, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.703055 22514 raft_consensus.cc:515] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.706960 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:18.707669 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c989e05630b4961a1e2791ac93ddab4" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.707707 22365 raft_consensus.cc:3055] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.708459 22365 raft_consensus.cc:740] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.708498 22438 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.709553 22365 consensus_queue.cc:260] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.711083 22365 raft_consensus.cc:3060] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.715040 22438 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:18.707798 22514 leader_election.cc:290] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:18.716569 22481 leader_election.cc:304] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.717413 22685 raft_consensus.cc:2804] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.717860 22685 raft_consensus.cc:697] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.718701 22685 consensus_queue.cc:237] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.719097 22365 raft_consensus.cc:2468] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:18.721521 22669 consensus_queue.cc:1048] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.726639 22262 catalog_manager.cc:5697] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.736474 22675 consensus_queue.cc:1048] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.780016 22684 raft_consensus.cc:993] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.780550 22685 raft_consensus.cc:1081] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.782028 22365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51910
I20260709 13:11:18.782526 22365 raft_consensus.cc:493] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.782838 22365 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.788208 22365 raft_consensus.cc:515] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.789965 22365 leader_election.cc:290] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.791095 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.791213 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed972efc29854a5cafb708f4574b8e55" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.791887 22438 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.792062 22514 raft_consensus.cc:3055] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.792551 22514 raft_consensus.cc:740] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.793283 22514 consensus_queue.cc:260] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.794188 22514 raft_consensus.cc:3060] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.798312 22438 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.799031 22514 raft_consensus.cc:2468] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.799580 22332 leader_election.cc:304] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:18.800598 22652 raft_consensus.cc:2804] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.801115 22652 raft_consensus.cc:697] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.801823 22652 consensus_queue.cc:237] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.809171 22261 catalog_manager.cc:5697] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 1 to 2, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.853087 22675 raft_consensus.cc:993] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.853639 22647 raft_consensus.cc:1081] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.855304 22365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51924
I20260709 13:11:18.855904 22365 raft_consensus.cc:493] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.856524 22365 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.862041 22365 raft_consensus.cc:515] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.863931 22365 leader_election.cc:290] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.864953 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.864951 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2acf583f5f84a4abe788f2659477953" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.865834 22441 raft_consensus.cc:3055] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.865885 22514 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.866479 22441 raft_consensus.cc:740] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:18.867441 22441 consensus_queue.cc:260] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.868845 22441 raft_consensus.cc:3060] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.874533 22514 raft_consensus.cc:2468] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.876206 22330 leader_election.cc:304] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.877193 22652 raft_consensus.cc:2804] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.877465 22441 raft_consensus.cc:2468] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 2.
I20260709 13:11:18.877890 22652 raft_consensus.cc:697] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.878882 22652 consensus_queue.cc:237] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.879722 22687 raft_consensus.cc:993] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: : Instructing follower 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.880326 22685 raft_consensus.cc:1081] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Signalling peer 36dad85592ac43e9bfad3ee2aced7296 to start an election
I20260709 13:11:18.882229 22365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
 from {username='slave'} at 127.0.0.1:51910
I20260709 13:11:18.882807 22365 raft_consensus.cc:493] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.883193 22365 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.887737 22261 catalog_manager.cc:5697] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 1 to 2, leader changed from b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 2 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.890446 22365 raft_consensus.cc:515] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.892822 22365 leader_election.cc:290] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 3 election: Requested vote from peers b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955), 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3:34781)
I20260709 13:11:18.893843 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:18.893196 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed21523595444224b0e33d58706b0a3c" candidate_uuid: "36dad85592ac43e9bfad3ee2aced7296" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
I20260709 13:11:18.894884 22441 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.894909 22514 raft_consensus.cc:3055] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:18.895557 22514 raft_consensus.cc:740] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:18.896441 22514 consensus_queue.cc:260] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.897543 22514 raft_consensus.cc:3060] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.904603 22514 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 3.
I20260709 13:11:18.905707 22330 leader_election.cc:304] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:18.906219 22441 raft_consensus.cc:2468] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dad85592ac43e9bfad3ee2aced7296 in term 3.
I20260709 13:11:18.906540 22652 raft_consensus.cc:2804] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:18.907100 22652 raft_consensus.cc:697] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 3 LEADER]: Becoming Leader. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:18.907967 22652 consensus_queue.cc:237] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:18.915766 22261 catalog_manager.cc:5697] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 reported cstate change: term changed from 2 to 3, leader changed from 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3) to 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1). New cstate: current_term: 3 leader_uuid: "36dad85592ac43e9bfad3ee2aced7296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.136081 22365 raft_consensus.cc:1275] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.137547 22685 consensus_queue.cc:1048] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.146632 22441 raft_consensus.cc:1275] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.149327 22685 consensus_queue.cc:1048] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.162107 22514 raft_consensus.cc:1275] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.163530 22652 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.178580 22441 raft_consensus.cc:1275] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.180720 22730 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.181720 22514 raft_consensus.cc:1275] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.183279 22675 consensus_queue.cc:1048] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.194005 22365 raft_consensus.cc:3060] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.202303 22365 raft_consensus.cc:1275] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer b361ecda55dd4d19b23d48e52f5f3c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.203598 22669 consensus_queue.cc:1048] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.224784 22514 raft_consensus.cc:1275] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.226142 22730 consensus_queue.cc:1048] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.236675 22441 raft_consensus.cc:1275] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.240659 22730 consensus_queue.cc:1048] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.388938 22513 raft_consensus.cc:1275] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:19.390368 22730 consensus_queue.cc:1048] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.400061 22441 raft_consensus.cc:1275] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:19.402457 22734 consensus_queue.cc:1048] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.406965 22513 raft_consensus.cc:1275] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.408998 22734 consensus_queue.cc:1048] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.422585 22441 raft_consensus.cc:1275] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 36dad85592ac43e9bfad3ee2aced7296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.425796 22652 consensus_queue.cc:1048] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:21.597028 22262 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57032:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:21.621371 22262 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57032:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:21.677592 11576 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:21.823300 22766 tablet.cc:1724] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:21.877915 22784 tablet.cc:1724] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:21.883647 22774 log.cc:927] Time spent T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:21.917599 22791 tablet.cc:1724] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:21.969507 22467 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:6cce7828b6c042f683a1fbf25553f9a9)
W20260709 13:11:21.974637 22467 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6cce7828b6c042f683a1fbf25553f9a9)
W20260709 13:11:21.980533 22467 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:6cce7828b6c042f683a1fbf25553f9a9)
I20260709 13:11:21.989362 22365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:44524
I20260709 13:11:21.990705 22365 raft_consensus.cc:606] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:21.968262 22790 tablet.cc:1724] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:22.024783 22795 log.cc:927] Time spent T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:22.023231 22802 tablet.cc:1724] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.019039 22796 tablet.cc:1724] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:22.027786 22779 log.cc:927] Time spent T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Append to log took a long time: real 0.166s	user 0.005s	sys 0.000s
W20260709 13:11:22.012377 22405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:34781, user_credentials={real_user=slave}} blocked reactor thread for 78164.9us
W20260709 13:11:22.058105 22406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:36251, user_credentials={real_user=slave}} blocked reactor thread for 58213.7us
I20260709 13:11:22.071002 22798 tablet.cc:1724] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:22.096288 22332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:45955, user_credentials={real_user=slave}} blocked reactor thread for 61251.5us
I20260709 13:11:22.130813 22802 tablet.cc:1724] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.132203 22807 tablet.cc:1724] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.136906 22766 tablet.cc:1724] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.132815 22811 tablet.cc:1724] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.170104 22806 tablet.cc:1724] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.173938 22784 tablet.cc:1724] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.181268 22744 raft_consensus.cc:993] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.181838 22744 raft_consensus.cc:1081] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.197685 22790 tablet.cc:1724] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.198462 22814 tablet.cc:1724] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:22.207746 22810 log.cc:927] Time spent T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:11:22.210631 22512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:11:22.211241 22512 raft_consensus.cc:493] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.211589 22512 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.214337 22796 tablet.cc:1724] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.217072 22798 tablet.cc:1724] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.229967 22512 raft_consensus.cc:515] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.232398 22512 leader_election.cc:290] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:22.234848 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:22.243327 22365 raft_consensus.cc:3055] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:22.237262 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e411ea2dc2e40d8bcd77e9329f5d95d" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:22.244712 22438 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.244745 22811 tablet.cc:1724] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.243746 22365 raft_consensus.cc:740] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:22.248559 22365 consensus_queue.cc:260] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.248106 22791 tablet.cc:1724] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.248193 22784 tablet.cc:1724] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.249724 22365 raft_consensus.cc:3060] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.254880 22790 tablet.cc:1724] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.256275 22766 tablet.cc:1724] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.261530 22802 tablet.cc:1724] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.273339 22365 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 3.
I20260709 13:11:22.274706 22480 leader_election.cc:304] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:22.275714 22733 raft_consensus.cc:2804] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:22.276224 22733 raft_consensus.cc:697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 3 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:22.277046 22733 consensus_queue.cc:237] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.280007 22807 tablet.cc:1724] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.288705 22814 tablet.cc:1724] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.283802 22817 tablet.cc:1724] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:22.278513 22405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:34781, user_credentials={real_user=slave}} blocked reactor thread for 59912us
I20260709 13:11:22.307368 22784 tablet.cc:1724] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:22.310653 22439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:58948
I20260709 13:11:22.324159 22439 raft_consensus.cc:606] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:22.311370 22438 raft_consensus.cc:2468] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 3.
I20260709 13:11:22.325784 11576 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:11:22.326514 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.340293 22263 catalog_manager.cc:5697] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 2 to 3, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.345813 22438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a"
dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:58948
I20260709 13:11:22.346666 22438 raft_consensus.cc:606] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:22.350230 22365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984"
dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
mode: GRACEFUL
new_leader_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:44524
I20260709 13:11:22.350869 22365 raft_consensus.cc:606] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Received request to transfer leadership to TS 898d51d3c83f4012b2188cf90191b4a4
I20260709 13:11:22.352463 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:22.353196 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:22.372265 22263 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: soft_deleted_table [id=21af233471c7450cae663e221a9f8e0a] alter complete (version 1)
I20260709 13:11:22.430699 22743 raft_consensus.cc:993] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.431386 22742 raft_consensus.cc:1081] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.433055 22513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55074
I20260709 13:11:22.433609 22513 raft_consensus.cc:493] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.433934 22513 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.438866 22513 raft_consensus.cc:515] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.440547 22513 leader_election.cc:290] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:22.441740 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:22.442107 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81c8b60fc4144f1a7d8a87370175ec8" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:22.442667 22364 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.442822 22438 raft_consensus.cc:3055] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:22.443320 22438 raft_consensus.cc:740] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:22.444140 22438 consensus_queue.cc:260] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.445160 22438 raft_consensus.cc:3060] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.449509 22364 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:22.450510 22438 raft_consensus.cc:2468] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:22.451028 22480 leader_election.cc:304] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:22.451898 22733 raft_consensus.cc:2804] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.452430 22733 raft_consensus.cc:697] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:22.453291 22733 consensus_queue.cc:237] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.461820 22263 catalog_manager.cc:5697] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 1 to 2, leader changed from b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.469650 22652 raft_consensus.cc:993] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.470161 22652 raft_consensus.cc:1081] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.472185 22513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:11:22.472806 22513 raft_consensus.cc:493] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.473169 22513 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.478574 22513 raft_consensus.cc:515] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:22.480542 22513 leader_election.cc:290] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:22.481352 22364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:22.482092 22364 raft_consensus.cc:3055] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:22.482144 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81500240a0fb40a9b2ffc5bd7faaa984" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:22.482440 22364 raft_consensus.cc:740] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dad85592ac43e9bfad3ee2aced7296, State: Running, Role: LEADER
I20260709 13:11:22.482892 22438 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.483345 22364 consensus_queue.cc:260] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:22.484705 22364 raft_consensus.cc:3060] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.489073 22438 raft_consensus.cc:2468] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:22.490367 22481 leader_election.cc:304] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898d51d3c83f4012b2188cf90191b4a4, b361ecda55dd4d19b23d48e52f5f3c7e; no voters: 
I20260709 13:11:22.490569 22364 raft_consensus.cc:2468] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 2.
I20260709 13:11:22.491325 22733 raft_consensus.cc:2804] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.492256 22733 raft_consensus.cc:697] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:22.493158 22733 consensus_queue.cc:237] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } }
I20260709 13:11:22.502512 22263 catalog_manager.cc:5697] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 1 to 2, leader changed from 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.665864 22365 raft_consensus.cc:1275] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:22.667452 22733 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:22.678076 22438 raft_consensus.cc:1275] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:22.681295 22824 consensus_queue.cc:1048] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:22.745695 22743 raft_consensus.cc:993] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: : Instructing follower 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.746397 22742 raft_consensus.cc:1081] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Signalling peer 898d51d3c83f4012b2188cf90191b4a4 to start an election
I20260709 13:11:22.748162 22513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a"
dest_uuid: "898d51d3c83f4012b2188cf90191b4a4"
 from {username='slave'} at 127.0.0.1:55074
I20260709 13:11:22.748744 22513 raft_consensus.cc:493] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.749032 22513 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.756469 22513 raft_consensus.cc:515] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.759348 22513 leader_election.cc:290] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 election: Requested vote from peers 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251), b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955)
I20260709 13:11:22.759884 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e"
I20260709 13:11:22.759678 22365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1179f88a74484ed195aa0bb2cef6ef3a" candidate_uuid: "898d51d3c83f4012b2188cf90191b4a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36dad85592ac43e9bfad3ee2aced7296"
I20260709 13:11:22.760594 22438 raft_consensus.cc:3055] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:22.760927 22365 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.760933 22438 raft_consensus.cc:740] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b361ecda55dd4d19b23d48e52f5f3c7e, State: Running, Role: LEADER
I20260709 13:11:22.761919 22438 consensus_queue.cc:260] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.763123 22438 raft_consensus.cc:3060] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.767817 22365 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 3.
I20260709 13:11:22.769291 22480 leader_election.cc:304] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dad85592ac43e9bfad3ee2aced7296, 898d51d3c83f4012b2188cf90191b4a4; no voters: 
I20260709 13:11:22.769301 22438 raft_consensus.cc:2468] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898d51d3c83f4012b2188cf90191b4a4 in term 3.
I20260709 13:11:22.770383 22824 raft_consensus.cc:2804] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:22.770844 22824 raft_consensus.cc:697] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 3 LEADER]: Becoming Leader. State: Replica: 898d51d3c83f4012b2188cf90191b4a4, State: Running, Role: LEADER
I20260709 13:11:22.771637 22824 consensus_queue.cc:237] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } }
I20260709 13:11:22.779621 22261 catalog_manager.cc:5697] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 reported cstate change: term changed from 2 to 3, leader changed from b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2) to 898d51d3c83f4012b2188cf90191b4a4 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "898d51d3c83f4012b2188cf90191b4a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898d51d3c83f4012b2188cf90191b4a4" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 34781 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.918457 22438 raft_consensus.cc:1275] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:22.920012 22824 consensus_queue.cc:1048] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:22.929471 22365 raft_consensus.cc:1275] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:22.930992 22785 consensus_queue.cc:1048] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.045583 22438 raft_consensus.cc:1275] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.047119 22785 consensus_queue.cc:1048] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:23.057902 22365 raft_consensus.cc:1275] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.059365 22824 consensus_queue.cc:1048] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:23.198704 22438 raft_consensus.cc:1275] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:23.200074 22785 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b361ecda55dd4d19b23d48e52f5f3c7e" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.211376 22365 raft_consensus.cc:1275] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Refusing update from remote peer 898d51d3c83f4012b2188cf90191b4a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:23.215544 22824 consensus_queue.cc:1048] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dad85592ac43e9bfad3ee2aced7296" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.427170 11576 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:23.432858 11576 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:11:23.433409 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:23.440261 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:11:23.440801 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:24.476897 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
W20260709 13:11:24.514832 22406 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:11:24.519423 22406 consensus_peers.cc:597] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.529664 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:24.530673 11576 tablet_replica.cc:333] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.531407 11576 raft_consensus.cc:2243] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.532015 11576 raft_consensus.cc:2272] T 9c989e05630b4961a1e2791ac93ddab4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.534678 11576 tablet_replica.cc:333] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.535355 11576 raft_consensus.cc:2243] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.536391 11576 raft_consensus.cc:2272] T ed972efc29854a5cafb708f4574b8e55 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.538630 11576 tablet_replica.cc:333] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.539294 11576 raft_consensus.cc:2243] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.539851 11576 raft_consensus.cc:2272] T 6cce7828b6c042f683a1fbf25553f9a9 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.542006 11576 tablet_replica.cc:333] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.542677 11576 raft_consensus.cc:2243] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.543634 11576 raft_consensus.cc:2272] T ed21523595444224b0e33d58706b0a3c P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.546520 11576 tablet_replica.cc:333] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.547309 11576 raft_consensus.cc:2243] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.547869 11576 raft_consensus.cc:2272] T 15e614ef73b84786b4df436b6efb2a14 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.550518 11576 tablet_replica.cc:333] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.551293 11576 raft_consensus.cc:2243] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.552327 11576 raft_consensus.cc:2272] T b386d438715d43ec90fa734ad1ad31e2 P 36dad85592ac43e9bfad3ee2aced7296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.554800 11576 tablet_replica.cc:333] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.555382 11576 raft_consensus.cc:2243] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.556270 11576 raft_consensus.cc:2272] T b2acf583f5f84a4abe788f2659477953 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.558246 11576 tablet_replica.cc:333] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.558924 11576 raft_consensus.cc:2243] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.559362 11576 raft_consensus.cc:2272] T b81c8b60fc4144f1a7d8a87370175ec8 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.561317 11576 tablet_replica.cc:333] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.561851 11576 raft_consensus.cc:2243] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.562289 11576 raft_consensus.cc:2272] T 1179f88a74484ed195aa0bb2cef6ef3a P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.564430 11576 tablet_replica.cc:333] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.564937 11576 raft_consensus.cc:2243] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.565371 11576 raft_consensus.cc:2272] T 7a564c9f1c7840cf8baec73c7bc4b357 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.567409 11576 tablet_replica.cc:333] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.567931 11576 raft_consensus.cc:2243] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.568356 11576 raft_consensus.cc:2272] T 81500240a0fb40a9b2ffc5bd7faaa984 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.570430 11576 tablet_replica.cc:333] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.571012 11576 raft_consensus.cc:2243] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.571427 11576 raft_consensus.cc:2272] T f5d883b9af0946c580a79f7e9e9824b5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.573791 11576 tablet_replica.cc:333] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.574369 11576 raft_consensus.cc:2243] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.575194 11576 raft_consensus.cc:2272] T 2cff88ddd5394d958dccc2033f8cba0f P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.577267 11576 tablet_replica.cc:333] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.577853 11576 raft_consensus.cc:2243] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.578294 11576 raft_consensus.cc:2272] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.580436 11576 tablet_replica.cc:333] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.581034 11576 raft_consensus.cc:2243] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.581671 11576 raft_consensus.cc:2272] T 341ea2ab9b194d0fbf85a6c43459d43e P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.585026 11576 tablet_replica.cc:333] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.585685 11576 raft_consensus.cc:2243] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.586333 11576 raft_consensus.cc:2272] T 7c4ea5df3fdb4b86be5596f6927313d5 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.588771 11576 tablet_replica.cc:333] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.589359 11576 raft_consensus.cc:2243] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.589941 11576 raft_consensus.cc:2272] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 36dad85592ac43e9bfad3ee2aced7296 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.591976 11576 tablet_replica.cc:333] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296: stopping tablet replica
I20260709 13:11:24.592636 11576 raft_consensus.cc:2243] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.593613 11576 raft_consensus.cc:2272] T 856926a8717f459a8d9d75ad0bedf155 P 36dad85592ac43e9bfad3ee2aced7296 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.603593 22406 consensus_peers.cc:597] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.632819 22480 consensus_peers.cc:597] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.642005 22480 consensus_peers.cc:597] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.643824 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
W20260709 13:11:24.675571 22480 consensus_peers.cc:597] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.678124 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:11:24.685823 22480 consensus_peers.cc:597] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.711423 22481 consensus_peers.cc:597] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 -> Peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Couldn't send request to peer b361ecda55dd4d19b23d48e52f5f3c7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.714442 22481 consensus_peers.cc:597] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 -> Peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Couldn't send request to peer b361ecda55dd4d19b23d48e52f5f3c7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.723440 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:24.725466 11576 tablet_replica.cc:333] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.726254 11576 raft_consensus.cc:2243] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.726806 11576 raft_consensus.cc:2272] T 9c989e05630b4961a1e2791ac93ddab4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.729538 11576 tablet_replica.cc:333] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.730566 11576 raft_consensus.cc:2243] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.731647 11576 raft_consensus.cc:2272] T 6cce7828b6c042f683a1fbf25553f9a9 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.733985 11576 tablet_replica.cc:333] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.734562 11576 raft_consensus.cc:2243] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.735005 11576 raft_consensus.cc:2272] T ed972efc29854a5cafb708f4574b8e55 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.737031 11576 tablet_replica.cc:333] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.737772 11576 raft_consensus.cc:2243] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.738265 11576 raft_consensus.cc:2272] T ed21523595444224b0e33d58706b0a3c P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.740132 11576 tablet_replica.cc:333] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.740715 11576 raft_consensus.cc:2243] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.741117 11576 raft_consensus.cc:2272] T 341ea2ab9b194d0fbf85a6c43459d43e P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.743031 11576 tablet_replica.cc:333] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.743539 11576 raft_consensus.cc:2243] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.744376 11576 raft_consensus.cc:2272] T 15e614ef73b84786b4df436b6efb2a14 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.746189 11576 tablet_replica.cc:333] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.746737 11576 raft_consensus.cc:2243] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.747114 11576 raft_consensus.cc:2272] T b386d438715d43ec90fa734ad1ad31e2 P b361ecda55dd4d19b23d48e52f5f3c7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.749120 11576 tablet_replica.cc:333] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.749763 11576 raft_consensus.cc:2243] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.750144 11576 raft_consensus.cc:2272] T b2acf583f5f84a4abe788f2659477953 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.751865 11576 tablet_replica.cc:333] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.752444 11576 raft_consensus.cc:2243] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.752893 11576 raft_consensus.cc:2272] T b81c8b60fc4144f1a7d8a87370175ec8 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.754693 11576 tablet_replica.cc:333] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.755239 11576 raft_consensus.cc:2243] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.755934 11576 raft_consensus.cc:2272] T 7a564c9f1c7840cf8baec73c7bc4b357 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.757937 11576 tablet_replica.cc:333] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.758443 11576 raft_consensus.cc:2243] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.758793 11576 raft_consensus.cc:2272] T 1179f88a74484ed195aa0bb2cef6ef3a P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.760752 11576 tablet_replica.cc:333] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.761274 11576 raft_consensus.cc:2243] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.761981 11576 raft_consensus.cc:2272] T f5d883b9af0946c580a79f7e9e9824b5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.763888 11576 tablet_replica.cc:333] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.764390 11576 raft_consensus.cc:2243] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.764746 11576 raft_consensus.cc:2272] T 81500240a0fb40a9b2ffc5bd7faaa984 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.766814 11576 tablet_replica.cc:333] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.767302 11576 raft_consensus.cc:2243] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.767997 11576 raft_consensus.cc:2272] T a0dc8ec80a4049a29c3fa6f65a33edb4 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.769999 11576 tablet_replica.cc:333] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.770505 11576 raft_consensus.cc:2243] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.770869 11576 raft_consensus.cc:2272] T 2cff88ddd5394d958dccc2033f8cba0f P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.772837 11576 tablet_replica.cc:333] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.773294 11576 raft_consensus.cc:2243] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.773995 11576 raft_consensus.cc:2272] T 7c4ea5df3fdb4b86be5596f6927313d5 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.775695 11576 tablet_replica.cc:333] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.776247 11576 raft_consensus.cc:2243] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.776731 11576 raft_consensus.cc:2272] T 4e411ea2dc2e40d8bcd77e9329f5d95d P b361ecda55dd4d19b23d48e52f5f3c7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.778859 11576 tablet_replica.cc:333] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e: stopping tablet replica
I20260709 13:11:24.779453 11576 raft_consensus.cc:2243] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.779953 11576 raft_consensus.cc:2272] T 856926a8717f459a8d9d75ad0bedf155 P b361ecda55dd4d19b23d48e52f5f3c7e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.781704 22481 consensus_peers.cc:597] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 -> Peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Couldn't send request to peer b361ecda55dd4d19b23d48e52f5f3c7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.810901 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
W20260709 13:11:24.839607 22480 consensus_peers.cc:597] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.846585 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
W20260709 13:11:24.869477 22480 consensus_peers.cc:597] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 -> Peer 36dad85592ac43e9bfad3ee2aced7296 (127.11.78.1:36251): Couldn't send request to peer 36dad85592ac43e9bfad3ee2aced7296. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:36251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.890152 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:24.890682 22481 consensus_peers.cc:597] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 -> Peer b361ecda55dd4d19b23d48e52f5f3c7e (127.11.78.2:45955): Couldn't send request to peer b361ecda55dd4d19b23d48e52f5f3c7e. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:45955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.891573 11576 tablet_replica.cc:333] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.892783 11576 raft_consensus.cc:2243] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.894146 11576 raft_consensus.cc:2272] T 9c989e05630b4961a1e2791ac93ddab4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.896658 11576 tablet_replica.cc:333] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.897290 11576 raft_consensus.cc:2243] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.897763 11576 raft_consensus.cc:2272] T 6cce7828b6c042f683a1fbf25553f9a9 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.899927 11576 tablet_replica.cc:333] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.900694 11576 raft_consensus.cc:2243] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.901162 11576 raft_consensus.cc:2272] T ed21523595444224b0e33d58706b0a3c P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.903195 11576 tablet_replica.cc:333] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.903801 11576 raft_consensus.cc:2243] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.904320 11576 raft_consensus.cc:2272] T ed972efc29854a5cafb708f4574b8e55 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.906637 11576 tablet_replica.cc:333] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.907215 11576 raft_consensus.cc:2243] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.907660 11576 raft_consensus.cc:2272] T 7c4ea5df3fdb4b86be5596f6927313d5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.909788 11576 tablet_replica.cc:333] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.910503 11576 raft_consensus.cc:2243] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.910997 11576 raft_consensus.cc:2272] T 856926a8717f459a8d9d75ad0bedf155 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.913290 11576 tablet_replica.cc:333] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.913861 11576 raft_consensus.cc:2243] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.914798 11576 raft_consensus.cc:2272] T 4e411ea2dc2e40d8bcd77e9329f5d95d P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.917232 11576 tablet_replica.cc:333] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.917919 11576 raft_consensus.cc:2243] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.918874 11576 raft_consensus.cc:2272] T 341ea2ab9b194d0fbf85a6c43459d43e P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.921442 11576 tablet_replica.cc:333] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.922115 11576 raft_consensus.cc:2243] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.922659 11576 raft_consensus.cc:2272] T 2cff88ddd5394d958dccc2033f8cba0f P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.925372 11576 tablet_replica.cc:333] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.925995 11576 raft_consensus.cc:2243] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.926524 11576 raft_consensus.cc:2272] T a0dc8ec80a4049a29c3fa6f65a33edb4 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.929090 11576 tablet_replica.cc:333] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.929802 11576 raft_consensus.cc:2243] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.930234 11576 raft_consensus.cc:2272] T 15e614ef73b84786b4df436b6efb2a14 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.932322 11576 tablet_replica.cc:333] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.932873 11576 raft_consensus.cc:2243] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.933291 11576 raft_consensus.cc:2272] T b2acf583f5f84a4abe788f2659477953 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.935226 11576 tablet_replica.cc:333] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.935752 11576 raft_consensus.cc:2243] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.936167 11576 raft_consensus.cc:2272] T b386d438715d43ec90fa734ad1ad31e2 P 898d51d3c83f4012b2188cf90191b4a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.938365 11576 tablet_replica.cc:333] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.938886 11576 raft_consensus.cc:2243] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.939706 11576 raft_consensus.cc:2272] T b81c8b60fc4144f1a7d8a87370175ec8 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.941776 11576 tablet_replica.cc:333] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.942308 11576 raft_consensus.cc:2243] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.942768 11576 raft_consensus.cc:2272] T 7a564c9f1c7840cf8baec73c7bc4b357 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.945210 11576 tablet_replica.cc:333] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.945741 11576 raft_consensus.cc:2243] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.946568 11576 raft_consensus.cc:2272] T 1179f88a74484ed195aa0bb2cef6ef3a P 898d51d3c83f4012b2188cf90191b4a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.948877 11576 tablet_replica.cc:333] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.949442 11576 raft_consensus.cc:2243] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.950268 11576 raft_consensus.cc:2272] T 81500240a0fb40a9b2ffc5bd7faaa984 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.952548 11576 tablet_replica.cc:333] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4: stopping tablet replica
I20260709 13:11:24.953056 11576 raft_consensus.cc:2243] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.953625 11576 raft_consensus.cc:2272] T f5d883b9af0946c580a79f7e9e9824b5 P 898d51d3c83f4012b2188cf90191b4a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.997331 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:11:25.035970 11576 master.cc:562] Master@127.11.78.62:41453 shutting down...
I20260709 13:11:25.068418 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.069140 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.069581 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P 36d0768454884987b731bd5818e2a14c: stopping tablet replica
I20260709 13:11:25.092926 11576 master.cc:584] Master@127.11.78.62:41453 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13102 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:11:25.152405 11576 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.78.62:38335
I20260709 13:11:25.153743 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:25.160414 22840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.160615 22841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.160730 22843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:25.162766 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:25.163875 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:25.164212 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:25.164402 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602685164374 us; error 0 us; skew 500 ppm
I20260709 13:11:25.164996 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:25.168009 11576 webserver.cc:533] Webserver started at http://127.11.78.62:36677/ using document root <none> and password file <none>
I20260709 13:11:25.168632 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:25.168857 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:25.169189 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:25.170387 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/master-0-root/instance:
uuid: "7f68f4edb3044ac7bb16413b5af80e47"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.175348 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:11:25.179029 22848 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.180125 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:25.180423 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/master-0-root
uuid: "7f68f4edb3044ac7bb16413b5af80e47"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.180689 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:25.191672 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:25.193176 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:25.240638 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.62:38335
I20260709 13:11:25.240790 22899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.62:38335 every 8 connection(s)
I20260709 13:11:25.245230 22900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.257364 22900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: Bootstrap starting.
I20260709 13:11:25.262351 22900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.266989 22900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: No bootstrap required, opened a new log
I20260709 13:11:25.269410 22900 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.269788 22900 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.270061 22900 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68f4edb3044ac7bb16413b5af80e47, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.271399 22900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.272091 22903 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.272750 22903 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.273465 22903 leader_election.cc:304] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f68f4edb3044ac7bb16413b5af80e47; no voters: 
I20260709 13:11:25.271932 22900 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:25.276233 22904 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.276230 22903 leader_election.cc:290] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 
I20260709 13:11:25.276961 22904 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.277648 22904 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.285929 22904 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.286835 22900 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:25.286795 22904 leader_election.cc:304] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f68f4edb3044ac7bb16413b5af80e47; no voters: 
I20260709 13:11:25.287403 22900 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.287765 22904 leader_election.cc:290] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:25.294255 22900 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.295332 22903 raft_consensus.cc:2764] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 FOLLOWER]: Leader election decision vote started in defunct term 1: won
I20260709 13:11:25.296756 22900 leader_election.cc:304] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f68f4edb3044ac7bb16413b5af80e47; no voters: 
I20260709 13:11:25.297466 22900 leader_election.cc:290] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260709 13:11:25.297602 22904 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:25.299290 22904 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68f4edb3044ac7bb16413b5af80e47, State: Running, Role: LEADER
I20260709 13:11:25.300205 22904 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER }
I20260709 13:11:25.300572 22900 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:25.305299 22903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7f68f4edb3044ac7bb16413b5af80e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER } }
I20260709 13:11:25.306207 22903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:25.314949 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f68f4edb3044ac7bb16413b5af80e47. Latest consensus state: current_term: 2 leader_uuid: "7f68f4edb3044ac7bb16413b5af80e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f68f4edb3044ac7bb16413b5af80e47" member_type: VOTER } }
I20260709 13:11:25.315960 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:25.318567 22911 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:25.328439 22911 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:25.340845 11576 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:25.344331 22911 catalog_manager.cc:1383] Generated new cluster ID: bb673105ca7b458e8bf469498f389261
I20260709 13:11:25.344751 22911 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:25.372390 22911 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:25.373947 22911 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:25.394795 22911 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: Generated new TSK 0
I20260709 13:11:25.395566 22911 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:25.412456 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:25.419221 22922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.420644 22923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.422065 22925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:25.422314 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:25.423403 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:25.423629 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:25.423844 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602685423826 us; error 0 us; skew 500 ppm
I20260709 13:11:25.424403 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:25.426932 11576 webserver.cc:533] Webserver started at http://127.11.78.1:34577/ using document root <none> and password file <none>
I20260709 13:11:25.427464 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:25.427672 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:25.427943 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:25.429103 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-0-root/instance:
uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.433607 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:11:25.437279 22930 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.438253 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:11:25.438616 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-0-root
uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.438920 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:25.460680 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:25.461963 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:25.463532 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:25.466142 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:25.466394 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.466660 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:25.466856 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.517419 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.1:41461
I20260709 13:11:25.517601 22992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.1:41461 every 8 connection(s)
I20260709 13:11:25.522686 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:25.530324 22997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.532373 22998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.534652 23000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:25.537506 11576 server_base.cc:1061] running on GCE node
I20260709 13:11:25.537737 22993 heartbeater.cc:344] Connected to a master server at 127.11.78.62:38335
I20260709 13:11:25.538368 22993 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:25.539172 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:25.539520 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:25.539389 22993 heartbeater.cc:507] Master 127.11.78.62:38335 requested a full tablet report, sending...
I20260709 13:11:25.539961 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602685539943 us; error 0 us; skew 500 ppm
I20260709 13:11:25.540766 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:25.542651 22865 ts_manager.cc:194] Registered new tserver with Master: cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461)
I20260709 13:11:25.543964 11576 webserver.cc:533] Webserver started at http://127.11.78.2:39351/ using document root <none> and password file <none>
I20260709 13:11:25.544750 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:25.544988 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:25.545428 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:25.545519 22865 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59062
I20260709 13:11:25.547083 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-1-root/instance:
uuid: "3326d8cd3827437abd58e4f78a6a648f"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.552807 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:11:25.556879 23005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.557940 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:11:25.558387 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-1-root
uuid: "3326d8cd3827437abd58e4f78a6a648f"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.558712 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:25.575845 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:25.577150 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:25.578758 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:25.581328 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:25.581564 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.581822 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:25.582026 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.629420 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.2:32831
I20260709 13:11:25.629699 23067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.2:32831 every 8 connection(s)
I20260709 13:11:25.634438 11576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:25.643071 23071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:25.643178 23072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:25.646836 11576 server_base.cc:1061] running on GCE node
W20260709 13:11:25.647915 23075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:25.649104 23068 heartbeater.cc:344] Connected to a master server at 127.11.78.62:38335
I20260709 13:11:25.649340 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:25.649631 23068 heartbeater.cc:461] Registering TS with master...
W20260709 13:11:25.649664 11576 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:25.650066 11576 hybrid_clock.cc:648] HybridClock initialized: now 1783602685650042 us; error 0 us; skew 500 ppm
I20260709 13:11:25.650797 23068 heartbeater.cc:507] Master 127.11.78.62:38335 requested a full tablet report, sending...
I20260709 13:11:25.650920 11576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:25.653563 22865 ts_manager.cc:194] Registered new tserver with Master: 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:25.654291 11576 webserver.cc:533] Webserver started at http://127.11.78.3:38997/ using document root <none> and password file <none>
I20260709 13:11:25.655182 22865 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59072
I20260709 13:11:25.655311 11576 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:25.655776 11576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:25.656237 11576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:25.657771 11576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-2-root/instance:
uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.663304 11576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:11:25.667474 23079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.668599 11576 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:25.668932 11576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-2-root
uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
format_stamp: "Formatted at 2026-07-09 13:11:25 on dist-test-slave-smzk"
I20260709 13:11:25.669214 11576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskuOpmZv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602346059955-11576-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:25.683961 11576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:25.685387 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:25.686869 11576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:25.689659 11576 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:25.689884 11576 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.690245 11576 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:25.690418 11576 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:25.742722 11576 rpc_server.cc:307] RPC server started. Bound to: 127.11.78.3:38021
I20260709 13:11:25.742882 23141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.78.3:38021 every 8 connection(s)
I20260709 13:11:25.758458 23142 heartbeater.cc:344] Connected to a master server at 127.11.78.62:38335
I20260709 13:11:25.759056 23142 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:25.759918 23142 heartbeater.cc:507] Master 127.11.78.62:38335 requested a full tablet report, sending...
I20260709 13:11:25.762460 22865 ts_manager.cc:194] Registered new tserver with Master: b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:25.763357 11576 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017432721s
I20260709 13:11:25.764367 22865 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59082
I20260709 13:11:25.793497 22865 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59094:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:25.796595 22865 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:25.890021 22958 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57edd2238b4de19f87575c99a7a256 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:25.890686 22956 tablet_service.cc:1511] Processing CreateTablet for tablet c7c63c4dac964c74ad67410e25b4fde4 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:25.891646 22958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57edd2238b4de19f87575c99a7a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.893219 23031 tablet_service.cc:1511] Processing CreateTablet for tablet c7c63c4dac964c74ad67410e25b4fde4 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:25.894282 22957 tablet_service.cc:1511] Processing CreateTablet for tablet 50a3a12d815f4d0da46463297152bcda (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:25.895671 22957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a3a12d815f4d0da46463297152bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.893219 23033 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57edd2238b4de19f87575c99a7a256 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:25.894729 23031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c63c4dac964c74ad67410e25b4fde4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.899976 23033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57edd2238b4de19f87575c99a7a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.901240 22956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c63c4dac964c74ad67410e25b4fde4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.901978 23032 tablet_service.cc:1511] Processing CreateTablet for tablet 50a3a12d815f4d0da46463297152bcda (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:25.903435 23032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a3a12d815f4d0da46463297152bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.915524 22955 tablet_service.cc:1511] Processing CreateTablet for tablet 069e6e43e1ff403aaaf3d856b334b82c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:25.917138 22955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e6e43e1ff403aaaf3d856b334b82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.922669 23107 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57edd2238b4de19f87575c99a7a256 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:25.924700 23107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57edd2238b4de19f87575c99a7a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.925671 23030 tablet_service.cc:1511] Processing CreateTablet for tablet 069e6e43e1ff403aaaf3d856b334b82c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:25.927961 23030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e6e43e1ff403aaaf3d856b334b82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.933856 23106 tablet_service.cc:1511] Processing CreateTablet for tablet 50a3a12d815f4d0da46463297152bcda (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:25.935635 23106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a3a12d815f4d0da46463297152bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.934144 23105 tablet_service.cc:1511] Processing CreateTablet for tablet c7c63c4dac964c74ad67410e25b4fde4 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:25.935793 23104 tablet_service.cc:1511] Processing CreateTablet for tablet 069e6e43e1ff403aaaf3d856b334b82c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:25.936954 23105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c63c4dac964c74ad67410e25b4fde4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.938062 23104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e6e43e1ff403aaaf3d856b334b82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.927850 23158 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:25.947101 23158 tablet_bootstrap.cc:654] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.963701 23158 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:25.964448 23158 ts_tablet_manager.cc:1403] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.004s
I20260709 13:11:25.968609 23158 raft_consensus.cc:359] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:25.970976 23158 raft_consensus.cc:385] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.971752 23158 raft_consensus.cc:740] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.972656 22954 tablet_service.cc:1511] Processing CreateTablet for tablet b58d59b8c8274ee0a96eba36acc79e1b (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:25.974323 22954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58d59b8c8274ee0a96eba36acc79e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.973097 23158 consensus_queue.cc:260] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:25.981446 23157 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:25.985349 23160 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:25.989497 23031 tablet_service.cc:1511] Processing CreateTablet for tablet b58d59b8c8274ee0a96eba36acc79e1b (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:25.995890 23031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58d59b8c8274ee0a96eba36acc79e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.000188 23157 tablet_bootstrap.cc:654] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.000188 23160 tablet_bootstrap.cc:654] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.008641 22956 tablet_service.cc:1511] Processing CreateTablet for tablet c014062df5e24baa9b6a397533bee16a (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:26.009255 23157 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.009774 23157 ts_tablet_manager.cc:1403] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.009s
I20260709 13:11:26.010066 22956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c014062df5e24baa9b6a397533bee16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.012809 23157 raft_consensus.cc:359] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.013754 23157 raft_consensus.cc:385] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.014045 23157 raft_consensus.cc:740] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.015297 23106 tablet_service.cc:1511] Processing CreateTablet for tablet b58d59b8c8274ee0a96eba36acc79e1b (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:26.016417 23068 heartbeater.cc:499] Master 127.11.78.62:38335 was elected leader, sending a full tablet report...
I20260709 13:11:26.017119 23106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58d59b8c8274ee0a96eba36acc79e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.017256 23158 ts_tablet_manager.cc:1434] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.052s	user 0.016s	sys 0.007s
I20260709 13:11:26.028415 23158 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.028805 23107 tablet_service.cc:1511] Processing CreateTablet for tablet d6cabc6582df46be9f2bb1de64cb9a1c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:26.030176 23107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cabc6582df46be9f2bb1de64cb9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.020790 23033 tablet_service.cc:1511] Processing CreateTablet for tablet c014062df5e24baa9b6a397533bee16a (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:26.035854 23158 tablet_bootstrap.cc:654] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.022050 23105 tablet_service.cc:1511] Processing CreateTablet for tablet c014062df5e24baa9b6a397533bee16a (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:26.022858 22954 tablet_service.cc:1511] Processing CreateTablet for tablet d6cabc6582df46be9f2bb1de64cb9a1c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:26.040412 23033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c014062df5e24baa9b6a397533bee16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.040886 22954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cabc6582df46be9f2bb1de64cb9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.043031 23105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c014062df5e24baa9b6a397533bee16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.043951 22958 tablet_service.cc:1511] Processing CreateTablet for tablet d163a730a2b3441f9eeca1aedaa447d8 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:26.045431 22958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d163a730a2b3441f9eeca1aedaa447d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.023976 23157 consensus_queue.cc:260] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.024920 23030 tablet_service.cc:1511] Processing CreateTablet for tablet d6cabc6582df46be9f2bb1de64cb9a1c (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:26.049499 23030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cabc6582df46be9f2bb1de64cb9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.026981 23160 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.052497 23160 ts_tablet_manager.cc:1403] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.004s
I20260709 13:11:26.053458 23104 tablet_service.cc:1511] Processing CreateTablet for tablet d163a730a2b3441f9eeca1aedaa447d8 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:26.054956 23104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d163a730a2b3441f9eeca1aedaa447d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.056710 23160 raft_consensus.cc:359] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.059396 23160 raft_consensus.cc:385] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.059017 23032 tablet_service.cc:1511] Processing CreateTablet for tablet c7d30a9cde334427be79e05cb5d521bb (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:26.059850 23160 raft_consensus.cc:740] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.060693 23032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d30a9cde334427be79e05cb5d521bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.061029 23160 consensus_queue.cc:260] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.077221 23031 tablet_service.cc:1511] Processing CreateTablet for tablet d163a730a2b3441f9eeca1aedaa447d8 (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:26.087666 23031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d163a730a2b3441f9eeca1aedaa447d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.091354 23103 tablet_service.cc:1511] Processing CreateTablet for tablet c7d30a9cde334427be79e05cb5d521bb (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:26.093701 23158 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.094342 23158 ts_tablet_manager.cc:1403] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.012s
I20260709 13:11:26.097307 23158 raft_consensus.cc:359] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.098006 23158 raft_consensus.cc:385] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.098326 23158 raft_consensus.cc:740] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.099686 23103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d30a9cde334427be79e05cb5d521bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.103261 23160 ts_tablet_manager.cc:1434] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.001s
I20260709 13:11:26.104120 23142 heartbeater.cc:499] Master 127.11.78.62:38335 was elected leader, sending a full tablet report...
I20260709 13:11:26.104442 23160 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.107538 23158 consensus_queue.cc:260] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.109274 22956 tablet_service.cc:1511] Processing CreateTablet for tablet c7d30a9cde334427be79e05cb5d521bb (DEFAULT_TABLE table=test-workload [id=cd900feb481b4a1d9e5c9b7889d339c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:26.110792 22956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d30a9cde334427be79e05cb5d521bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:26.112267 23158 ts_tablet_manager.cc:1434] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:11:26.112640 22993 heartbeater.cc:499] Master 127.11.78.62:38335 was elected leader, sending a full tablet report...
I20260709 13:11:26.113694 23158 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.118701 23157 ts_tablet_manager.cc:1434] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 13:11:26.121456 23158 tablet_bootstrap.cc:654] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.134156 23160 tablet_bootstrap.cc:654] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.143803 23157 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.145218 23158 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.145793 23158 ts_tablet_manager.cc:1403] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 13:11:26.151551 23157 tablet_bootstrap.cc:654] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.159118 23158 raft_consensus.cc:359] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.159998 23158 raft_consensus.cc:385] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.160348 23158 raft_consensus.cc:740] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.161387 23158 consensus_queue.cc:260] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.163790 23160 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.164837 23160 ts_tablet_manager.cc:1403] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.004s
I20260709 13:11:26.165536 23158 ts_tablet_manager.cc:1434] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:11:26.167482 23158 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.169484 23160 raft_consensus.cc:359] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.170454 23157 tablet_bootstrap.cc:492] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.170506 23160 raft_consensus.cc:385] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.171111 23157 ts_tablet_manager.cc:1403] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.008s
I20260709 13:11:26.171054 23160 raft_consensus.cc:740] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.172437 23160 consensus_queue.cc:260] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.174435 23157 raft_consensus.cc:359] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.175199 23157 raft_consensus.cc:385] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.175493 23157 raft_consensus.cc:740] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.176213 23158 tablet_bootstrap.cc:654] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.176812 23160 ts_tablet_manager.cc:1434] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:11:26.176265 23157 consensus_queue.cc:260] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.177961 23160 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.216789 23161 raft_consensus.cc:493] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.218655 23161 raft_consensus.cc:515] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.227092 23160 tablet_bootstrap.cc:654] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.238345 23161 leader_election.cc:290] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.238837 23157 ts_tablet_manager.cc:1434] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.004s
I20260709 13:11:26.243240 23158 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.244462 23158 ts_tablet_manager.cc:1403] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.011s
I20260709 13:11:26.250315 23157 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.255100 23160 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.251323 23158 raft_consensus.cc:359] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.258297 23158 raft_consensus.cc:385] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.261363 23158 raft_consensus.cc:740] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.263413 23158 consensus_queue.cc:260] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.264606 23160 ts_tablet_manager.cc:1403] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.016s
I20260709 13:11:26.269750 23157 tablet_bootstrap.cc:654] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.270184 23161 raft_consensus.cc:493] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.270865 23161 raft_consensus.cc:515] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.274200 23158 ts_tablet_manager.cc:1434] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 13:11:26.276588 23158 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.280725 23161 leader_election.cc:290] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.287289 23160 raft_consensus.cc:359] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.288272 23166 raft_consensus.cc:493] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.289038 23166 raft_consensus.cc:515] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.290414 23158 tablet_bootstrap.cc:654] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.292075 23157 tablet_bootstrap.cc:492] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.292748 23157 ts_tablet_manager.cc:1403] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.004s
I20260709 13:11:26.288334 23160 raft_consensus.cc:385] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.294283 23160 raft_consensus.cc:740] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.295275 23160 consensus_queue.cc:260] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.296552 23157 raft_consensus.cc:359] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.297427 23157 raft_consensus.cc:385] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.297726 23157 raft_consensus.cc:740] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.298239 23166 leader_election.cc:290] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.298659 23157 consensus_queue.cc:260] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.304127 23165 raft_consensus.cc:493] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.304761 23165 raft_consensus.cc:515] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
W20260709 13:11:26.312566 22913 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:26.318699 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.319188 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.320248 22967 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
W20260709 13:11:26.321401 23006 leader_election.cc:343] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.322224 23165 leader_election.cc:290] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.324857 23160 ts_tablet_manager.cc:1434] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.057s	user 0.015s	sys 0.001s
I20260709 13:11:26.324992 23006 leader_election.cc:304] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.327432 23158 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.331923 23161 raft_consensus.cc:2804] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.332437 23161 raft_consensus.cc:493] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.332528 23158 ts_tablet_manager.cc:1403] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.025s
I20260709 13:11:26.332926 23161 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.328053 23157 ts_tablet_manager.cc:1434] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:11:26.336021 23157 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.335858 23158 raft_consensus.cc:359] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.336694 23158 raft_consensus.cc:385] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.337029 23158 raft_consensus.cc:740] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.338104 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.337958 23158 consensus_queue.cc:260] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.340914 23117 raft_consensus.cc:2468] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:26.348609 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.349100 23009 leader_election.cc:304] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.349647 23116 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:26.366976 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.367839 22967 raft_consensus.cc:2468] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:26.369465 23080 leader_election.cc:304] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.370554 23179 raft_consensus.cc:2804] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.370802 23184 raft_consensus.cc:2804] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.371078 23179 raft_consensus.cc:493] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.371346 23184 raft_consensus.cc:493] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.371591 23179 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.371793 23184 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.377677 23161 raft_consensus.cc:515] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.381124 23161 leader_election.cc:290] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.381469 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.382380 22967 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.382735 23160 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.385581 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:26.388283 23116 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.397078 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.398267 23043 raft_consensus.cc:2468] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:26.400379 22931 leader_election.cc:304] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.401485 23160 tablet_bootstrap.cc:654] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.401613 23165 raft_consensus.cc:2804] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.402143 23165 raft_consensus.cc:493] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.402499 23165 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.402882 23158 ts_tablet_manager.cc:1434] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.011s
I20260709 13:11:26.403620 23157 tablet_bootstrap.cc:654] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.407253 23158 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.409228 23184 raft_consensus.cc:515] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.411206 23179 raft_consensus.cc:515] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.414850 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.415699 22968 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.414911 23116 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:26.415144 23158 tablet_bootstrap.cc:654] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.418063 23009 leader_election.cc:304] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:26.419157 23185 raft_consensus.cc:2804] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.419714 23185 raft_consensus.cc:697] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:26.420872 23185 consensus_queue.cc:237] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.425015 22966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.425434 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:26.426338 23117 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:26.426986 23006 leader_election.cc:343] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.428794 23115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.429325 23165 raft_consensus.cc:515] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
W20260709 13:11:26.431083 22934 leader_election.cc:343] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.433517 23165 leader_election.cc:290] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.433846 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:26.435016 23043 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.435282 23115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
W20260709 13:11:26.437062 22934 leader_election.cc:343] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.444394 23184 leader_election.cc:290] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.448243 22968 raft_consensus.cc:2468] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:26.453202 23042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.453857 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:26.454628 23042 raft_consensus.cc:2468] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:26.448582 22967 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:26.449008 23043 raft_consensus.cc:2468] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:26.456158 23080 leader_election.cc:304] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.457450 23166 raft_consensus.cc:2804] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.458032 22931 leader_election.cc:304] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:26.458739 23158 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.449836 23179 leader_election.cc:290] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.453171 23157 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.459806 23157 ts_tablet_manager.cc:1403] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.000s
I20260709 13:11:26.459720 23165 raft_consensus.cc:2804] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.461750 23158 ts_tablet_manager.cc:1403] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.012s
I20260709 13:11:26.465025 23157 raft_consensus.cc:359] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.466560 23157 raft_consensus.cc:385] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.467069 23157 raft_consensus.cc:740] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.468569 23157 consensus_queue.cc:260] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.469633 23158 raft_consensus.cc:359] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.470503 23158 raft_consensus.cc:385] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.470871 23158 raft_consensus.cc:740] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.472781 22863 catalog_manager.cc:5697] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 1 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.474933 23158 consensus_queue.cc:260] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.479707 23158 ts_tablet_manager.cc:1434] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 13:11:26.481256 23158 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.487645 23157 ts_tablet_manager.cc:1434] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:11:26.490720 23157 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.500434 23166 raft_consensus.cc:697] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:26.495857 23158 tablet_bootstrap.cc:654] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.504112 23157 tablet_bootstrap.cc:654] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.503479 23166 consensus_queue.cc:237] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.512423 23117 raft_consensus.cc:2468] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:26.516814 23158 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.520820 23165 raft_consensus.cc:697] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:26.521943 23160 tablet_bootstrap.cc:492] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.522822 23160 ts_tablet_manager.cc:1403] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.141s	user 0.030s	sys 0.032s
I20260709 13:11:26.522686 23165 consensus_queue.cc:237] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.524989 23009 leader_election.cc:304] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.517601 23158 ts_tablet_manager.cc:1403] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.009s
I20260709 13:11:26.530267 23185 raft_consensus.cc:2804] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.532442 23185 raft_consensus.cc:697] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:26.533774 23185 consensus_queue.cc:237] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.538133 23191 raft_consensus.cc:493] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.539208 23191 raft_consensus.cc:515] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.539827 23184 raft_consensus.cc:493] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.540690 23184 raft_consensus.cc:515] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.543533 23184 leader_election.cc:290] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.544108 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.544998 23043 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:26.545820 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.546190 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.547183 22931 leader_election.cc:304] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.547760 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
W20260709 13:11:26.548065 23009 leader_election.cc:343] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.548427 23192 raft_consensus.cc:2804] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.548930 23192 raft_consensus.cc:493] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:26.549218 22934 leader_election.cc:343] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.549337 23192 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.557569 23160 raft_consensus.cc:359] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.558763 23160 raft_consensus.cc:385] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.559147 23160 raft_consensus.cc:740] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.551793 23158 raft_consensus.cc:359] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.563274 23158 raft_consensus.cc:385] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.563688 23158 raft_consensus.cc:740] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.565030 23158 consensus_queue.cc:260] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.568300 23160 consensus_queue.cc:260] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.573266 22864 catalog_manager.cc:5697] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.574894 23157 tablet_bootstrap.cc:492] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.576000 23185 raft_consensus.cc:493] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.577042 23185 raft_consensus.cc:515] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.580788 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
W20260709 13:11:26.582254 23009 leader_election.cc:343] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.582603 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.583266 23160 ts_tablet_manager.cc:1434] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:11:26.584597 23160 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
W20260709 13:11:26.584755 23006 leader_election.cc:343] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.585414 23006 leader_election.cc:304] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f; no voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.582902 23185 leader_election.cc:290] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.586382 23184 raft_consensus.cc:2749] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.585541 22863 catalog_manager.cc:5697] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.573097 23158 ts_tablet_manager.cc:1434] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:11:26.568063 23191 leader_election.cc:290] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.575883 23157 ts_tablet_manager.cc:1403] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.019s
I20260709 13:11:26.590900 23158 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.590646 23192 raft_consensus.cc:515] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.592311 22967 raft_consensus.cc:2393] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3326d8cd3827437abd58e4f78a6a648f in current term 1: Already voted for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in this term.
I20260709 13:11:26.594753 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:26.594605 22865 catalog_manager.cc:5697] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 1 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.595503 23043 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.596309 23006 leader_election.cc:304] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f; no voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.596676 23192 leader_election.cc:290] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.598636 23160 tablet_bootstrap.cc:654] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.599012 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:26.600247 23157 raft_consensus.cc:359] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
W20260709 13:11:26.601023 22934 leader_election.cc:343] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.601333 23157 raft_consensus.cc:385] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.601706 23157 raft_consensus.cc:740] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.604401 23157 consensus_queue.cc:260] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.604984 23043 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:26.606292 23185 raft_consensus.cc:2749] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.608120 23157 ts_tablet_manager.cc:1434] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:11:26.608999 23166 raft_consensus.cc:493] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.609548 23157 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.609622 23166 raft_consensus.cc:515] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.610601 23158 tablet_bootstrap.cc:654] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.614353 23166 leader_election.cc:290] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.609103 23160 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.615737 23160 ts_tablet_manager.cc:1403] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.003s
I20260709 13:11:26.615067 22931 leader_election.cc:304] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:26.617720 23192 raft_consensus.cc:2804] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.618288 23192 raft_consensus.cc:697] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:26.618834 23157 tablet_bootstrap.cc:654] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.613933 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.620110 23160 raft_consensus.cc:359] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.621268 23160 raft_consensus.cc:385] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.619313 23192 consensus_queue.cc:237] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.622750 23160 raft_consensus.cc:740] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.624137 23160 consensus_queue.cc:260] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.627844 23160 ts_tablet_manager.cc:1434] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:11:26.629498 23160 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.635296 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.636924 23043 raft_consensus.cc:2393] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9a36b5bd1eb4fb79ad35370a0677b57 in current term 1: Already voted for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in this term.
I20260709 13:11:26.638844 23080 leader_election.cc:304] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.640668 23166 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.650697 23160 tablet_bootstrap.cc:654] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.654038 23157 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.654800 23157 ts_tablet_manager.cc:1403] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.020s
I20260709 13:11:26.655149 23166 raft_consensus.cc:2749] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.663980 23160 tablet_bootstrap.cc:492] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.664465 23158 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.664795 23160 ts_tablet_manager.cc:1403] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.003s
I20260709 13:11:26.665169 23158 ts_tablet_manager.cc:1403] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.015s
I20260709 13:11:26.668258 23160 raft_consensus.cc:359] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.668578 23158 raft_consensus.cc:359] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.669147 23160 raft_consensus.cc:385] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.668442 23157 raft_consensus.cc:359] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.669569 23158 raft_consensus.cc:385] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.669622 23160 raft_consensus.cc:740] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.670224 23158 raft_consensus.cc:740] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.670800 23160 consensus_queue.cc:260] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.671933 23158 consensus_queue.cc:260] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.670276 22864 catalog_manager.cc:5697] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.673733 23160 ts_tablet_manager.cc:1434] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:11:26.674530 23158 ts_tablet_manager.cc:1434] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:26.674999 23160 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.675866 23158 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:26.677153 23166 raft_consensus.cc:493] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.677659 23166 raft_consensus.cc:515] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.682653 23158 tablet_bootstrap.cc:654] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.682665 23166 leader_election.cc:290] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.684839 23160 tablet_bootstrap.cc:654] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.684703 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.670192 23157 raft_consensus.cc:385] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.685601 23157 raft_consensus.cc:740] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
W20260709 13:11:26.687016 23080 leader_election.cc:343] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.688225 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.693615 23043 raft_consensus.cc:2468] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:26.694990 23080 leader_election.cc:304] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.696265 23166 raft_consensus.cc:2804] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.696702 23166 raft_consensus.cc:493] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.697256 23166 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.707418 23166 raft_consensus.cc:515] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.708024 23160 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.708539 23157 consensus_queue.cc:260] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.709699 23160 ts_tablet_manager.cc:1403] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 13:11:26.713001 23160 raft_consensus.cc:359] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.713492 23157 ts_tablet_manager.cc:1434] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.001s
I20260709 13:11:26.713701 23160 raft_consensus.cc:385] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.723253 23160 raft_consensus.cc:740] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.717294 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.724362 23160 consensus_queue.cc:260] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
W20260709 13:11:26.725294 23080 leader_election.cc:343] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.727032 23160 ts_tablet_manager.cc:1434] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:11:26.728650 23160 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:26.729569 23157 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.729966 23158 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:26.732185 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:26.732621 23158 ts_tablet_manager.cc:1403] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.057s	user 0.037s	sys 0.009s
I20260709 13:11:26.732975 23043 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.734460 23185 raft_consensus.cc:493] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.735014 23185 raft_consensus.cc:515] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.737205 23185 leader_election.cc:290] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.737537 23190 raft_consensus.cc:493] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.738058 23190 raft_consensus.cc:515] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.738936 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.738754 23158 raft_consensus.cc:359] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.740108 23158 raft_consensus.cc:385] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.740474 23158 raft_consensus.cc:740] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.741850 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.741641 23158 consensus_queue.cc:260] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.742784 22967 raft_consensus.cc:2468] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:26.745695 23158 ts_tablet_manager.cc:1434] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:11:26.746805 23006 leader_election.cc:304] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:26.747928 23185 raft_consensus.cc:2804] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.748378 23185 raft_consensus.cc:493] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.748466 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.748803 23185 raft_consensus.cc:3060] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:26.752174 23009 leader_election.cc:343] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.752420 23080 leader_election.cc:343] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.754341 23190 leader_election.cc:290] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.756196 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.757090 23041 raft_consensus.cc:2468] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:26.758308 23080 leader_election.cc:304] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
W20260709 13:11:26.759895 23143 tablet.cc:2406] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:26.760120 23190 raft_consensus.cc:2804] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.760667 23190 raft_consensus.cc:493] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.761071 23190 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.765723 23160 tablet_bootstrap.cc:654] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.768182 23166 leader_election.cc:290] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.769591 23043 raft_consensus.cc:2468] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:26.770383 23185 raft_consensus.cc:515] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.771219 23080 leader_election.cc:304] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.771965 23190 raft_consensus.cc:515] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.773921 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.774376 23190 leader_election.cc:290] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.774466 23160 tablet_bootstrap.cc:492] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.774575 22967 raft_consensus.cc:3060] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.775162 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:26.775276 23190 raft_consensus.cc:2804] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.775322 23160 ts_tablet_manager.cc:1403] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:11:26.776897 23190 raft_consensus.cc:697] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:26.776978 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:26.777887 23190 consensus_queue.cc:237] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.778787 23160 raft_consensus.cc:359] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.779548 23160 raft_consensus.cc:385] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.779575 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:26.779877 23160 raft_consensus.cc:740] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.780400 23041 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.780829 23160 consensus_queue.cc:260] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.783823 23160 ts_tablet_manager.cc:1434] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
W20260709 13:11:26.785073 23080 leader_election.cc:343] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.785452 23160 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
W20260709 13:11:26.785851 23009 leader_election.cc:343] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.786614 22967 raft_consensus.cc:2468] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:26.773419 23185 leader_election.cc:290] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.788095 23006 leader_election.cc:304] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:26.789037 23185 raft_consensus.cc:2804] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.789530 23185 raft_consensus.cc:697] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:26.790364 23185 consensus_queue.cc:237] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.794203 23160 tablet_bootstrap.cc:654] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.794898 22865 catalog_manager.cc:5697] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.801540 23157 tablet_bootstrap.cc:654] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.803885 22862 catalog_manager.cc:5697] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 1 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.810359 23160 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:26.811213 23160 ts_tablet_manager.cc:1403] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:11:26.815480 23160 raft_consensus.cc:359] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.817282 23160 raft_consensus.cc:385] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.817652 23160 raft_consensus.cc:740] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.818817 23160 consensus_queue.cc:260] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.794433 23041 raft_consensus.cc:2468] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:26.822006 23160 ts_tablet_manager.cc:1434] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 13:11:26.822387 23080 leader_election.cc:304] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.823357 23190 raft_consensus.cc:2804] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.823881 23190 raft_consensus.cc:697] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:26.824697 23157 tablet_bootstrap.cc:492] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.824819 23190 consensus_queue.cc:237] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.825970 23157 ts_tablet_manager.cc:1403] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.012s
I20260709 13:11:26.829442 23157 raft_consensus.cc:359] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.830089 23157 raft_consensus.cc:385] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.830348 23157 raft_consensus.cc:740] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.831065 23157 consensus_queue.cc:260] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.833319 23157 ts_tablet_manager.cc:1434] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:26.834576 23157 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.833906 22862 catalog_manager.cc:5697] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.842448 23157 tablet_bootstrap.cc:654] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.847407 23157 tablet_bootstrap.cc:492] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.847858 23157 ts_tablet_manager.cc:1403] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:11:26.849973 23157 raft_consensus.cc:359] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.850490 23157 raft_consensus.cc:385] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.850697 23157 raft_consensus.cc:740] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.851425 23157 consensus_queue.cc:260] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.853075 23157 ts_tablet_manager.cc:1434] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:26.854235 23157 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:26.859424 23190 raft_consensus.cc:493] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.860090 23190 raft_consensus.cc:515] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.860620 23157 tablet_bootstrap.cc:654] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.862496 23190 leader_election.cc:290] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:26.863114 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:26.864177 22967 raft_consensus.cc:2393] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9a36b5bd1eb4fb79ad35370a0677b57 in current term 1: Already voted for candidate 3326d8cd3827437abd58e4f78a6a648f in this term.
I20260709 13:11:26.865572 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c014062df5e24baa9b6a397533bee16a" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.866667 23157 tablet_bootstrap.cc:492] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:26.867247 23157 ts_tablet_manager.cc:1403] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:11:26.867089 23080 leader_election.cc:304] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:26.868081 23190 raft_consensus.cc:3060] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.869784 23157 raft_consensus.cc:359] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.870358 23157 raft_consensus.cc:385] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.870673 23157 raft_consensus.cc:740] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.871418 23157 consensus_queue.cc:260] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.873718 23157 ts_tablet_manager.cc:1434] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:26.874686 23190 raft_consensus.cc:2749] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.874430 23185 consensus_queue.cc:1048] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.887720 23184 consensus_queue.cc:1048] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.903755 23192 raft_consensus.cc:493] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.904488 23192 raft_consensus.cc:515] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.906214 23192 leader_election.cc:290] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.907361 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.907424 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.908200 23192 raft_consensus.cc:493] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.908613 23117 raft_consensus.cc:2393] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in current term 1: Already voted for candidate 3326d8cd3827437abd58e4f78a6a648f in this term.
I20260709 13:11:26.908690 23192 raft_consensus.cc:515] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:26.909854 22934 leader_election.cc:304] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:26.911096 23191 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.912825 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:26.913800 23041 raft_consensus.cc:2393] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in current term 1: Already voted for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in this term.
I20260709 13:11:26.913662 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:26.915293 23192 leader_election.cc:290] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:26.916169 22934 leader_election.cc:304] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:26.916970 23192 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.918936 23191 raft_consensus.cc:2749] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.922689 23192 raft_consensus.cc:2749] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.949951 23184 consensus_queue.cc:1048] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.958262 23190 consensus_queue.cc:1048] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.965499 23184 consensus_queue.cc:1048] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.976248 23041 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.988590 23179 consensus_queue.cc:1048] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.011816 23192 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.022895 23116 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.033625 23191 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.066262 23191 consensus_queue.cc:1048] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.074319 23191 consensus_queue.cc:1048] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.152774 23191 raft_consensus.cc:493] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.153319 23191 raft_consensus.cc:515] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.155108 23191 leader_election.cc:290] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.156211 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:27.156353 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:27.156991 23041 raft_consensus.cc:2393] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in current term 1: Already voted for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in this term.
I20260709 13:11:27.158046 22931 leader_election.cc:304] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:27.158802 23191 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.160378 23226 raft_consensus.cc:493] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.160971 23226 raft_consensus.cc:515] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.162954 23226 leader_election.cc:290] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.164278 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:27.164320 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:27.164984 23116 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:27.165350 23041 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:27.166419 22934 leader_election.cc:304] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.166955 23191 raft_consensus.cc:2749] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.167466 23226 raft_consensus.cc:2804] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.168054 23226 raft_consensus.cc:493] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.168414 23226 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.174255 23226 raft_consensus.cc:515] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.175817 23226 leader_election.cc:290] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.176928 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:27.176939 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.177757 23041 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.177783 23116 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.185290 23116 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:27.185290 23041 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:27.186705 22934 leader_election.cc:304] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.187506 23226 raft_consensus.cc:2804] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.188090 23226 raft_consensus.cc:697] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.188998 23226 consensus_queue.cc:237] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.197420 22864 catalog_manager.cc:5697] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.219856 23184 consensus_queue.cc:1048] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.231714 23184 consensus_queue.cc:1048] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.309067 23179 consensus_queue.cc:1048] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.322223 23166 consensus_queue.cc:1048] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.379671 23190 consensus_queue.cc:1048] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.397915 23190 consensus_queue.cc:1048] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.417515 23041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:11:27.418318 23041 raft_consensus.cc:606] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:27.427562 23041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:11:27.428153 23041 raft_consensus.cc:606] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:27.443416 23116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:51954
I20260709 13:11:27.443922 23116 raft_consensus.cc:606] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:27.460180 22967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:27.460948 22967 raft_consensus.cc:606] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:27.470085 23116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:51954
I20260709 13:11:27.470597 23116 raft_consensus.cc:606] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:27.476436 23116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:51954
I20260709 13:11:27.477090 23116 raft_consensus.cc:606] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:27.483711 22967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:27.484400 22967 raft_consensus.cc:606] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:27.495164 23179 raft_consensus.cc:993] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.495723 23190 raft_consensus.cc:1081] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.497519 22967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59014
I20260709 13:11:27.498100 22967 raft_consensus.cc:493] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.498431 22967 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.504855 22967 raft_consensus.cc:515] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.506664 22967 leader_election.cc:290] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.507819 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:27.507819 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e6e43e1ff403aaaf3d856b334b82c" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.508916 23041 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.509050 23116 raft_consensus.cc:3055] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.509517 23116 raft_consensus.cc:740] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:27.510282 23116 consensus_queue.cc:260] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.511618 23116 raft_consensus.cc:3060] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.514740 23041 raft_consensus.cc:2468] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.516283 22931 leader_election.cc:304] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.517362 23226 raft_consensus.cc:2804] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.517910 23226 raft_consensus.cc:697] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.518181 23116 raft_consensus.cc:2468] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.518916 23226 consensus_queue.cc:237] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.527048 22865 catalog_manager.cc:5697] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.746793 23226 consensus_queue.cc:1048] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.758934 23165 consensus_queue.cc:1048] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.768251 23191 raft_consensus.cc:993] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:27.768831 23191 raft_consensus.cc:1081] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:27.770350 23116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:51944
I20260709 13:11:27.770890 23116 raft_consensus.cc:493] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.771265 23116 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.777787 23116 raft_consensus.cc:515] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.779937 23116 leader_election.cc:290] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:27.781105 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:27.781963 22967 raft_consensus.cc:3055] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.782052 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d30a9cde334427be79e05cb5d521bb" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:27.782383 22967 raft_consensus.cc:740] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.783373 23041 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.783910 22967 consensus_queue.cc:260] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.784469 23185 raft_consensus.cc:993] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.786109 23185 raft_consensus.cc:1081] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.786404 22967 raft_consensus.cc:3060] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.787890 22968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59010
I20260709 13:11:27.788584 22968 raft_consensus.cc:493] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.788897 22968 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.792893 23041 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 2.
I20260709 13:11:27.794771 23080 leader_election.cc:304] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:27.795107 22967 raft_consensus.cc:2468] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 2.
I20260709 13:11:27.795744 23190 raft_consensus.cc:2804] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.796460 23190 raft_consensus.cc:697] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:27.795295 22968 raft_consensus.cc:515] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.797493 23190 consensus_queue.cc:237] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.798802 22968 leader_election.cc:290] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.799629 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:27.800380 23041 raft_consensus.cc:3055] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.800427 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57edd2238b4de19f87575c99a7a256" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.800853 23041 raft_consensus.cc:740] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:27.801173 23116 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.801784 23041 consensus_queue.cc:260] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.803032 23041 raft_consensus.cc:3060] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.808384 23116 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.807197 22864 catalog_manager.cc:5697] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.809881 22934 leader_election.cc:304] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.810753 23191 raft_consensus.cc:2804] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.811265 23191 raft_consensus.cc:697] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.811278 23041 raft_consensus.cc:2468] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.812316 23191 consensus_queue.cc:237] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.820168 22864 catalog_manager.cc:5697] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.844379 23179 raft_consensus.cc:993] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.844913 23190 raft_consensus.cc:1081] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.846468 23041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:11:27.846917 23041 raft_consensus.cc:493] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.847173 23041 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.852098 23041 raft_consensus.cc:515] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.853899 23041 leader_election.cc:290] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.854974 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:27.855099 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cabc6582df46be9f2bb1de64cb9a1c" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.855849 23116 raft_consensus.cc:3055] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.855844 22968 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.856213 23116 raft_consensus.cc:740] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:27.857131 23116 consensus_queue.cc:260] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.858526 23116 raft_consensus.cc:3060] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.862982 22968 raft_consensus.cc:2468] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.863670 23116 raft_consensus.cc:2468] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.864461 23006 leader_election.cc:304] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.865283 23161 raft_consensus.cc:2804] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.865756 23161 raft_consensus.cc:697] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:27.866626 23161 consensus_queue.cc:237] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.873934 22864 catalog_manager.cc:5697] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.900009 23165 raft_consensus.cc:993] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.900619 23165 raft_consensus.cc:1081] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.902537 23041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:11:27.903225 23041 raft_consensus.cc:493] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.903627 23041 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.910153 23041 raft_consensus.cc:515] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.912072 23041 leader_election.cc:290] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.913034 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:27.913259 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.913919 22968 raft_consensus.cc:3055] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.914044 23116 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.914335 22968 raft_consensus.cc:740] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.915406 22968 consensus_queue.cc:260] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.916546 22968 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.920228 23116 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.921554 23009 leader_election.cc:304] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:27.922349 23161 raft_consensus.cc:2804] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.922782 23161 raft_consensus.cc:697] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:27.923388 22968 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.923525 23161 consensus_queue.cc:237] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.930569 22864 catalog_manager.cc:5697] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.949717 23179 raft_consensus.cc:993] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.950322 23243 raft_consensus.cc:1081] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:27.952535 23041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:11:27.953186 23041 raft_consensus.cc:493] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.953569 23041 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.955329 23184 raft_consensus.cc:993] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.955953 23161 raft_consensus.cc:1081] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:27.957857 22968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59010
I20260709 13:11:27.958469 22968 raft_consensus.cc:493] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.958807 22968 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.962080 23041 raft_consensus.cc:515] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.964900 23041 leader_election.cc:290] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.965200 22968 raft_consensus.cc:515] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.966267 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:27.966980 22967 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.967072 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d163a730a2b3441f9eeca1aedaa447d8" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.967840 23116 raft_consensus.cc:3055] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.968226 23116 raft_consensus.cc:740] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:27.968292 22968 leader_election.cc:290] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:27.969251 23116 consensus_queue.cc:260] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.969717 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:27.970471 23117 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.970501 23116 raft_consensus.cc:3060] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.971450 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c63c4dac964c74ad67410e25b4fde4" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:27.974601 23041 raft_consensus.cc:3055] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:27.975131 23041 raft_consensus.cc:740] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:27.975934 23041 consensus_queue.cc:260] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.977310 23041 raft_consensus.cc:3060] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:27.977702 22967 raft_consensus.cc:2468] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.979533 23006 leader_election.cc:304] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.979959 23117 raft_consensus.cc:2468] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.980402 23161 raft_consensus.cc:2804] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.981464 23116 raft_consensus.cc:2468] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:27.981631 22934 leader_election.cc:304] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:27.981993 23161 raft_consensus.cc:697] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:27.982656 23165 raft_consensus.cc:2804] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:27.983233 23165 raft_consensus.cc:697] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:27.983487 23161 consensus_queue.cc:237] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.984010 23165 consensus_queue.cc:237] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:27.989352 23041 raft_consensus.cc:2468] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:27.993158 22864 catalog_manager.cc:5697] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.993897 22865 catalog_manager.cc:5697] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.072440 23116 raft_consensus.cc:1275] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.073868 23165 consensus_queue.cc:1048] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.086539 23041 raft_consensus.cc:1275] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.088521 23246 consensus_queue.cc:1048] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.189255 22967 raft_consensus.cc:1275] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.190912 23243 consensus_queue.cc:1048] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.201326 23041 raft_consensus.cc:1275] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.203522 23243 consensus_queue.cc:1048] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.213264 23041 raft_consensus.cc:1275] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.214833 23246 consensus_queue.cc:1048] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.224408 23116 raft_consensus.cc:1275] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.226104 23226 consensus_queue.cc:1048] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.268298 23116 raft_consensus.cc:1275] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.269870 23161 consensus_queue.cc:1048] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.278734 22968 raft_consensus.cc:1275] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.280579 23161 consensus_queue.cc:1048] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.357136 23116 raft_consensus.cc:1275] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.358631 23185 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.369623 22968 raft_consensus.cc:1275] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.371390 23185 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:28.443607 23041 raft_consensus.cc:1275] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.445196 23226 consensus_queue.cc:1048] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.455902 23116 raft_consensus.cc:1275] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.457722 23165 consensus_queue.cc:1048] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.516409 23116 raft_consensus.cc:1275] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.517947 23185 consensus_queue.cc:1048] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.527848 22968 raft_consensus.cc:1275] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:28.529826 23161 consensus_queue.cc:1048] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:30.515642 22865 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38518:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:30.518203 22865 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:30.575364 22956 tablet_service.cc:1511] Processing CreateTablet for tablet 0495fd0c25e845138c02ed88a1c3eef8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:30.576315 23031 tablet_service.cc:1511] Processing CreateTablet for tablet 0495fd0c25e845138c02ed88a1c3eef8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:30.577193 23103 tablet_service.cc:1511] Processing CreateTablet for tablet 0495fd0c25e845138c02ed88a1c3eef8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:30.577910 23031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0495fd0c25e845138c02ed88a1c3eef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.577281 22956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0495fd0c25e845138c02ed88a1c3eef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.578790 23103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0495fd0c25e845138c02ed88a1c3eef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.583179 22954 tablet_service.cc:1511] Processing CreateTablet for tablet a38b0670a92747b48ff851abad276bdc (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:30.584762 22954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b0670a92747b48ff851abad276bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.588153 22957 tablet_service.cc:1511] Processing CreateTablet for tablet d5f66ab31496419fbd91f8626bcd50ac (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:30.589661 22957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f66ab31496419fbd91f8626bcd50ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.588356 22958 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7c6506b0934ec998680a669f9e9673 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:30.590829 23105 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7c6506b0934ec998680a669f9e9673 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:30.591815 22958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7c6506b0934ec998680a669f9e9673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.592439 23105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7c6506b0934ec998680a669f9e9673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.596894 23104 tablet_service.cc:1511] Processing CreateTablet for tablet a38b0670a92747b48ff851abad276bdc (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:30.598591 23104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b0670a92747b48ff851abad276bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.601449 23030 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7c6506b0934ec998680a669f9e9673 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:30.603029 23030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7c6506b0934ec998680a669f9e9673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.604533 23033 tablet_service.cc:1511] Processing CreateTablet for tablet d5f66ab31496419fbd91f8626bcd50ac (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:30.605405 23032 tablet_service.cc:1511] Processing CreateTablet for tablet a38b0670a92747b48ff851abad276bdc (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:30.606150 23033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f66ab31496419fbd91f8626bcd50ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.606958 23032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b0670a92747b48ff851abad276bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.608774 22955 tablet_service.cc:1511] Processing CreateTablet for tablet eb3a3ee619524e039bfdd0675924f9c3 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:30.608777 23106 tablet_service.cc:1511] Processing CreateTablet for tablet d5f66ab31496419fbd91f8626bcd50ac (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:30.614213 23106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f66ab31496419fbd91f8626bcd50ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.616442 23029 tablet_service.cc:1511] Processing CreateTablet for tablet eb3a3ee619524e039bfdd0675924f9c3 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:30.618075 23029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3a3ee619524e039bfdd0675924f9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.610195 22955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3a3ee619524e039bfdd0675924f9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.620434 22953 tablet_service.cc:1511] Processing CreateTablet for tablet c8b935a1298f452b98407f31f5b80307 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:30.622013 23107 tablet_service.cc:1511] Processing CreateTablet for tablet eb3a3ee619524e039bfdd0675924f9c3 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:30.623597 23107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3a3ee619524e039bfdd0675924f9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.622020 22953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b935a1298f452b98407f31f5b80307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.661757 23028 tablet_service.cc:1511] Processing CreateTablet for tablet c8b935a1298f452b98407f31f5b80307 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:30.663475 23028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b935a1298f452b98407f31f5b80307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.665879 23102 tablet_service.cc:1511] Processing CreateTablet for tablet c8b935a1298f452b98407f31f5b80307 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:30.667421 23102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b935a1298f452b98407f31f5b80307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.665879 22952 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae5f8f2a945454b91f4859744ec4ac4 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:30.669631 22952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae5f8f2a945454b91f4859744ec4ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.698066 23027 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae5f8f2a945454b91f4859744ec4ac4 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:30.699704 23027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae5f8f2a945454b91f4859744ec4ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.699996 23101 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae5f8f2a945454b91f4859744ec4ac4 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:30.701373 23101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae5f8f2a945454b91f4859744ec4ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.710453 22951 tablet_service.cc:1511] Processing CreateTablet for tablet 5de31d1ef1de4b558c5dc638537b8d96 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:30.712821 22951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de31d1ef1de4b558c5dc638537b8d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.738929 23026 tablet_service.cc:1511] Processing CreateTablet for tablet 5de31d1ef1de4b558c5dc638537b8d96 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:30.740458 23026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de31d1ef1de4b558c5dc638537b8d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.740825 23270 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:30.748888 23271 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:30.756132 23105 tablet_service.cc:1511] Processing CreateTablet for tablet 5de31d1ef1de4b558c5dc638537b8d96 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:30.757727 23105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de31d1ef1de4b558c5dc638537b8d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.767819 22955 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5a7099a8384455a812b2a68ba281c8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:30.769905 22955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5a7099a8384455a812b2a68ba281c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.770660 23029 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5a7099a8384455a812b2a68ba281c8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:30.772279 23029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5a7099a8384455a812b2a68ba281c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.779146 23270 tablet_bootstrap.cc:654] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.807123 23272 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:30.812474 23271 tablet_bootstrap.cc:654] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.812548 23107 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5a7099a8384455a812b2a68ba281c8 (DEFAULT_TABLE table=soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:30.814834 23107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5a7099a8384455a812b2a68ba281c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.819366 23272 tablet_bootstrap.cc:654] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.826591 23270 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:30.827212 23270 ts_tablet_manager.cc:1403] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.006s
I20260709 13:11:30.830354 23270 raft_consensus.cc:359] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.831189 23270 raft_consensus.cc:385] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.831532 23270 raft_consensus.cc:740] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.832491 23270 consensus_queue.cc:260] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.835585 23271 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:30.836210 23271 ts_tablet_manager.cc:1403] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.000s
I20260709 13:11:30.839255 23271 raft_consensus.cc:359] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.839987 23271 raft_consensus.cc:385] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.840607 23271 raft_consensus.cc:740] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.841486 23271 consensus_queue.cc:260] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.843295 23271 ts_tablet_manager.cc:1434] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:11:30.844486 23271 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:30.844800 23270 ts_tablet_manager.cc:1434] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:30.846050 23270 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:30.852139 23271 tablet_bootstrap.cc:654] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.853816 23270 tablet_bootstrap.cc:654] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.860816 23270 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:30.861455 23270 ts_tablet_manager.cc:1403] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 13:11:30.867076 23270 raft_consensus.cc:359] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.867902 23270 raft_consensus.cc:385] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.868239 23270 raft_consensus.cc:740] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.869019 23270 consensus_queue.cc:260] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.869613 23272 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:30.876179 23272 ts_tablet_manager.cc:1403] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.011s
I20260709 13:11:30.876670 23270 ts_tablet_manager.cc:1434] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:11:30.877281 23271 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:30.877816 23271 ts_tablet_manager.cc:1403] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 13:11:30.878075 23270 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:30.880541 23272 raft_consensus.cc:359] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.881389 23272 raft_consensus.cc:385] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.881717 23272 raft_consensus.cc:740] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.882485 23271 raft_consensus.cc:359] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.882666 23272 consensus_queue.cc:260] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.883513 23271 raft_consensus.cc:385] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.883957 23271 raft_consensus.cc:740] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.884754 23271 consensus_queue.cc:260] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.887368 23271 ts_tablet_manager.cc:1434] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:30.888399 23271 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:30.892942 23270 tablet_bootstrap.cc:654] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.895522 23271 tablet_bootstrap.cc:654] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.909572 23272 ts_tablet_manager.cc:1434] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 13:11:30.911767 23272 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:30.914031 23270 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:30.916257 23270 ts_tablet_manager.cc:1403] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.016s
I20260709 13:11:30.919433 23272 tablet_bootstrap.cc:654] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.919657 23270 raft_consensus.cc:359] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.920490 23270 raft_consensus.cc:385] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.920831 23270 raft_consensus.cc:740] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.921653 23270 consensus_queue.cc:260] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.922645 23271 tablet_bootstrap.cc:492] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:30.923493 23271 ts_tablet_manager.cc:1403] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.004s
I20260709 13:11:30.927066 23271 raft_consensus.cc:359] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.927927 23271 raft_consensus.cc:385] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.928323 23271 raft_consensus.cc:740] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.929193 23271 consensus_queue.cc:260] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.930163 23270 ts_tablet_manager.cc:1434] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.006s
I20260709 13:11:30.932242 23270 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:30.935647 23271 ts_tablet_manager.cc:1434] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:30.941102 23271 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:30.942438 23270 tablet_bootstrap.cc:654] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.943346 23272 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:30.943979 23272 ts_tablet_manager.cc:1403] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.023s
I20260709 13:11:30.947899 23272 raft_consensus.cc:359] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.948972 23272 raft_consensus.cc:385] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.949190 23271 tablet_bootstrap.cc:654] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.949494 23272 raft_consensus.cc:740] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.950837 23272 consensus_queue.cc:260] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.954288 23272 ts_tablet_manager.cc:1434] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:30.955749 23272 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:30.975752 23270 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:30.976472 23270 ts_tablet_manager.cc:1403] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.020s
I20260709 13:11:30.978404 23272 tablet_bootstrap.cc:654] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.979609 23270 raft_consensus.cc:359] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.980484 23270 raft_consensus.cc:385] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.980791 23270 raft_consensus.cc:740] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.981870 23270 consensus_queue.cc:260] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.984918 23270 ts_tablet_manager.cc:1434] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:30.985875 23271 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:30.986454 23270 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:30.986464 23271 ts_tablet_manager.cc:1403] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.021s
I20260709 13:11:30.987032 23272 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:30.987852 23272 ts_tablet_manager.cc:1403] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.010s
I20260709 13:11:30.990366 23271 raft_consensus.cc:359] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.991304 23271 raft_consensus.cc:385] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.991588 23271 raft_consensus.cc:740] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.992642 23258 raft_consensus.cc:493] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.992404 23271 consensus_queue.cc:260] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.993355 23258 raft_consensus.cc:515] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.993496 23272 raft_consensus.cc:359] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:30.994355 23272 raft_consensus.cc:385] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.994587 23270 tablet_bootstrap.cc:654] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.994750 23272 raft_consensus.cc:740] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.995393 23271 ts_tablet_manager.cc:1434] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:11:30.996791 23271 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:31.004384 23271 tablet_bootstrap.cc:654] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.004130 23272 consensus_queue.cc:260] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.013850 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.015110 22967 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.016808 23272 ts_tablet_manager.cc:1434] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:11:31.017833 23080 leader_election.cc:304] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.018183 23272 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.026341 23258 leader_election.cc:290] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.026609 23272 tablet_bootstrap.cc:654] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.027082 23258 raft_consensus.cc:2804] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.027529 23258 raft_consensus.cc:493] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.027938 23258 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.037392 23287 raft_consensus.cc:493] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.038250 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.038393 23287 raft_consensus.cc:515] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.039404 23041 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.049296 23272 tablet_bootstrap.cc:492] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.043989 23258 raft_consensus.cc:515] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.050027 23272 ts_tablet_manager.cc:1403] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 13:11:31.050123 23271 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:31.051239 23271 ts_tablet_manager.cc:1403] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.024s
I20260709 13:11:31.052825 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.053601 22967 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.053651 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.054307 23041 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.055855 23271 raft_consensus.cc:359] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.057710 23271 raft_consensus.cc:385] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.058189 23271 raft_consensus.cc:740] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.059268 23271 consensus_queue.cc:260] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.063174 23271 ts_tablet_manager.cc:1434] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.006s
I20260709 13:11:31.064987 23271 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:31.065133 22967 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.066831 23080 leader_election.cc:304] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.073335 23041 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.070227 23258 leader_election.cc:290] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.080206 23258 raft_consensus.cc:2804] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.080679 23165 raft_consensus.cc:493] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.080842 23258 raft_consensus.cc:697] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:31.081462 23165 raft_consensus.cc:515] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.081954 23258 consensus_queue.cc:237] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.082139 23272 raft_consensus.cc:359] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.083806 23272 raft_consensus.cc:385] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.084326 23272 raft_consensus.cc:740] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.085475 23272 consensus_queue.cc:260] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.086650 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7c6506b0934ec998680a669f9e9673" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.090157 23116 raft_consensus.cc:2468] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.091625 22934 leader_election.cc:304] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.092742 23278 raft_consensus.cc:2804] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.093145 23278 raft_consensus.cc:493] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.093528 23278 raft_consensus.cc:3060] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.087191 23165 leader_election.cc:290] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.110303 23287 leader_election.cc:290] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.116386 23272 ts_tablet_manager.cc:1434] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.066s	user 0.017s	sys 0.004s
I20260709 13:11:31.118752 23272 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.087877 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7c6506b0934ec998680a669f9e9673" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.088644 23271 tablet_bootstrap.cc:654] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:31.129032 23080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.78.1:41461, user_credentials={real_user=slave}} blocked reactor thread for 62324.8us
I20260709 13:11:31.131572 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.131799 23270 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:31.132400 23270 ts_tablet_manager.cc:1403] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.146s	user 0.044s	sys 0.080s
I20260709 13:11:31.135623 23270 raft_consensus.cc:359] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.136396 23270 raft_consensus.cc:385] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.136716 23270 raft_consensus.cc:740] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
W20260709 13:11:31.137636 23080 leader_election.cc:343] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.137437 23270 consensus_queue.cc:260] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.137722 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.139941 23270 ts_tablet_manager.cc:1434] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 13:11:31.140477 23080 leader_election.cc:343] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.141078 23080 leader_election.cc:304] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:31.141186 23271 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:31.141235 23270 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:31.142118 23271 ts_tablet_manager.cc:1403] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.003s
I20260709 13:11:31.142453 23289 raft_consensus.cc:2749] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:31.143980 22931 leader_election.cc:343] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.147076 23272 tablet_bootstrap.cc:654] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.146687 23271 raft_consensus.cc:359] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.147563 23271 raft_consensus.cc:385] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.147888 23271 raft_consensus.cc:740] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.148746 23271 consensus_queue.cc:260] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.149956 23278 raft_consensus.cc:515] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.152057 23271 ts_tablet_manager.cc:1434] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:31.153118 23271 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:31.153517 23270 tablet_bootstrap.cc:654] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.159716 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7c6506b0934ec998680a669f9e9673" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.160501 23116 raft_consensus.cc:3060] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.163190 23271 tablet_bootstrap.cc:654] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.165134 22863 catalog_manager.cc:5697] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.169006 23116 raft_consensus.cc:2468] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.153443 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7c6506b0934ec998680a669f9e9673" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.170861 22934 leader_election.cc:304] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.172070 23290 raft_consensus.cc:2804] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.172922 23290 raft_consensus.cc:697] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.174099 23290 consensus_queue.cc:237] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.174996 23272 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.176584 23272 ts_tablet_manager.cc:1403] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.005s
W20260709 13:11:31.171597 22931 leader_election.cc:343] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.180913 23278 leader_election.cc:290] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.181569 23272 raft_consensus.cc:359] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.182837 23271 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:31.182906 23272 raft_consensus.cc:385] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.183588 23272 raft_consensus.cc:740] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.183749 23271 ts_tablet_manager.cc:1403] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:11:31.185807 23272 consensus_queue.cc:260] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.189026 23271 raft_consensus.cc:359] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.190183 23271 raft_consensus.cc:385] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.190588 23271 raft_consensus.cc:740] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.191466 23271 consensus_queue.cc:260] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.194463 23272 ts_tablet_manager.cc:1434] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:11:31.195405 23271 ts_tablet_manager.cc:1434] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:31.195399 22864 catalog_manager.cc:5697] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.197095 23271 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:31.203158 23270 tablet_bootstrap.cc:492] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:31.203787 23270 ts_tablet_manager.cc:1403] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.063s	user 0.038s	sys 0.009s
I20260709 13:11:31.195784 23272 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.206228 23271 tablet_bootstrap.cc:654] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.206218 23270 raft_consensus.cc:359] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.206964 23270 raft_consensus.cc:385] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.207260 23270 raft_consensus.cc:740] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.207965 23270 consensus_queue.cc:260] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.210507 23270 ts_tablet_manager.cc:1434] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:31.211555 23270 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:31.217446 23270 tablet_bootstrap.cc:654] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.218312 23258 raft_consensus.cc:493] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.219254 23258 raft_consensus.cc:515] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.222846 23258 leader_election.cc:290] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.224344 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.225016 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.225893 23041 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.225420 22967 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.226649 23272 tablet_bootstrap.cc:654] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.227445 23080 leader_election.cc:304] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:31.229444 23258 raft_consensus.cc:2804] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.229907 23258 raft_consensus.cc:493] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.231164 23258 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.247082 23271 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:31.247807 23271 ts_tablet_manager.cc:1403] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.008s
I20260709 13:11:31.248860 23270 tablet_bootstrap.cc:492] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:31.249509 23270 ts_tablet_manager.cc:1403] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.010s
I20260709 13:11:31.251349 23271 raft_consensus.cc:359] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.254810 23271 raft_consensus.cc:385] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.255367 23271 raft_consensus.cc:740] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.256493 23271 consensus_queue.cc:260] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.255457 23258 raft_consensus.cc:515] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.260147 23271 ts_tablet_manager.cc:1434] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:31.260565 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.261379 22967 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.261637 23271 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Bootstrap starting.
I20260709 13:11:31.262856 23272 tablet_bootstrap.cc:492] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.263597 23272 ts_tablet_manager.cc:1403] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.010s
I20260709 13:11:31.263350 23270 raft_consensus.cc:359] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.264318 23270 raft_consensus.cc:385] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.264710 23270 raft_consensus.cc:740] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.265614 23270 consensus_queue.cc:260] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.267086 23272 raft_consensus.cc:359] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.267902 23272 raft_consensus.cc:385] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.268229 23272 raft_consensus.cc:740] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.268466 23270 ts_tablet_manager.cc:1434] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:11:31.269047 23272 consensus_queue.cc:260] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.269995 23271 tablet_bootstrap.cc:654] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.271579 23272 ts_tablet_manager.cc:1434] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:31.272710 23272 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.279449 23272 tablet_bootstrap.cc:654] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.282739 23271 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: No bootstrap required, opened a new log
I20260709 13:11:31.283418 23271 ts_tablet_manager.cc:1403] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:11:31.286746 23271 raft_consensus.cc:359] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.287576 23271 raft_consensus.cc:385] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.287873 23271 raft_consensus.cc:740] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.288932 23271 consensus_queue.cc:260] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.290906 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.291263 23271 ts_tablet_manager.cc:1434] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:31.291607 23041 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.292593 23258 leader_election.cc:290] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.269745 23270 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:31.294855 22967 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.296738 23290 raft_consensus.cc:493] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.299996 23290 raft_consensus.cc:515] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.300786 23080 leader_election.cc:304] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.302052 23258 raft_consensus.cc:2804] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.302743 23258 raft_consensus.cc:697] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:31.303974 23041 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.303753 23258 consensus_queue.cc:237] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.301205 23272 tablet_bootstrap.cc:492] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.304998 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.305819 23272 ts_tablet_manager.cc:1403] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.001s
I20260709 13:11:31.305876 23116 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.307194 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.307930 23043 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.309069 22934 leader_election.cc:304] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.309743 23290 leader_election.cc:290] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.310204 23278 raft_consensus.cc:2804] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.310807 23278 raft_consensus.cc:493] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.309916 23272 raft_consensus.cc:359] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.308106 23270 tablet_bootstrap.cc:654] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.311168 23278 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.311321 23272 raft_consensus.cc:385] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.311792 23272 raft_consensus.cc:740] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.315189 23272 consensus_queue.cc:260] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.325935 23278 raft_consensus.cc:515] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.326792 23161 raft_consensus.cc:493] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.327466 23161 raft_consensus.cc:515] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.330291 23161 leader_election.cc:290] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.332121 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.332651 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.333087 23043 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.333529 22967 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:31.336558 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.337491 23116 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:31.337644 23006 leader_election.cc:304] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.344641 22863 catalog_manager.cc:5697] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.346216 23043 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.347538 22931 leader_election.cc:304] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.348390 23290 raft_consensus.cc:2804] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.348867 23290 raft_consensus.cc:697] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.349998 23290 consensus_queue.cc:237] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.358618 23161 raft_consensus.cc:2804] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.359149 23161 raft_consensus.cc:493] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.359666 23161 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.365571 23290 raft_consensus.cc:493] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.366401 23290 raft_consensus.cc:515] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.370469 23278 leader_election.cc:290] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.371357 23278 raft_consensus.cc:493] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.371939 23278 raft_consensus.cc:515] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.372778 22864 catalog_manager.cc:5697] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.379201 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.378566 23290 leader_election.cc:290] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
W20260709 13:11:31.381091 22913 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:31.381812 23043 raft_consensus.cc:2468] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.382789 23161 raft_consensus.cc:515] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.383741 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.384095 22931 leader_election.cc:304] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.384711 23043 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.390219 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.391261 22967 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.391470 23114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.391971 22931 leader_election.cc:304] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.385596 23278 leader_election.cc:290] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.385653 23290 raft_consensus.cc:2804] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.393245 23290 raft_consensus.cc:493] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.393304 23278 raft_consensus.cc:2804] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.393664 23290 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.393883 23278 raft_consensus.cc:493] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.394418 23278 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.381812 23270 tablet_bootstrap.cc:492] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:31.387455 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.396620 23270 ts_tablet_manager.cc:1403] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.026s
I20260709 13:11:31.399654 22967 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:31.388484 23272 ts_tablet_manager.cc:1434] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.082s	user 0.015s	sys 0.033s
I20260709 13:11:31.389338 23115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.400938 23115 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 0.
I20260709 13:11:31.390141 23161 leader_election.cc:290] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.392203 23114 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.401564 23006 leader_election.cc:304] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.404457 23270 raft_consensus.cc:359] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.405357 23308 raft_consensus.cc:2804] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.405515 23270 raft_consensus.cc:385] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.406178 23270 raft_consensus.cc:740] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.407192 23270 consensus_queue.cc:260] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.385061 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.408975 23116 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.408995 23272 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.411422 23165 raft_consensus.cc:493] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.404709 22934 leader_election.cc:343] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.412071 23165 raft_consensus.cc:515] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.414671 23165 leader_election.cc:290] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.419806 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
W20260709 13:11:31.421953 22931 leader_election.cc:343] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.428228 23290 raft_consensus.cc:515] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.429322 23115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.423877 23114 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:31.430698 23272 tablet_bootstrap.cc:654] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:31.431272 22934 leader_election.cc:343] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.431860 22934 leader_election.cc:304] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:31.433007 23165 raft_consensus.cc:2749] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.433338 23278 raft_consensus.cc:515] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.433797 23308 raft_consensus.cc:697] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:31.434605 23270 ts_tablet_manager.cc:1434] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:11:31.434856 23308 consensus_queue.cc:237] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.435855 23278 leader_election.cc:290] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.431857 23116 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.437714 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.437718 23043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.438570 23041 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.438624 23043 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.439867 23290 leader_election.cc:290] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.441447 23270 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: Bootstrap starting.
I20260709 13:11:31.443506 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.444235 23116 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.449227 23041 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.452670 23116 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.453435 22931 leader_election.cc:304] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.455045 23290 raft_consensus.cc:2804] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.455209 23043 raft_consensus.cc:2468] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.455549 23290 raft_consensus.cc:697] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.454763 22865 catalog_manager.cc:5697] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 1 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.456739 22931 leader_election.cc:304] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.456355 23308 raft_consensus.cc:493] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.457633 23278 raft_consensus.cc:2804] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.457530 23308 raft_consensus.cc:515] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.458495 23278 raft_consensus.cc:697] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.458176 23290 consensus_queue.cc:237] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.459471 23278 consensus_queue.cc:237] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.457319 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.466472 23116 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.468452 23308 leader_election.cc:290] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.470405 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae5f8f2a945454b91f4859744ec4ac4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.471249 22968 raft_consensus.cc:2468] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:31.474283 23272 tablet_bootstrap.cc:492] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.475140 23272 ts_tablet_manager.cc:1403] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.001s
I20260709 13:11:31.477155 23006 leader_election.cc:304] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.478488 23308 raft_consensus.cc:2804] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.478994 23308 raft_consensus.cc:493] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.479396 23308 raft_consensus.cc:3060] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.486068 23272 raft_consensus.cc:359] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.490197 23270 tablet_bootstrap.cc:654] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.492632 23116 raft_consensus.cc:2468] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 1.
I20260709 13:11:31.493918 23114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae5f8f2a945454b91f4859744ec4ac4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" is_pre_election: true
I20260709 13:11:31.495030 23272 raft_consensus.cc:385] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.495539 23114 raft_consensus.cc:2468] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 0.
I20260709 13:11:31.495533 23272 raft_consensus.cc:740] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.497526 23272 consensus_queue.cc:260] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.496301 23308 raft_consensus.cc:515] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.501686 23272 ts_tablet_manager.cc:1434] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 13:11:31.505373 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae5f8f2a945454b91f4859744ec4ac4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.505393 23272 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: Bootstrap starting.
I20260709 13:11:31.506223 22968 raft_consensus.cc:3060] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.507015 23308 leader_election.cc:290] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.509464 23270 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: No bootstrap required, opened a new log
I20260709 13:11:31.510030 23270 ts_tablet_manager.cc:1403] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.007s
I20260709 13:11:31.513305 23270 raft_consensus.cc:359] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.514048 23270 raft_consensus.cc:385] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.514338 23270 raft_consensus.cc:740] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.515058 23272 tablet_bootstrap.cc:654] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.515278 23270 consensus_queue.cc:260] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.517652 23270 ts_tablet_manager.cc:1434] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:31.515961 22863 catalog_manager.cc:5697] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.519972 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae5f8f2a945454b91f4859744ec4ac4" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.521073 23116 raft_consensus.cc:3060] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.523728 22968 raft_consensus.cc:2468] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:31.525286 23006 leader_election.cc:304] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.526275 23308 raft_consensus.cc:2804] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.526825 23308 raft_consensus.cc:697] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:31.527706 23308 consensus_queue.cc:237] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.555406 23116 raft_consensus.cc:2468] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 1.
I20260709 13:11:31.556468 23272 tablet_bootstrap.cc:492] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: No bootstrap required, opened a new log
I20260709 13:11:31.557137 23272 ts_tablet_manager.cc:1403] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.020s
I20260709 13:11:31.556732 22864 catalog_manager.cc:5697] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 0 to 1, leader changed from <none> to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 1 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.559100 22863 catalog_manager.cc:5697] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 1 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.560313 23272 raft_consensus.cc:359] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.561148 23272 raft_consensus.cc:385] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.561430 23272 raft_consensus.cc:740] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.562274 23272 consensus_queue.cc:260] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.564489 23272 ts_tablet_manager.cc:1434] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:31.581336 23258 consensus_queue.cc:1048] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.598321 23258 consensus_queue.cc:1048] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.658279 23041 raft_consensus.cc:3060] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.668779 23290 consensus_queue.cc:1048] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.681945 23165 consensus_queue.cc:1048] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.704351 23258 consensus_queue.cc:1048] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.706712 23258 raft_consensus.cc:493] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.707290 23258 raft_consensus.cc:515] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.711086 23258 leader_election.cc:290] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.711210 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" is_pre_election: true
I20260709 13:11:31.712090 22967 raft_consensus.cc:2468] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.712908 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f" is_pre_election: true
I20260709 13:11:31.713622 23041 raft_consensus.cc:2468] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 0.
I20260709 13:11:31.714782 23080 leader_election.cc:304] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:31.715638 23258 raft_consensus.cc:2804] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.716213 23258 raft_consensus.cc:493] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.716838 23258 raft_consensus.cc:3060] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.721666 23289 consensus_queue.cc:1048] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.729583 23258 raft_consensus.cc:515] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.732064 23258 leader_election.cc:290] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:31.732935 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.733614 22967 raft_consensus.cc:3060] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.737448 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5a7099a8384455a812b2a68ba281c8" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.738130 23041 raft_consensus.cc:3060] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.740520 22967 raft_consensus.cc:2468] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.747857 23080 leader_election.cc:304] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:31.748512 23041 raft_consensus.cc:2468] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 1.
I20260709 13:11:31.748893 23258 raft_consensus.cc:2804] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.749441 23258 raft_consensus.cc:697] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:31.750370 23258 consensus_queue.cc:237] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.758836 22863 catalog_manager.cc:5697] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 1 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.798862 23165 consensus_queue.cc:1048] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.803154 23114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:51954
I20260709 13:11:31.804243 23114 raft_consensus.cc:606] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:31.813723 23165 consensus_queue.cc:1048] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.817883 23043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:11:31.818708 23043 raft_consensus.cc:606] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:31.826519 23116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
mode: GRACEFUL
new_leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:51954
I20260709 13:11:31.827139 23116 raft_consensus.cc:606] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Received request to transfer leadership to TS cfaf9e111a9b4fd8b79f8bfa0ffd19db
I20260709 13:11:31.833174 22967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:31.833909 22967 raft_consensus.cc:606] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:31.840456 22967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:31.841029 22967 raft_consensus.cc:606] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:31.848971 23165 consensus_queue.cc:1048] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.849849 22967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:31.850627 22967 raft_consensus.cc:606] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS 3326d8cd3827437abd58e4f78a6a648f
I20260709 13:11:31.858296 23278 raft_consensus.cc:993] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:31.858855 23278 raft_consensus.cc:1081] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:31.861333 23043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:11:31.861972 23043 raft_consensus.cc:493] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.864207 23043 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.866686 23290 consensus_queue.cc:1048] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.873495 23043 raft_consensus.cc:515] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.876724 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.877415 22967 raft_consensus.cc:3055] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.878172 23114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b935a1298f452b98407f31f5b80307" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.878222 22967 raft_consensus.cc:740] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.878916 23114 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.879356 22967 consensus_queue.cc:260] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.880595 22967 raft_consensus.cc:3060] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.884939 23290 consensus_queue.cc:1048] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.887387 23114 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:31.887948 22967 raft_consensus.cc:2468] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:31.888978 23009 leader_election.cc:304] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:31.890077 23308 raft_consensus.cc:2804] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.890676 23308 raft_consensus.cc:697] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:31.891526 23308 consensus_queue.cc:237] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.896793 23043 leader_election.cc:290] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.902911 23290 consensus_queue.cc:1048] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.909858 22864 catalog_manager.cc:5697] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.916981 23290 raft_consensus.cc:993] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:31.917641 23290 raft_consensus.cc:1081] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:31.919261 23041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:11:31.919724 23041 raft_consensus.cc:493] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.920105 23041 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.925763 23041 raft_consensus.cc:515] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.927439 23041 leader_election.cc:290] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.928422 22967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:31.928674 23114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de31d1ef1de4b558c5dc638537b8d96" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.929453 23114 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.929824 22967 raft_consensus.cc:3055] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.930447 22967 raft_consensus.cc:740] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:31.931198 22967 consensus_queue.cc:260] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.932302 22967 raft_consensus.cc:3060] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.936874 23114 raft_consensus.cc:2468] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:31.937503 22967 raft_consensus.cc:2468] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:31.938125 23009 leader_election.cc:304] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:31.939350 23308 raft_consensus.cc:2804] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.939796 23308 raft_consensus.cc:697] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:31.940738 23308 consensus_queue.cc:237] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.948547 22864 catalog_manager.cc:5697] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.968976 23308 consensus_queue.cc:1048] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.976820 23311 raft_consensus.cc:993] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:31.977738 23308 raft_consensus.cc:1081] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:31.980140 22968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59010
I20260709 13:11:31.982206 22968 raft_consensus.cc:493] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.982683 22968 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.983939 23311 consensus_queue.cc:1048] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.991220 22968 raft_consensus.cc:515] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:31.995885 22968 leader_election.cc:290] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:31.996681 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:31.997437 23041 raft_consensus.cc:3055] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.997509 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b0670a92747b48ff851abad276bdc" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:31.997810 23041 raft_consensus.cc:740] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:31.998423 23116 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.998932 23041 consensus_queue.cc:260] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.000411 23041 raft_consensus.cc:3060] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.008061 23041 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.008061 23116 raft_consensus.cc:2468] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.009385 22934 leader_election.cc:304] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:32.010178 23290 raft_consensus.cc:2804] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.010713 23290 raft_consensus.cc:697] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:32.011615 23290 consensus_queue.cc:237] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.020744 22864 catalog_manager.cc:5697] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.045956 23289 raft_consensus.cc:993] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:32.046464 23258 raft_consensus.cc:1081] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:32.048102 22968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59014
I20260709 13:11:32.048684 22968 raft_consensus.cc:493] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.049013 22968 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.054931 22968 raft_consensus.cc:515] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.057045 22968 leader_election.cc:290] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:32.057780 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:32.058265 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f66ab31496419fbd91f8626bcd50ac" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:32.058447 23041 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.058948 23116 raft_consensus.cc:3055] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.059234 23116 raft_consensus.cc:740] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:32.059960 23116 consensus_queue.cc:260] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.061080 23116 raft_consensus.cc:3060] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.063865 23041 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.065147 22931 leader_election.cc:304] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:32.066066 23290 raft_consensus.cc:2804] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.066519 23290 raft_consensus.cc:697] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:32.067374 23290 consensus_queue.cc:237] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.068063 23116 raft_consensus.cc:2468] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.074580 22864 catalog_manager.cc:5697] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.097594 23289 raft_consensus.cc:993] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: : Instructing follower cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:32.098204 23258 raft_consensus.cc:1081] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Signalling peer cfaf9e111a9b4fd8b79f8bfa0ffd19db to start an election
I20260709 13:11:32.100217 22968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
 from {username='slave'} at 127.0.0.1:59014
I20260709 13:11:32.100987 22968 raft_consensus.cc:493] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.101352 22968 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.105332 23311 consensus_queue.cc:1048] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.108539 22968 raft_consensus.cc:515] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.111490 22968 leader_election.cc:290] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Requested vote from peers 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:32.111687 23041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:32.112203 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0495fd0c25e845138c02ed88a1c3eef8" candidate_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:32.112432 23041 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.112869 23116 raft_consensus.cc:3055] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.113236 23116 raft_consensus.cc:740] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:32.113936 23116 consensus_queue.cc:260] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.115255 23116 raft_consensus.cc:3060] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.119447 23041 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.120813 22931 leader_election.cc:304] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:32.123910 23290 raft_consensus.cc:2804] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.124490 23290 raft_consensus.cc:697] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Becoming Leader. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:32.125378 23290 consensus_queue.cc:237] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.125934 23336 consensus_queue.cc:1048] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.127578 23116 raft_consensus.cc:2468] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfaf9e111a9b4fd8b79f8bfa0ffd19db in term 2.
I20260709 13:11:32.141296 22864 catalog_manager.cc:5697] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db reported cstate change: term changed from 1 to 2, leader changed from b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3) to cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1). New cstate: current_term: 2 leader_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.204243 23258 consensus_queue.cc:1048] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.217171 23258 consensus_queue.cc:1048] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.271456 23278 raft_consensus.cc:993] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:32.272109 23290 raft_consensus.cc:1081] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer 3326d8cd3827437abd58e4f78a6a648f to start an election
I20260709 13:11:32.274076 23041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:11:32.274652 23041 raft_consensus.cc:493] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.275002 23041 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.280931 23041 raft_consensus.cc:515] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.283174 23041 leader_election.cc:290] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3:38021)
I20260709 13:11:32.283768 22968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:32.283910 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3a3ee619524e039bfdd0675924f9c3" candidate_uuid: "3326d8cd3827437abd58e4f78a6a648f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
I20260709 13:11:32.284579 22968 raft_consensus.cc:3055] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.284677 23116 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.285140 22968 raft_consensus.cc:740] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:32.286026 22968 consensus_queue.cc:260] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.287833 22968 raft_consensus.cc:3060] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.290933 23116 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:32.292306 23009 leader_election.cc:304] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3326d8cd3827437abd58e4f78a6a648f, b9a36b5bd1eb4fb79ad35370a0677b57; no voters: 
I20260709 13:11:32.293162 23336 raft_consensus.cc:2804] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.293557 22968 raft_consensus.cc:2468] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3326d8cd3827437abd58e4f78a6a648f in term 2.
I20260709 13:11:32.293823 23336 raft_consensus.cc:697] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Leader. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:32.294875 23336 consensus_queue.cc:237] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:32.302912 22865 catalog_manager.cc:5697] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2). New cstate: current_term: 2 leader_uuid: "3326d8cd3827437abd58e4f78a6a648f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.320791 22968 raft_consensus.cc:1275] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.322286 23336 consensus_queue.cc:1048] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.331168 23116 raft_consensus.cc:1275] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.332775 23311 consensus_queue.cc:1048] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.354815 22968 raft_consensus.cc:1275] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.356285 23308 consensus_queue.cc:1048] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.364848 23116 raft_consensus.cc:1275] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.366710 23336 consensus_queue.cc:1048] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.503350 23116 raft_consensus.cc:1275] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.505190 23290 consensus_queue.cc:1048] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.505621 23116 raft_consensus.cc:1275] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.507133 23290 consensus_queue.cc:1048] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.514652 23041 raft_consensus.cc:1275] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.516238 23290 consensus_queue.cc:1048] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.532652 23043 raft_consensus.cc:1275] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.535184 23290 consensus_queue.cc:1048] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.570253 23041 raft_consensus.cc:1275] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.571720 23290 consensus_queue.cc:1048] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.580341 23116 raft_consensus.cc:1275] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer cfaf9e111a9b4fd8b79f8bfa0ffd19db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.582275 23290 consensus_queue.cc:1048] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.881620 23114 raft_consensus.cc:1275] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.883169 23308 consensus_queue.cc:1048] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.892143 22967 raft_consensus.cc:1275] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer 3326d8cd3827437abd58e4f78a6a648f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.893900 23336 consensus_queue.cc:1048] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.858564 22864 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38518:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:34.880034 22864 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38518:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:34.919584 11576 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:35.114467 23376 log.cc:927] Time spent T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:35.154080 22968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda"
dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
mode: GRACEFUL
new_leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:11:35.154805 22968 raft_consensus.cc:606] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Received request to transfer leadership to TS b9a36b5bd1eb4fb79ad35370a0677b57
W20260709 13:11:35.157809 23394 log.cc:927] Time spent T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:11:35.185214 23402 tablet.cc:1724] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:35.201550 23391 log.cc:927] Time spent T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:11:35.202654 23404 log.cc:927] Time spent T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Append to log took a long time: real 0.052s	user 0.005s	sys 0.000s
I20260709 13:11:35.189287 23403 tablet.cc:1724] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.216552 23405 tablet.cc:1724] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.174829 23397 tablet.cc:1724] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.223976 23401 tablet.cc:1724] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:35.229887 22931 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.2:32831, user_credentials={real_user=slave}} blocked reactor thread for 77407.5us
I20260709 13:11:35.230551 23409 tablet.cc:1724] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:35.237753 22934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.3:38021, user_credentials={real_user=slave}} blocked reactor thread for 72142.1us
I20260709 13:11:35.244773 23407 tablet.cc:1724] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.279639 23415 tablet.cc:1724] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.288691 23410 tablet.cc:1724] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.298754 23402 tablet.cc:1724] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.301709 23409 tablet.cc:1724] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.329643 23418 tablet.cc:1724] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.343178 23420 tablet.cc:1724] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.346179 23405 tablet.cc:1724] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.355717 23403 tablet.cc:1724] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.376209 23421 tablet.cc:1724] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.364559 23407 tablet.cc:1724] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.389212 23401 tablet.cc:1724] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:35.416937 23006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.78.1:41461, user_credentials={real_user=slave}} blocked reactor thread for 131898us
I20260709 13:11:35.427453 23397 tablet.cc:1724] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.430918 23418 tablet.cc:1724] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.433455 23421 tablet.cc:1724] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.446050 23411 raft_consensus.cc:993] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: : Instructing follower b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:35.446753 23411 raft_consensus.cc:1081] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Signalling peer b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:35.449375 23115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:51944
I20260709 13:11:35.450002 23115 raft_consensus.cc:493] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.450351 23115 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.457931 23415 tablet.cc:1724] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.458047 23410 tablet.cc:1724] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.461440 23402 tablet.cc:1724] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.475082 23042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b"
dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
mode: GRACEFUL
new_leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:57214
I20260709 13:11:35.475924 23042 raft_consensus.cc:606] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Received request to transfer leadership to TS b9a36b5bd1eb4fb79ad35370a0677b57
I20260709 13:11:35.482892 23418 tablet.cc:1724] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.486699 23409 tablet.cc:1724] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.503103 11576 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:35.504020 11576 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:35.497175 23420 tablet.cc:1724] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:35.525219 23115 raft_consensus.cc:515] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.532640 22964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:35.533320 22964 raft_consensus.cc:3055] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.533628 22964 raft_consensus.cc:740] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfaf9e111a9b4fd8b79f8bfa0ffd19db, State: Running, Role: LEADER
I20260709 13:11:35.534499 22964 consensus_queue.cc:260] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.535707 22964 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.539942 23115 leader_election.cc:290] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 2 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:35.541685 23042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a3a12d815f4d0da46463297152bcda" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:35.549289 23042 raft_consensus.cc:3060] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.562604 22964 raft_consensus.cc:2468] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 2.
I20260709 13:11:35.563455 23042 raft_consensus.cc:2468] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 2.
I20260709 13:11:35.564395 23080 leader_election.cc:304] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:35.565646 23388 raft_consensus.cc:2804] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.566143 23388 raft_consensus.cc:697] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:35.566854 23388 consensus_queue.cc:237] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.568979 22863 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: soft_deleted_table [id=a71695910edb4de6b96d62fde632c15a] alter complete (version 1)
I20260709 13:11:35.579608 22864 catalog_manager.cc:5697] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 1 to 2, leader changed from cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1) to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 2 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.857992 23416 raft_consensus.cc:993] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: : Instructing follower b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:35.858493 23416 raft_consensus.cc:1081] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Signalling peer b9a36b5bd1eb4fb79ad35370a0677b57 to start an election
I20260709 13:11:35.860221 23115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b"
dest_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:11:35.860962 23115 raft_consensus.cc:493] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.861318 23115 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.867336 23115 raft_consensus.cc:515] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.869568 23115 leader_election.cc:290] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 3 election: Requested vote from peers cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461), 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831)
I20260709 13:11:35.870949 22966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db"
I20260709 13:11:35.871003 23040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58d59b8c8274ee0a96eba36acc79e1b" candidate_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3326d8cd3827437abd58e4f78a6a648f"
I20260709 13:11:35.871737 22966 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.871948 23040 raft_consensus.cc:3055] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:35.872480 23040 raft_consensus.cc:740] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3326d8cd3827437abd58e4f78a6a648f, State: Running, Role: LEADER
I20260709 13:11:35.873260 23040 consensus_queue.cc:260] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.874326 23040 raft_consensus.cc:3060] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.877925 22966 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 3.
I20260709 13:11:35.879514 23080 leader_election.cc:304] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9a36b5bd1eb4fb79ad35370a0677b57, cfaf9e111a9b4fd8b79f8bfa0ffd19db; no voters: 
I20260709 13:11:35.880329 23388 raft_consensus.cc:2804] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:35.880789 23388 raft_consensus.cc:697] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 3 LEADER]: Becoming Leader. State: Replica: b9a36b5bd1eb4fb79ad35370a0677b57, State: Running, Role: LEADER
I20260709 13:11:35.881657 23388 consensus_queue.cc:237] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } }
I20260709 13:11:35.882751 23040 raft_consensus.cc:2468] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9a36b5bd1eb4fb79ad35370a0677b57 in term 3.
I20260709 13:11:35.893503 22864 catalog_manager.cc:5697] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 reported cstate change: term changed from 2 to 3, leader changed from 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2) to b9a36b5bd1eb4fb79ad35370a0677b57 (127.11.78.3). New cstate: current_term: 3 leader_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9a36b5bd1eb4fb79ad35370a0677b57" member_type: VOTER last_known_addr { host: "127.11.78.3" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.057783 22966 raft_consensus.cc:1275] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:36.059532 23388 consensus_queue.cc:1048] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:36.071012 23040 raft_consensus.cc:1275] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:36.073513 23432 consensus_queue.cc:1048] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:36.357009 22967 raft_consensus.cc:1275] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 3 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:36.358487 23388 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfaf9e111a9b4fd8b79f8bfa0ffd19db" member_type: VOTER last_known_addr { host: "127.11.78.1" port: 41461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.384099 23040 raft_consensus.cc:1275] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 3 FOLLOWER]: Refusing update from remote peer b9a36b5bd1eb4fb79ad35370a0677b57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:36.386811 23379 consensus_queue.cc:1048] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3326d8cd3827437abd58e4f78a6a648f" member_type: VOTER last_known_addr { host: "127.11.78.2" port: 32831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.578409 11576 tablet_server.cc:179] TabletServer@127.11.78.1:0 shutting down...
I20260709 13:11:36.619153 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:36.620539 11576 tablet_replica.cc:333] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.622184 11576 raft_consensus.cc:2243] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.623304 11576 raft_consensus.cc:2272] T 0f5a7099a8384455a812b2a68ba281c8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.626556 11576 tablet_replica.cc:333] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.627345 11576 raft_consensus.cc:2243] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.627882 11576 raft_consensus.cc:2272] T 8ae5f8f2a945454b91f4859744ec4ac4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.632154 11576 tablet_replica.cc:333] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.633349 11576 raft_consensus.cc:2243] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.634425 11576 raft_consensus.cc:2272] T 5de31d1ef1de4b558c5dc638537b8d96 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.638849 11576 tablet_replica.cc:333] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.640064 11576 raft_consensus.cc:2243] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.641144 11576 raft_consensus.cc:2272] T eb3a3ee619524e039bfdd0675924f9c3 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.644815 11576 tablet_replica.cc:333] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.645502 11576 raft_consensus.cc:2243] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.646499 11576 raft_consensus.cc:2272] T d5f66ab31496419fbd91f8626bcd50ac P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.649211 11576 tablet_replica.cc:333] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.649899 11576 raft_consensus.cc:2243] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.650450 11576 raft_consensus.cc:2272] T d163a730a2b3441f9eeca1aedaa447d8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.653311 11576 tablet_replica.cc:333] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.653913 11576 raft_consensus.cc:2243] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.654842 11576 raft_consensus.cc:2272] T a38b0670a92747b48ff851abad276bdc P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.657490 11576 tablet_replica.cc:333] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.658284 11576 raft_consensus.cc:2243] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.658847 11576 raft_consensus.cc:2272] T d6cabc6582df46be9f2bb1de64cb9a1c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.664179 11576 tablet_replica.cc:333] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.665390 11576 raft_consensus.cc:2243] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.667167 11576 raft_consensus.cc:2272] T c7c63c4dac964c74ad67410e25b4fde4 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.668888 23080 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:11:36.671659 11576 tablet_replica.cc:333] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.672888 11576 raft_consensus.cc:2243] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:36.673316 23080 consensus_peers.cc:597] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.674196 11576 raft_consensus.cc:2272] T 069e6e43e1ff403aaaf3d856b334b82c P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.677852 11576 tablet_replica.cc:333] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.678823 11576 raft_consensus.cc:2243] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.680207 11576 raft_consensus.cc:2272] T 0495fd0c25e845138c02ed88a1c3eef8 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.680644 23080 consensus_peers.cc:597] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.684113 11576 tablet_replica.cc:333] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.685256 11576 raft_consensus.cc:2243] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.686390 11576 raft_consensus.cc:2272] T c8b935a1298f452b98407f31f5b80307 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.687182 23006 consensus_peers.cc:597] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.689875 23080 consensus_peers.cc:597] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.690376 11576 tablet_replica.cc:333] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.691299 11576 raft_consensus.cc:2243] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.691933 11576 raft_consensus.cc:2272] T 50a3a12d815f4d0da46463297152bcda P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.695643 11576 tablet_replica.cc:333] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.696390 11576 raft_consensus.cc:2243] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.697000 11576 raft_consensus.cc:2272] T c7d30a9cde334427be79e05cb5d521bb P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.699898 11576 tablet_replica.cc:333] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.700506 11576 raft_consensus.cc:2243] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.701056 11576 raft_consensus.cc:2272] T c014062df5e24baa9b6a397533bee16a P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.703768 11576 tablet_replica.cc:333] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.704384 11576 raft_consensus.cc:2243] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.704870 11576 raft_consensus.cc:2272] T b58d59b8c8274ee0a96eba36acc79e1b P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.709456 11576 tablet_replica.cc:333] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.710217 11576 raft_consensus.cc:2243] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:36.711478 23006 consensus_peers.cc:597] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.712108 11576 raft_consensus.cc:2272] T 8d7c6506b0934ec998680a669f9e9673 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.715272 11576 tablet_replica.cc:333] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db: stopping tablet replica
I20260709 13:11:36.715902 11576 raft_consensus.cc:2243] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.717113 11576 raft_consensus.cc:2272] T 9d57edd2238b4de19f87575c99a7a256 P cfaf9e111a9b4fd8b79f8bfa0ffd19db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.767400 11576 tablet_server.cc:196] TabletServer@127.11.78.1:0 shutdown complete.
W20260709 13:11:36.799558 23006 consensus_peers.cc:597] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:41461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.827111 11576 tablet_server.cc:179] TabletServer@127.11.78.2:0 shutting down...
W20260709 13:11:36.827728 23006 consensus_peers.cc:597] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:41461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.852352 23006 consensus_peers.cc:597] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:41461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.861505 23080 consensus_peers.cc:597] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 -> Peer cfaf9e111a9b4fd8b79f8bfa0ffd19db (127.11.78.1:41461): Couldn't send request to peer cfaf9e111a9b4fd8b79f8bfa0ffd19db. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.1:41461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.865154 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:36.866149 11576 tablet_replica.cc:333] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.867136 11576 raft_consensus.cc:2243] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.867861 11576 raft_consensus.cc:2272] T 0f5a7099a8384455a812b2a68ba281c8 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.870491 11576 tablet_replica.cc:333] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.871169 11576 raft_consensus.cc:2243] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.872233 11576 raft_consensus.cc:2272] T 8ae5f8f2a945454b91f4859744ec4ac4 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.874616 11576 tablet_replica.cc:333] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.875367 11576 raft_consensus.cc:2243] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.876497 11576 raft_consensus.cc:2272] T 5de31d1ef1de4b558c5dc638537b8d96 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.879215 11576 tablet_replica.cc:333] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.879938 11576 raft_consensus.cc:2243] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.880628 11576 raft_consensus.cc:2272] T 0495fd0c25e845138c02ed88a1c3eef8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.883339 11576 tablet_replica.cc:333] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.883983 11576 raft_consensus.cc:2243] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.884598 11576 raft_consensus.cc:2272] T d5f66ab31496419fbd91f8626bcd50ac P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.887071 11576 tablet_replica.cc:333] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.887737 11576 raft_consensus.cc:2243] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.888754 11576 raft_consensus.cc:2272] T d163a730a2b3441f9eeca1aedaa447d8 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.891148 11576 tablet_replica.cc:333] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.891827 11576 raft_consensus.cc:2243] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.892468 11576 raft_consensus.cc:2272] T a38b0670a92747b48ff851abad276bdc P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.894776 11576 tablet_replica.cc:333] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.895362 11576 raft_consensus.cc:2243] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.896430 11576 raft_consensus.cc:2272] T d6cabc6582df46be9f2bb1de64cb9a1c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.898984 11576 tablet_replica.cc:333] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.899643 11576 raft_consensus.cc:2243] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.900225 11576 raft_consensus.cc:2272] T c7c63c4dac964c74ad67410e25b4fde4 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.904415 11576 tablet_replica.cc:333] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.905098 11576 raft_consensus.cc:2243] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.906250 11576 raft_consensus.cc:2272] T eb3a3ee619524e039bfdd0675924f9c3 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.909327 11576 tablet_replica.cc:333] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.909875 11576 raft_consensus.cc:2243] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.910378 11576 raft_consensus.cc:2272] T 069e6e43e1ff403aaaf3d856b334b82c P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.913260 11576 tablet_replica.cc:333] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.913798 11576 raft_consensus.cc:2243] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.914701 11576 raft_consensus.cc:2272] T c8b935a1298f452b98407f31f5b80307 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.917064 11576 tablet_replica.cc:333] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.917562 11576 raft_consensus.cc:2243] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.918051 11576 raft_consensus.cc:2272] T 50a3a12d815f4d0da46463297152bcda P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.921000 11576 tablet_replica.cc:333] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.921561 11576 raft_consensus.cc:2243] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.922070 11576 raft_consensus.cc:2272] T c7d30a9cde334427be79e05cb5d521bb P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.924312 11576 tablet_replica.cc:333] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.924840 11576 raft_consensus.cc:2243] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.925290 11576 raft_consensus.cc:2272] T b58d59b8c8274ee0a96eba36acc79e1b P 3326d8cd3827437abd58e4f78a6a648f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.928295 11576 tablet_replica.cc:333] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.928869 11576 raft_consensus.cc:2243] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.929806 11576 raft_consensus.cc:2272] T c014062df5e24baa9b6a397533bee16a P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.932017 11576 tablet_replica.cc:333] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.932649 11576 raft_consensus.cc:2243] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.933179 11576 raft_consensus.cc:2272] T 8d7c6506b0934ec998680a669f9e9673 P 3326d8cd3827437abd58e4f78a6a648f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.935371 11576 tablet_replica.cc:333] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f: stopping tablet replica
I20260709 13:11:36.935891 11576 raft_consensus.cc:2243] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.936439 11576 raft_consensus.cc:2272] T 9d57edd2238b4de19f87575c99a7a256 P 3326d8cd3827437abd58e4f78a6a648f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.983372 11576 tablet_server.cc:196] TabletServer@127.11.78.2:0 shutdown complete.
W20260709 13:11:37.022094 23080 consensus_peers.cc:597] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 -> Peer 3326d8cd3827437abd58e4f78a6a648f (127.11.78.2:32831): Couldn't send request to peer 3326d8cd3827437abd58e4f78a6a648f. Status: Network error: Client connection negotiation failed: client connection to 127.11.78.2:32831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.027379 11576 tablet_server.cc:179] TabletServer@127.11.78.3:0 shutting down...
I20260709 13:11:37.065323 11576 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:37.066258 11576 tablet_replica.cc:333] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.067181 11576 raft_consensus.cc:2243] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.068401 11576 raft_consensus.cc:2272] T 0f5a7099a8384455a812b2a68ba281c8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.071892 11576 tablet_replica.cc:333] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.072666 11576 raft_consensus.cc:2243] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.073314 11576 raft_consensus.cc:2272] T 5de31d1ef1de4b558c5dc638537b8d96 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.075733 11576 tablet_replica.cc:333] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.076455 11576 raft_consensus.cc:2243] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.077031 11576 raft_consensus.cc:2272] T eb3a3ee619524e039bfdd0675924f9c3 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.079500 11576 tablet_replica.cc:333] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.080258 11576 raft_consensus.cc:2243] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.080849 11576 raft_consensus.cc:2272] T 8ae5f8f2a945454b91f4859744ec4ac4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.083493 11576 tablet_replica.cc:333] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.084173 11576 raft_consensus.cc:2243] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.084753 11576 raft_consensus.cc:2272] T 0495fd0c25e845138c02ed88a1c3eef8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.087103 11576 tablet_replica.cc:333] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.087739 11576 raft_consensus.cc:2243] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.088373 11576 raft_consensus.cc:2272] T d5f66ab31496419fbd91f8626bcd50ac P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.091058 11576 tablet_replica.cc:333] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.091713 11576 raft_consensus.cc:2243] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.092216 11576 raft_consensus.cc:2272] T d163a730a2b3441f9eeca1aedaa447d8 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.094570 11576 tablet_replica.cc:333] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.095141 11576 raft_consensus.cc:2243] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.095640 11576 raft_consensus.cc:2272] T c8b935a1298f452b98407f31f5b80307 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.098029 11576 tablet_replica.cc:333] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.098758 11576 raft_consensus.cc:2243] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.099756 11576 raft_consensus.cc:2272] T 50a3a12d815f4d0da46463297152bcda P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.102141 11576 tablet_replica.cc:333] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.102886 11576 raft_consensus.cc:2243] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.103900 11576 raft_consensus.cc:2272] T c7d30a9cde334427be79e05cb5d521bb P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.106380 11576 tablet_replica.cc:333] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.107034 11576 raft_consensus.cc:2243] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.107534 11576 raft_consensus.cc:2272] T c014062df5e24baa9b6a397533bee16a P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.109946 11576 tablet_replica.cc:333] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.110591 11576 raft_consensus.cc:2243] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.111459 11576 raft_consensus.cc:2272] T b58d59b8c8274ee0a96eba36acc79e1b P b9a36b5bd1eb4fb79ad35370a0677b57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.114389 11576 tablet_replica.cc:333] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.115034 11576 raft_consensus.cc:2243] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.115595 11576 raft_consensus.cc:2272] T a38b0670a92747b48ff851abad276bdc P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.118054 11576 tablet_replica.cc:333] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.118647 11576 raft_consensus.cc:2243] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.119189 11576 raft_consensus.cc:2272] T d6cabc6582df46be9f2bb1de64cb9a1c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.121549 11576 tablet_replica.cc:333] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.122165 11576 raft_consensus.cc:2243] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.122689 11576 raft_consensus.cc:2272] T c7c63c4dac964c74ad67410e25b4fde4 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.125090 11576 tablet_replica.cc:333] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.125705 11576 raft_consensus.cc:2243] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.126245 11576 raft_consensus.cc:2272] T 069e6e43e1ff403aaaf3d856b334b82c P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.128720 11576 tablet_replica.cc:333] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.129364 11576 raft_consensus.cc:2243] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.129977 11576 raft_consensus.cc:2272] T 8d7c6506b0934ec998680a669f9e9673 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.132397 11576 tablet_replica.cc:333] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57: stopping tablet replica
I20260709 13:11:37.132901 11576 raft_consensus.cc:2243] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.133406 11576 raft_consensus.cc:2272] T 9d57edd2238b4de19f87575c99a7a256 P b9a36b5bd1eb4fb79ad35370a0677b57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.180624 11576 tablet_server.cc:196] TabletServer@127.11.78.3:0 shutdown complete.
I20260709 13:11:37.227702 11576 master.cc:562] Master@127.11.78.62:38335 shutting down...
I20260709 13:11:37.255302 11576 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.255968 11576 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.256412 11576 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7f68f4edb3044ac7bb16413b5af80e47: stopping tablet replica
I20260709 13:11:37.278607 11576 master.cc:584] Master@127.11.78.62:38335 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12187 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25290 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (351101 ms total)
[  PASSED  ] 8 tests.
I20260709 13:11:37.342221 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 423 messages since previous log ~15 seconds ago
I20260709 13:11:37.342562 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 423 messages since previous log ~15 seconds ago
I20260709 13:11:37.342758 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 422 messages since previous log ~15 seconds ago
I20260709 13:11:37.343048 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:11:37.343276 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:11:37.343528 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~188 seconds ago
I20260709 13:11:37.343859 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:11:37.344214 11576 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 38 messages since previous log ~10 seconds ago
